Direct broadcasting room draggable layout interaction method and system based on dynamic gesture recognition

Abstract

The invention relates to the technical field of feature recognition, and discloses a live broadcast room draggable layout interaction method and system based on dynamic gesture recognition, and the method comprises the steps: constructing a layout adjustment controller through employing the dragging authority and operation boundary of interactive elements; according to the layout change rate and the effective operation range of the interactive elements, extracting gesture interaction response features of the target user in the interactive element dragging process; extracting space trajectory features and motion rhythm rules corresponding to the interactive elements, and identifying a dragging interaction intention of the target user; generating a personalized layout adjustment instruction by combining the dragging interaction intention and the gesture interaction response characteristics; according to the adaptive layout constraint condition and the layout adjustment controller, creating a visual feedback view of the live broadcast room; and based on the dragging interaction intention, generating a draggable interaction layout of the live broadcast room through the personalized layout adjustment instruction and the visual feedback view. According to the invention, the convenience and accuracy of layout adjustment of the live broadcast room can be improved.

Description

Technical Field

[0001] This invention relates to a draggable layout interaction method and system for live streaming rooms based on dynamic gesture recognition, belonging to the field of feature recognition technology. Background Technology

[0002] Drag-and-drop layout interaction in live streaming rooms refers to the process of scaling, reorganizing, and adjusting the layout of live streaming rooms by capturing real-time drag-and-drop operation data (such as drag trajectory, stopping position, and operation force) and combining it with the display characteristics of live streaming room elements. This can effectively improve the user's interactive experience and interface utilization. However, the types of elements in live streaming rooms are complex and diverse, and users' operating habits vary greatly. These factors make it difficult for the smoothness and adaptability of live streaming room layout adjustments to fully meet actual needs, thus limiting further improvement in the interactive experience and interface utilization of live streaming rooms. Therefore, optimizing and improving drag-and-drop layout interaction technology in live streaming rooms is particularly crucial.

[0003] Existing methods mostly rely on a single operation mode with a fixed trigger area, such as dragging a button with a mouse or sliding a border on the touch screen, to adjust the layout of the live broadcast room. Although this method is intuitive, it cannot achieve real-time dynamic recognition of user operation intentions and intelligent adaptation of layout schemes, resulting in insufficient convenience and accuracy of live broadcast room layout adjustments.

[0004] Therefore, there is an urgent need for a solution that can improve the convenience and accuracy of adjusting the layout of live streaming rooms. Summary of the Invention

[0005] This invention provides a draggable layout interaction method and system for live streaming rooms based on dynamic gesture recognition, the main purpose of which is to improve the convenience and accuracy of adjusting the layout of live streaming rooms.

[0006] To achieve the above objectives, the present invention provides a draggable layout interaction method for live streaming rooms based on dynamic gesture recognition, comprising:

[0007] Obtain the interactive elements of the target user in the live broadcast room, determine the drag permissions and operation boundaries of the interactive elements, and construct the layout adjustment controller of the interactive elements based on the drag permissions and operation boundaries.

[0008] Based on the layout adjustment controller, the gesture-element association features of the live broadcast room are extracted. Based on the gesture-element association features, the layout change rate and effective operation range of the interactive elements are determined. Based on the layout change rate and the effective operation range, the interface layout adaptability of the interactive elements is calculated.

[0009] According to the interactive element, real-time gesture action data of the target user is collected, spatial trajectory features and motion rhythm rules corresponding to the interactive element are extracted based on the real-time gesture action data, and a drag interaction intention of the target user is recognized according to the spatial trajectory features and the motion rhythm rules;

[0010] Based on the interface layout adaptation degree, gesture interaction response features of the target user in the drag process of the interactive element are extracted, and a personalized layout adjustment instruction of the interactive element is generated according to the drag interaction intention and the gesture interaction response features;

[0011] Real-time monitoring of the interface running state of the live room, based on the personalized layout adjustment instruction and the interface running state, setting the adaptive layout constraint condition of the interactive element, according to the adaptive layout constraint condition and the layout adjustment controller, creating the visual feedback view of the live room;

[0012] Based on the drag interaction intention, the personalized layout adjustment instruction and the visual feedback view are used to generate a draggable interactive layout of the live room.

[0013] Optionally, the layout adjustment controller of the interactive element is constructed according to the drag permission and the operation boundary, including:

[0014] Obtaining the operation permission condition corresponding to the drag permission and the operation boundary;

[0015] Extracting key restriction parameters in the operation permission condition;

[0016] Identify the spatial topological relationship between the interactive elements;

[0017] According to the spatial topological relationship, the correlation coefficient of the interactive element is calculated;

[0018] Based on the key restriction parameters and the correlation coefficient, a control priority queue of the interactive element is generated;

[0019] According to the control priority queue, the hierarchical adjustment rule of the interactive element is set, and the rule conflict arbitration mechanism of the hierarchical adjustment rule is established;

[0020] Combined with the control priority queue, the hierarchical adjustment rule and the rule conflict arbitration mechanism, the layout adjustment controller of the interactive element is constructed.

[0021] Optionally, the gesture-element association features of the live room are extracted based on the layout adjustment controller, including:

[0022] Collecting a gesture input sequence and an element response sequence of the live room based on the layout adjustment controller;

[0023] Performing synchronous alignment processing of the gesture input sequence and the element response sequence by using a dynamic time warping algorithm to obtain a timing matching pair;

[0024] Constructing a gesture-element linkage probability distribution graph of the live room based on the timing matching pair;

[0025] Extracting a gesture-element association feature of the live room through the gesture-element linkage probability distribution graph.

[0026] Optionally, the determining of the layout change rate and the effective operation range of the interactive element according to the gesture-element association feature comprises:

[0027] According to the gesture-element association feature, acquiring spatiotemporal sequence data and spatial coordinate data of the interactive element;

[0028] Based on the spatiotemporal sequence data, extracting gesture dynamics features corresponding to the interactive element;

[0029] According to the gesture dynamics features, generating a dynamic response parameter set of the interactive element;

[0030] Determining the layout change rate of the interactive element through the dynamic response parameter set;

[0031] Based on the spatial coordinate data, establishing a spatial coordinate curve of the interactive element;

[0032] Identifying key coordinate points of the spatial coordinate curve, and determining a gesture convex hull boundary corresponding to the interactive element through the key coordinate points;

[0033] According to the gesture convex hull boundary, constructing an initial operation range constraint set of the interactive element;

[0034] Combining the dynamic response parameter set and the initial operation range constraint set, determining the effective operation range of the interactive element.

[0035] Optionally, the identifying of the target user's drag interaction intention according to the spatial trajectory feature and the motion rhythm law comprises:

[0036] Performing normalization processing on the spatial trajectory feature and the motion rhythm law to generate a standardized feature set;

[0037] Extracting a spatiotemporal association feature of the standardized feature set, and identifying a drag operation mode of the target user based on the spatiotemporal association feature;

[0038] analyze a state evolution rule of the drag operation mode;

[0039] generate a drag state transition matrix of the target user according to the state evolution rule;

[0040] construct a drag intention recognition network of the target user based on the drag state transition matrix;

[0041] identify a drag interaction intention of the target user through the drag intention recognition network.

[0042] Optionally, the gesture interaction response features of the target user in the drag process of the interactive element are extracted based on the interface layout adaptation degree, including:

[0043] obtain a drag speed of the target user in the drag process of the interactive element, and calculate a speed change rate of the drag speed;

[0044] perform a segmentation processing of the drag process according to the speed change rate to obtain a drag operation stage;

[0045] identify a current drag operation intention of the target user based on the drag operation stage, and determine a current interface element type corresponding to the interactive element;

[0046] define an adaptive threshold of the interface layout adaptation degree through the current drag operation intention and the current interface element type;

[0047] divide a drag behavior mode of the target user in the drag operation stage according to the adaptive threshold;

[0048] calculate a cross-mode feature offset of the target user based on the drag behavior mode;

[0049] perform a clustering processing of the drag operation of the target user according to the cross-mode feature offset to obtain a classified operation style group;

[0050] collect gesture dynamic data of the classified operation style group, and filter out a key indicator strongly associated with the interface layout adaptation degree from the gesture dynamic data;

[0051] extract gesture interaction response features of the target user based on the key indicator.

[0052] Optionally, the personalized layout adjustment instruction of the interactive element is generated according to the drag interaction intention and the gesture interaction response features, including:

[0053] reconstruct a motion trajectory of the interactive element according to the drag interaction intention and the gesture interaction response feature;

[0054] calculate a motion coherence index of the motion trajectory;

[0055] identify a drag behavior corresponding to the interactive element based on the motion trajectory and the gesture interaction response feature;

[0056] extract a fine-tuning stability indicator in the drag behavior;

[0057] quantify a gesture performance indicator of the interactive element in combination with the motion coherence index and the fine-tuning stability indicator;

[0058] analyze a layout adaptation requirement corresponding to the gesture performance indicator;

[0059] construct a layout adjustment decision rule corresponding to the interactive element based on the gesture performance indicator and the layout adaptation requirement;

[0060] identify a typical drag scenario of the interactive element according to the layout adjustment decision rule;

[0061] generate an individualized layout adjustment instruction of the interactive element based on the typical drag scenario.

[0062] Optionally, the setting of the adaptive layout constraint condition of the interactive element based on the individualized layout adjustment instruction and the interface running state comprises:

[0063] identify a user operation preference corresponding to the interactive element according to the individualized layout adjustment instruction;

[0064] determine a system real-time performance indicator corresponding to the interactive element based on the interface running state;

[0065] construct a dynamic layout constraint evaluation system of the interactive element according to the user operation preference and the system real-time performance indicator;

[0066] calculate a layout adaptation degree score of the interactive element under different constraint conditions through the dynamic layout constraint evaluation system:

[0067] select a candidate layout constraint condition set of the interactive element according to the layout adaptation degree score;

[0068] perform a feasibility verification process on the candidate layout constraint condition set to obtain a target layout constraint condition;

[0069] Based on the dynamic layout constraint evaluation system, real-time monitoring of the key indicators of the target layout constraint condition is performed to establish a dynamic baseline comparison mechanism;

[0070] According to the dynamic baseline comparison mechanism, a double-channel feedback node of the target layout constraint condition is set;

[0071] In combination with the dynamic layout constraint evaluation system, the dynamic baseline comparison mechanism and the double-channel feedback node, an adaptive layout constraint condition of the interactive element is set.

[0072] Optionally, according to the adaptive layout constraint condition and the layout adjustment controller, a visual feedback view of the live room is created, which comprises:

[0073] Synchronously collecting a dynamic relaxation parameter of the adaptive layout constraint condition and an instruction conflict marker bit of the layout adjustment controller;

[0074] According to the dynamic relaxation parameter, a stretchable area of the live room is determined;

[0075] Performing decoding processing of the instruction conflict marker bit to determine a conflict type;

[0076] Based on the stretchable area, an elastic grid layer of the live room is generated;

[0077] According to the conflict type, a fault diagnosis identifier of the live room is set;

[0078] Identifying a physical screen boundary and a key element locking area of the live room;

[0079] In combination with the dynamic relaxation parameter, the physical screen boundary and the key element locking area, an adjustable threshold of the elastic grid layer is set;

[0080] Based on the adjustable threshold, a layout adjustment guide line of the live room is generated;

[0081] Associating and mapping the fault diagnosis identifier with a conflict resolution solution of the layout adjustment controller to obtain a fault operation guide;

[0082] Integrating the elastic grid layer, the fault diagnosis identifier, the layout adjustment guide line and the fault operation guide to create a visual feedback view of the live room.

[0083] In order to solve the above problems, the application also provides a live room dragable layout interaction system based on dynamic gesture recognition, which comprises:

[0084] A condition recognition module is configured to acquire an interactive element of a target user in a live broadcast room, determine a dragging permission and an operation boundary of the interactive element, and construct a layout adjustment controller of the interactive element according to the dragging permission and the operation boundary.

[0085] An adaptation analysis module is configured to extract gesture-element association features of the live broadcast room based on the layout adjustment controller, determine a layout change rate and an effective operation range of the interactive element according to the gesture-element association features, and calculate an interface layout adaptation degree of the interactive element based on the layout change rate and the effective operation range.

[0086] An intention recognition module is configured to collect real-time gesture action data of the target user according to the interactive element, extract spatial trajectory features and motion rhythm rules corresponding to the interactive element based on the real-time gesture action data, and recognize a dragging interaction intention of the target user according to the spatial trajectory features and the motion rhythm rules.

[0087] An instruction generation module is configured to extract gesture interaction response features of the target user in a dragging process of the interactive element based on the interface layout adaptation degree, and generate a personalized layout adjustment instruction of the interactive element according to the dragging interaction intention and the gesture interaction response features.

[0088] A visual feedback module is configured to monitor an interface running state of the live broadcast room in real time, set adaptive layout constraint conditions of the interactive element based on the personalized layout adjustment instruction and the interface running state, and create a visual feedback view of the live broadcast room according to the adaptive layout constraint conditions and the layout adjustment controller.

[0089] A layout output module is configured to generate a draggable interactive layout of the live broadcast room through the personalized layout adjustment instruction and the visual feedback view based on the dragging interaction intention.

[0090] Compared with the problems described in the background art, the embodiments of the present application can ensure that the drag operation in the live room is carried out within a reasonable and controllable range by determining the drag permission and the operation boundary of the interactive element. Further, the embodiments of the present application can integrate scattered permission rules and boundary limit data to form a multi-dimensional and collaborative layout control system by constructing a layout adjustment controller of the interactive element according to the drag permission and the operation boundary, thereby providing a structured framework for precisely matching user interaction intention and element adjustment logic, ensuring orderly management and control of drag operation in complex live scenes, and improving the overall adaptation capability of interactive element layout adjustment. The embodiments of the present application can significantly enhance the naturalness and intuitiveness of the dragable interaction in the live room, improve the accuracy and flexibility of the layout adjustment in the live room, and further determine the layout change rate and the effective operation range of the interactive element according to the gesture-element association feature, thereby converting abstract gesture interaction rules into executable dynamic adjustment indicators, providing a quantitative benchmark for precise matching of gesture operation and element response, and significantly enhancing the ability to ensure operation fluency and boundary controllability in complex interactive scenes in the live room. The embodiments of the present application can optimize the adjustment accuracy of dynamic gestures on the interface layout of the live room based on the layout change rate and the effective operation range, and can ensure the matching degree of the layout change of the interface element and the user gesture operation, thereby improving the fluency of the layout interaction in the live room and the user operation experience. Further, the embodiments of the present application can extract the spatial trajectory feature and the motion rhythm rule corresponding to the interactive element based on the real-time gesture action data, thereby accurately identifying the interactive trajectory mode and the operation rhythm feature of the user for a specific interface element, and ensuring that the subsequent interface layout adjustment is highly consistent with the user interaction habit and operation intention. The embodiments of the present application can provide a basis for distinguishing between the effective operation and the accidental touch behavior of the user by identifying the drag interaction intention of the target user according to the spatial trajectory feature and the motion rhythm rule, and can avoid operation interruption or experience fragmentation caused by mismatch between interaction feedback and actual operation intention. Further, the embodiments of the present application can extract the gesture interaction response feature of the target user in the drag process of the interactive element based on the interface layout adaptation degree, thereby dynamically quantifying the real-time matching deviation between user operation and interface layout, and improving the intelligence of the layout interaction in the live room and the fluency of user operation.This invention, through generating personalized layout adjustment instructions for interactive elements based on the drag-and-drop interaction intent and the gesture interaction response characteristics, can enhance the accuracy of the interface layout's adaptation to user operating habits, while also improving the smoothness and user experience of live streaming interactions. Furthermore, by setting adaptive layout constraints for interactive elements based on the personalized layout adjustment instructions and the interface's running state, this invention can accurately match user operating habits with real-time interface performance, thereby improving the accuracy of layout adjustment adaptation. Simultaneously, by dynamically optimizing the constraint strength, it can improve the stability of interface interactions. This invention, through creating a layout adjustment controller based on the adaptive layout constraints, can further enhance the accuracy of the layout adjustment adaptation. The visual feedback view of the live streaming room can map the adaptation relationship between gesture operations and layout constraints in real time, enhancing the user's perception of the interaction boundaries and improving the accuracy and efficiency of live streaming room layout adjustments. Finally, this embodiment of the invention generates a draggable interactive layout for the live streaming room based on the drag-and-drop interaction intent, the personalized layout adjustment command, and the visual feedback view. This ensures that the live streaming room layout accurately matches the operating habits of different users, increases the user's freedom of control over the layout, and achieves dynamic adaptation of layout forms in different live streaming scenarios. Simultaneously, it provides intuitive user behavior data support for iterative innovation in live streaming room interaction design, fundamentally enhancing the content presentation quality and user engagement in complex interactive scenarios. Therefore, the draggable layout interaction method and system for live streaming rooms based on dynamic gesture recognition provided by this embodiment of the invention can improve the convenience and accuracy of live streaming room layout adjustments. Attached Figure Description

[0091] Figure 1 This is a flowchart illustrating a draggable layout interaction method for a live streaming room based on dynamic gesture recognition, provided in an embodiment of the present invention.

[0092] Figure 2 A schematic diagram of the gesture convex hull boundary of a draggable layout interaction method for a live streaming room based on dynamic gesture recognition, provided in an embodiment of the present invention.

[0093] Figure 3 This is a functional module diagram of a draggable layout interactive system for a live streaming room based on dynamic gesture recognition, provided as an embodiment of the present invention.

[0094] The objectives, features, and advantages of this invention will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. Detailed Implementation

[0095] It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

[0096] The embodiment of the present application provides a live room dragable layout interaction method based on dynamic gesture recognition. The execution subject of the live room dragable layout interaction method based on dynamic gesture recognition includes but is not limited to at least one of the electronic devices such as a server, a terminal and the like which can be configured to execute the method provided by the embodiment of the present application. In other words, the live room dragable layout interaction method based on dynamic gesture recognition can be executed by software or hardware installed in a terminal device or a server device. The server includes but is not limited to a single server, a server cluster, a cloud server or a cloud server cluster and the like.

[0097] Referring to Figure 1 Fig. 1 is a flowchart of a live room dragable layout interaction method based on dynamic gesture recognition provided by an embodiment of the present application. In the embodiment, the live room dragable layout interaction method based on dynamic gesture recognition includes the following steps.

[0098] S1, acquiring an interactive element of a target user in a live room, determining a drag permission and an operation boundary of the interactive element, and constructing a layout adjustment controller of the interactive element according to the drag permission and the operation boundary.

[0099] The embodiment of the present application can determine the specific action object and range of the interactive operation by acquiring the interactive element of the target user in the live room. The target user refers to a specific user group such as a consumer, an anchor and the like who performs watching and interactive operation in the live room. The live room refers to a digital virtual space for carrying out live activities, including a live picture display area, an interactive function area (such as a barrage area, a comment area, a gift panel and the like) and a plurality of function modules. The interactive element refers to an interface object in the live room which can be moved, scaled, hidden and the like by a user or an anchor through gesture, click and the like operation modes, such as a live main window, a suspended gift special effect frame, a barrage display area, an interactive button and the like.

[0100] Further, the embodiment of the present application can ensure that the drag operation in the live room is within a reasonable and controllable range by determining the drag permission and operation boundary of the interactive element. The drag permission refers to the division of operation permission set for the interactive element in the live room, which is used to determine which interactive element allows the target user to perform the drag operation, which interactive element only allows the anchor to operate, or different levels of users have different drag permission ranges. For example, the anchor can drag and scale the size of the live main picture, the guest mic window, the product explanation PPT panel, and other core content areas. In addition to the drag permission of the ordinary user, the paid member user can also drag the exclusive gift special effect display box. The operation boundary refers to the spatial and logical restrictions on the interactive element during the dragging process, including the area range that can be dragged, the size limitation during the dragging, and the interaction limitation between elements, etc. For example, the live main picture can be dragged within the 80% area in the center of the screen, but cannot be dragged out of the 20% boundary at the edge of the screen.

[0101] Optionally, the drag permission of the interactive element can be determined by the user role level and the element function attribute, and the operation boundary can be determined by the live room interface layout specification and the user interaction experience demand.

[0102] The embodiment of the present application can integrate scattered permission rules and boundary limitation data to form a multi-dimensional and collaborative layout control system by constructing the layout adjustment controller of the interactive element according to the drag permission and the operation boundary, which provides a structured framework for accurately matching the user interaction intention and the element adjustment logic, ensures the orderly management and control of the drag operation in the complex live scene, improves the overall adaptation ability of the layout adjustment of the interactive element, and the layout adjustment controller refers to a core control module for managing and restricting the drag, scaling, rotation, and other operations of the user on the interactive element (such as a video window, a bullet screen area, a product card, etc.) in the live room.

[0103] As an embodiment of the present application, the layout adjustment controller of the interactive element is constructed according to the drag permission and the operation boundary, which includes:

[0104] Obtaining the operation permission condition corresponding to the drag permission and the operation boundary;

[0105] Extracting the key limitation parameter in the operation permission condition;

[0106] Identifying the spatial topological relationship between the interactive elements;

[0107] Calculating the correlation coefficient of the interactive elements according to the spatial topological relationship;

[0108] Generating a control priority queue of the interactive elements based on the key limitation parameter and the correlation coefficient;

[0109] According to the regulation priority queue, a hierarchical adjustment rule of the interactive element is set, and a rule conflict arbitration mechanism of the hierarchical adjustment rule is established.

[0110] In combination with the regulation priority queue, the hierarchical adjustment rule and the rule conflict arbitration mechanism, a layout adjustment controller of the interactive element is constructed.

[0111] The operation permission condition refers to a comprehensive condition set formed by integrating the drag permission and the operation boundary, which specifies the qualification and range of interactive element operation. The key restriction parameter refers to a core parameter extracted from the operation permission condition, which plays a decisive role in the layout adjustment of the interactive element, such as the drag permission level value corresponding to the user role, the maximum / minimum size threshold of the element that can be dragged, etc. The spatial topology relationship refers to the relative position relationship of multiple interactive elements in the space layout within the live room, including the relationship between elements such as inclusion, adjacency, overlap, separation, etc. For example, the live host picture and the bullet screen area are adjacent and do not overlap, the gift panel and the interactive button are separated, etc. The correlation coefficient refers to a numerical value that quantitatively represents the degree of correlation between interactive elements in matrix form. The regulation priority queue refers to a queue formed by sorting the layout adjustment order of interactive elements based on key restriction parameters and correlation coefficients. The hierarchical adjustment rule refers to a differentiated layout adjustment rule for different levels of interactive elements formulated according to the regulation priority queue. For example, high-priority elements can be adjusted in a larger space range and are not subject to the shielding restrictions of low-priority elements. Low-priority elements need to avoid high-priority elements when adjusting, and elements of the same level follow the principle of equal avoidance, etc. The rule conflict arbitration mechanism refers to a set of decision logic for determining the conflict priority, selecting applicable rules and giving reasonable solutions when different hierarchical adjustment rules conflict or are mutually restrictive (i.e. rule conflict) during the hierarchical adjustment of interactive elements.

[0112] Optionally, the correlation coefficient of the interactable element according to the spatial topological relationship can be calculated by a Pearson correlation coefficient, the regulation priority queue of the interactable element based on the key limiting parameter and the correlation coefficient can be generated by a weighted scoring function, and the rule conflict arbitration mechanism of the hierarchical adjustment rule can be established by using a fuzzy logic algorithm, for example, the importance score of the anchor window and the interactive demand intensity of the barrage area can be taken as inputs to divide a fuzzy set; then, a fuzzy rule base is defined, for example, if the anchor window importance is high and the barrage interactive demand is medium, rule A is preferentially executed, and if the anchor window importance is medium and the barrage interactive demand is high, rule B is preferentially executed; then, the input variables are processed by fuzzy reasoning (such as the Mamdani method) to obtain fuzzy output of conflict arbitration, such as rule A priority is 0.8 and rule B priority is 0.3; finally, defuzzification (such as the barycenter method) is performed to convert the fuzzy output into a clear decision result, that is, rule A is preferentially executed.

[0113] S2, based on the layout adjustment controller, extracting gesture-element association features of the live room, determining a layout change rate and an effective operation range of the interactable element according to the gesture-element association features, and calculating an interface layout adaptation degree of the interactable element based on the layout change rate and the effective operation range.

[0114] According to the embodiment of the present application, the gesture-element association features of the live room are extracted based on the layout adjustment controller, which can significantly enhance the naturalness and intuitiveness of the live room dragable interaction, and improve the accuracy and flexibility of the live room layout adjustment. The gesture-element association features refer to the association features between the user dynamic gesture operation and the interactable element layout adjustment response captured by the layout adjustment controller during the live room dragable layout interaction, for example, when two fingers make a hand opening gesture on the product explanation panel, the panel will be enlarged in proportion to the gesture opening amplitude.

[0115] As an embodiment of the present application, the gesture-element association features of the live room are extracted based on the layout adjustment controller, which includes:

[0116] Based on the layout adjustment controller, the gesture input sequence and the element response sequence of the live room are collected;

[0117] The dynamic time warping algorithm is used to perform synchronous alignment processing of the gesture input sequence and the element response sequence to obtain a time sequence matching pair;

[0118] Based on the time sequence matching pair, a gesture-element linkage probability distribution graph of the live room is constructed;

[0119] The gesture-element association feature of the live broadcast room is extracted through the gesture-element linkage probability distribution diagram.

[0120] The gesture input sequence refers to a series of continuous gesture action data generated by a layout adjustment controller when a user performs a drag operation in a live broadcast room, including gesture type (such as single-finger drag, double-finger zoom), trajectory coordinates, operation duration, force variation, and the like, and is arranged in chronological order to form a sequence. The element response sequence refers to a series of continuous response data of the layout state (such as position movement, size scaling, display / hidden switching, etc.) of the interactive element after receiving the user gesture operation. The dynamic time warping algorithm refers to an algorithm for processing time series data alignment, which can calculate the optimal matching path of the gesture input sequence and the element response sequence on the time axis through dynamic programming. The time series matching pair refers to a pair of data combinations formed by the gesture data in the gesture input sequence and the element response data in the element response sequence at the corresponding time after being processed by the dynamic time warping algorithm. Each matching pair contains a set of time-synchronized gesture operation information and element response information. The gesture-element linkage probability distribution diagram refers to a distribution diagram that presents the correlation strength of gestures and elements in a visual manner, which is constructed based on the time series matching pair. The horizontal axis of the diagram can represent the gesture type, and the vertical axis can represent the interactive element type. The numerical value or color depth of the coordinate point represents the probability of the linkage response of a certain gesture and a certain element.

[0121] Optionally, based on the time series matching pair, the gesture-element linkage probability distribution diagram of the live broadcast room can be constructed by kernel density estimation (KDE) and three-dimensional space discretization. For example, a Gaussian kernel function can be used to perform kernel density estimation on the gesture type, element type, and linkage probability data in the time series matching pair to obtain a continuous probability distribution model. Then, the three-dimensional space is discretized by 0.1 probability intervals to generate a grid-like gesture-element linkage probability distribution diagram. The gesture-element association feature of the live broadcast room can be extracted through the gesture-element linkage probability distribution diagram by a non-maximum suppression algorithm. For example, the probability values of each grid point in the distribution diagram are locally extreme value detected, and the local maximum points with probability values higher than the surrounding 8-neighbor grid points are retained to eliminate redundant non-maximum points, thereby extracting gesture-element association feature points with significant correlation strength.

[0122] Further, the embodiment of the present application can convert abstract gesture interaction rules into executable dynamic adjustment indicators by determining the layout change rate and effective operation range of the interactive element according to the gesture-element association feature, provide quantitative benchmarks for precise matching of gesture operation and element response, and significantly enhance the guarantee capability of operation fluency and boundary controllability in the complex interaction scene of the live room. The layout change rate refers to the speed at which the layout attributes such as the position and size of the interactive element change with user gesture operation in the live room dragable layout interaction based on dynamic gesture recognition. For example, when the user drags the product display window of the live room at a speed of 5 cm per second, the window moves with the gesture at a speed of 100 pixels per second. Here, 100 pixels per second is the layout change rate of the product display window. The effective operation range refers to the spatial boundary range within which the interactive element can respond to user dynamic gesture operation and perform layout adjustment in the live room scene. For example, the area within which the chat interaction panel of the live room can be dragged is limited to the right 30% of the screen range of the live host picture. This range is the effective operation range of the panel itself.

[0123] As an embodiment of the present application, the determination of the layout change rate and the effective operation range of the interactive element according to the gesture-element association feature comprises:

[0124] According to the gesture-element association feature, obtain the space-time sequence data and spatial coordinate data of the interactive element;

[0125] Based on the space-time sequence data, extract the gesture dynamics feature corresponding to the interactive element;

[0126] According to the gesture dynamics feature, generate a dynamic response parameter set of the interactive element;

[0127] Determine the layout change rate of the interactive element through the dynamic response parameter set;

[0128] Based on the spatial coordinate data, establish a spatial coordinate curve of the interactive element;

[0129] Identify the key coordinate points of the spatial coordinate curve, and determine the gesture convex hull boundary corresponding to the interactive element through the key coordinate points;

[0130] According to the gesture convex hull boundary, construct an initial operation range constraint set of the interactive element;

[0131] Determine the effective operation range of the interactive element in combination with the dynamic response parameter set and the initial operation range constraint set.

[0132] The spatio-temporal sequence data refers to a sequence of spatial position information of the interactive element changing over time, and contains associated data of a timestamp and a corresponding coordinate. The spatial coordinate data refers to position coordinate information of the interactive element in a two-dimensional or three-dimensional space, for example, a sequence of (x, y) coordinates of a user's finger touch position on a touch screen, or a set of three-dimensional coordinates (x, y, z) of a gesture motion trajectory. The gesture dynamics feature refers to a feature related to a motion state extracted from a gesture motion process, reflecting the motion law and physical characteristics of the gesture, such as the speed and acceleration of the gesture motion. The dynamic response parameter set refers to a parameter set used to describe the dynamic change of the interactive element with the gesture, including a sensitivity coefficient of element layout change, a damping coefficient, an inertia parameter, etc. The spatial coordinate curve refers to a continuous curve formed by fitting discrete spatial coordinate data through an interpolation algorithm, used to describe the motion trajectory of the interactive element. The key coordinate point refers to a point in the spatial coordinate curve with a significant feature, usually a point with a significant change in curvature or a point having a decisive effect on the curve shape. The gesture convex hull boundary refers to a minimum convex polygon boundary containing all key coordinate points, used to describe the spatial range profile of the gesture operation. The initial operation range constraint set refers to a constraint condition set limiting the effective operation area of the interactive element, containing boundary range, interaction threshold and other parameters.

[0133] To more clearly understand how the gesture convex hull boundary supports the determination of the effective operation range, refer to Figure 2 As shown in FIG. 1, a gesture convex hull boundary diagram of a live room dragable layout interaction method based on dynamic gesture recognition provided by an embodiment of the present application is shown, in which a convex polygon composed of key coordinate points (A-H) is clearly marked, the vertices of which correspond to the limit positions of the gesture action, and the internal area of the polygon is the initially delimited gesture action range. Specifically, after the gesture convex hull boundary is determined through the key coordinate points of the spatial coordinate curve, the gesture convex hull boundary diagram can intuitively present the geometric shape of the boundary, such as the number of vertices contained by the boundary, the coordinate distribution of each vertex, the spatial position relationship between the boundary and the interactive element, etc., providing an intuitive geometric reference for the subsequent construction of the constraint set and the final determination of the effective operation range.

[0134] Optionally, the layout change rate of the interactive element can be determined by a second-order dynamic equation, such as a second-order equation based on a spring-damping model, combined with damping coefficient, sensitivity and other parameters in the dynamic response parameter set, to calculate the layout change rate of the interactive element over time, and the equation can be represented as m·a+c·v+k·x=F, wherein m represents the mass coefficient, c represents the damping coefficient, k represents the stiffness coefficient, and F represents the gesture force. Based on the spatial coordinate data, the spatial coordinate curve of the interactive element can be established by a B-spline interpolation algorithm, and the key coordinate points of the spatial coordinate curve can be identified by a Douglas-Peucker algorithm, such as by setting a distance threshold, recursively retaining points in the curve that deviate from the approximate straight line by more than the threshold, and finally obtaining key coordinate points that can represent the shape of the curve. By the key coordinate points, the gesture convex hull boundary corresponding to the interactive element can be realized by using a Delaunay triangulation algorithm.

[0135] The embodiment of the present application can optimize the adjustment accuracy of dynamic gestures on the interface layout of the live room by calculating the interface layout adaptation degree of the interactive element based on the layout change rate and the effective operation range, while ensuring the matching degree of the layout change of the interface element and the user gesture operation, improving the fluency of the layout interaction of the live room and the user operation experience. The interface layout adaptation degree refers to the matching degree between the layout change state of the interactive element (such as the barrage area, the gift panel, the anchor window, etc.) in the live room and the layout change rate and the effective operation range corresponding to the user dynamic gesture.

[0136] Further, as another embodiment of the present application, the interface layout adaptation degree of the interactive element can be calculated by the following formula:

[0137]

[0138] wherein, represents the interface layout adaptation degree of the interactive element, represents the layout change rate of the i-th interactive element, unit (px / s), represents the maximum value of the layout change rate of the interactive element, represents the effective operation range of the i-th interactive element, unit (px), represents the actual operation range of the i-th interactive element, unit (px), represents the layout vector length of the i-th interactive element in the interface, unit (px), represents the maximum value of the layout vector length of the interactive element, unit (px), represents the weight adjustment coefficient, n represents the number of interactive elements, and i represents the index of the interactive element.

[0139] It should be noted that in the present application, represents the effective operation range of the i th interactive element, unit: (px), that is, the clickable area of the interactive element in the mobile / web interface, which can be defined by pixel coordinates. For example, the effective operation range of a button can be a rectangular area of 80px x 40px, and the formula is It can reflect the degree of dynamic adjustment of the interactive element. The closer the ratio is to 1, the more frequent the element changes, It is used to measure the matching degree of design and user behavior. The closer the difference is to 1, the better the matching degree is, represents the normalized layout vector length, which can suppress the dominant influence of large size or long distance elements on the result. It should be particularly noted that α∈[0,1], and the range of A is usually [0,2]. The larger the value of A, the higher the layout adaptation degree.

[0140] For example, assume that there are three buttons in the live room interface: among them, button 1: =10px / s, =50px, =45px, =100px; button 2: =5px / s, =30px, =35px, =150px; button 3: =20px / s( ), =80px, =80px, =200px, and =0.5, A =0.5, A

[0141] S3, according to the interactive element, collecting real-time gesture action data of the target user, based on the real-time gesture action data, extracting the spatial trajectory features and motion rhythm rules corresponding to the interactive element, according to the spatial trajectory features and the motion rhythm rules, identifying the target user's drag interaction intention.

[0142] The embodiment of the present application can accurately capture the interaction intention of the user for a specific interface element by collecting real-time gesture action data of the target user according to the interactive element, and ensure that the live room interaction response is accurately matched with the operation demand of the user. The real-time gesture action data refers to a set of original data collected by a sensor (such as a camera, a depth sensor, a body sensing device, etc.) in real time during the interaction of the target user with the interactive element in the live room, which can reflect the dynamic changes of the gesture, such as the moving track of the spatial coordinates of the gesture with time, the motion angle of each joint of the gesture, the speed and acceleration of the gesture action, etc.

[0143] Further, the embodiment of the present application can accurately identify the interaction track mode and operation rhythm characteristics of the user for a specific interface element by extracting the spatial trajectory features and motion rhythm rules corresponding to the interactive element based on the real-time gesture action data, and ensure that the subsequent interface layout adjustment is highly consistent with the user interaction habits and operation intention. The spatial trajectory feature refers to a geometric feature describing the motion path of the gesture in three-dimensional or two-dimensional space extracted from the real-time gesture action data of the user, including the starting point and ending point coordinates of the gesture motion, the bending degree (curvature) of the track, the change of the motion direction, the spatial range covered by the track, etc. For example, the path form of the finger of the user when dragging the gift panel from the right side of the screen to the middle, or the fan-shaped diffusion track of the double fingers from convergence to opening when zooming in the anchor window, all belong to the spatial trajectory feature. The motion rhythm rule refers to the periodicity, speed change mode or time distribution characteristics of the gesture action in the time dimension, which reflects the fast and slow rhythm and time rhythm of the gesture operation, including the speed change trend of the gesture motion, the duration of the action, the pause interval, the period of repeated operation, etc. For example, the high-speed continuous movement gesture of the user in a short time when quickly sliding the bullet screen area, or the low-speed smooth dragging gesture of the user when slowly adjusting the position of the chat window, correspond to different motion rhythm rules respectively.

[0144] Optionally, the spatial trajectory feature corresponding to the interactive element based on the real-time gesture action data can be extracted by a multi-scale feature fusion method, such as calculating the basic geometric parameters of the track by coordinates; calculating the main direction of the track by principal component analysis (PCA); and describing the bending degree by the control point distribution of the B-spline curve, etc. The motion rhythm rule corresponding to the interactive element can be extracted by using a time-frequency domain analysis method, such as calculating the average speed, speed variance (reflecting stability), and acceleration peak frequency of each period by using a sliding window (such as a 50ms window); and extracting the main frequency component of the interactive element by performing Fourier transform on the speed sequence.

[0145] According to the space trajectory feature and the motion rhythm rule, the drag interaction intention of the target user is recognized, which can provide a judgment basis for distinguishing the effective operation of the user and the mis-touch behavior, and can avoid operation interruption or experience fragmentation caused by the mismatch between the interaction feedback and the actual operation intention. The drag interaction intention refers to the specific target or expected result that the user wants to achieve through the drag action by analyzing the space trajectory feature and the motion rhythm rule of the user gesture, including position adjustment intention, fine calibration intention, range screening intention, rapid transfer intention, etc. For example, a user wants to quickly drag the chat interaction panel from the left side of the screen to the right side.

[0146] As an embodiment of the present application, according to the space trajectory feature and the motion rhythm rule, the drag interaction intention of the target user is recognized, including:

[0147] The space trajectory feature and the motion rhythm rule are normalized to generate a standardized feature set;

[0148] The spatiotemporal correlation feature of the standardized feature set is extracted, and the drag operation mode of the target user is identified based on the spatiotemporal correlation feature;

[0149] The state evolution rule of the drag operation mode is analyzed;

[0150] According to the state evolution rule, a drag state transition matrix of the target user is generated;

[0151] Based on the drag state transition matrix, a drag intention recognition network of the target user is constructed;

[0152] The drag interaction intention of the target user is identified through the drag intention recognition network.

[0153] The standardized feature set refers to a feature set formed after unified dimension processing of spatial trajectory features (such as trajectory length, curvature) and motion rhythm rules (such as speed, frequency). For example, by min-max standardization, the trajectory length (unit: pixel) and the motion speed (unit: pixel / second) are converted to the [0, 1] interval, and the numerical range difference of different features is eliminated. A set containing standardized trajectory curvature, standardized motion frequency and other parameters can be obtained. The spatio-temporal correlation feature refers to the comprehensive feature reflecting the internal relationship between the motion trajectory of the user's gesture in space (spatial feature) and the motion rhythm changing over time (temporal feature) in the drag interaction scene. The drag operation mode refers to the typical drag behavior type expressed by the user through limb action (such as gesture, body movement). For example, by feature clustering, fast long-distance straight-line dragging (high speed, low curvature, long trajectory), fine short-distance adjustment (low speed, high curvature, short trajectory) and other modes are identified. The state evolution rule refers to the conversion rule of the drag operation mode over time. The drag state transition matrix refers to the matrix describing the conversion probability between different drag operation modes. The drag intent recognition network refers to a model for mapping the drag operation mode and the interaction intent, which can output the intent category of the user, such as moving to the edge to align the element.

[0154] Optionally, the state evolution rule of the drag operation mode can be analyzed by using a hidden Markov model. According to the state evolution rule, the drag state transition matrix of the target user can be generated by the Baum-Welch algorithm. For example, based on a large amount of historical drag data, the state transition probability of the HMM is iteratively estimated by using the Baum-Welch algorithm, and a transition probability matrix is obtained, such as the state transition probability from fine adjustment to fast dragging is 0.2, the state transition probability from fast dragging to stopping is 0.7, and the like. Based on the drag state transition matrix, the drag intent recognition network of the target user can be constructed by using a HMM+neural network hybrid model. For example, the state probability distribution of the current operation mode is output by using the HMM, and then the distribution is input into the neural network. The probability of the adjustment position scaling size and other intents is output by using the full connection layer and the softmax activation function. The category corresponding to the highest probability value is the recognition result.

[0155] S4, based on the interface layout adaptation degree, extracting gesture interaction response features of the target user in the drag process of the interactive element, generating a personalized layout adjustment instruction of the interactive element according to the drag interaction intent and the gesture interaction response features.

[0156] The embodiment of the application can dynamically quantify the real-time matching deviation of user operation and interface layout by extracting gesture interaction response features of the target user in the interactive element dragging process based on the interface layout adaptation degree, improve the intelligence of live room layout interaction and the fluency of user operation, the gesture interaction response features refer to the feature set reflecting the operation state, interaction feedback effect and user operation habit extracted by the correlation analysis of gesture action and interface layout adaptation degree in the process of target user dragging interactive elements, including operation dynamic features, feedback response features, interaction matching features, etc., for example, when the element alignment logic in the interface layout is clear (high adaptation degree), the deceleration fine-tuning frequency of user dragging will increase (feature value becomes larger), indicating that the user is using layout feedback for precise operation.

[0157] As an embodiment of the application, the gesture interaction response features of the target user in the interactive element dragging process based on the interface layout adaptation degree include:

[0158] Obtain the dragging speed of the target user in the interactive element dragging process, and calculate the speed change rate of the dragging speed;

[0159] According to the speed change rate, perform segmented processing of the dragging process to obtain a dragging operation stage;

[0160] Based on the dragging operation stage, identify the current dragging operation intention of the target user, and determine the current interface element type corresponding to the interactive element;

[0161] Define the adaptive threshold of the interface layout adaptation degree through the current dragging operation intention and the current interface element type;

[0162] According to the adaptive threshold, divide the dragging behavior mode corresponding to the target user in the dragging operation stage;

[0163] Based on the dragging behavior mode, calculate the cross-mode feature offset of the target user;

[0164] According to the cross-mode feature offset, perform clustering processing on the dragging operation of the target user to obtain a classified operation style group;

[0165] Collect gesture dynamic data of the classified operation style group, and filter out key indicators with strong correlation with the interface layout adaptation degree from the gesture dynamic data;

[0166] Based on the key indicators, extract the gesture interaction response features of the target user.

[0167] In the formula, the dragging speed refers to the displacement of a gesture (or an interactive element) in a unit of time during the dragging of the interactive element by a target user, usually in units of pixels per second, which can reflect the speed of the dragging operation, for example, when a finger drags a gift panel on the screen, the speed value is 500 pixels per second, the speed change rate refers to the change degree of the dragging speed with time, that is, the increase or decrease of the speed in a unit of time (unit: pixel / square second), the dragging operation stage refers to the division of the complete dragging process into continuous time periods with clear operation intentions based on the characteristics of the speed change rate (such as whether it is zero, positive or negative, or the numerical range), for example, the starting stage (speed change rate>0, speed increases from 0 to a threshold value), the uniform speed stage (speed change rate≈0, speed is stable in a certain range), and the deceleration stage (speed change rate<0, speed decreases from a peak value to 0), the current dragging operation intention refers to the specific operation purpose of the target user in the current stage inferred according to the dragging operation stage and the speed change characteristics, for example, the fast movement intention in the starting stage, the current interface element type refers to the functional attribute classification of the dragged interactive element in the live room interface, such as the chat window, the anchor window, the gift animation panel, etc., the adaptive threshold refers to the dynamically adjusted interface layout adaptation critical value according to the current dragging operation intention and the current interface element type, the value range is 0-1, the higher the value, the stricter the adaptation requirement, for example, for the precise positioning intention + anchor window (heavy element), the adaptive threshold can be set to 0.8; for the fast movement intention + chat switch (light element), the adaptive threshold can be set to 0.4, the dragging behavior mode refers to the behavior characteristic type of the target user in the current dragging operation stage defined according to the comparison result of the real-time interface layout adaptation and the adaptive threshold, including the free dragging mode and the constraint adaptation mode, the cross-mode feature offset refers to the change amplitude of the core gesture features (such as trajectory curvature, speed fluctuation value) of the target user in different dragging behavior modes, for example, the trajectory curvature is 0.3 in the free mode and 0.05 in the constraint mode, so the offset is 0.25, the dragging operation refers to the specific action process of the target user changing the position, size or state of the interactive element in the interface through gestures (such as finger sliding, body motion), the classified operation style group refers to the clustering result based on the cross-mode feature offset, which divides the target users with similar dragging habits into groups, such as sensitive adaptive type and inertia retention type, the gesture dynamic data refers to the original data set reflecting the real-time state of the gesture collected by the sensor (such as camera, touch screen) during the dragging operation, including but not limited to three-dimensional coordinate sequence of the gesture, speed / acceleration time series curve, touch pressure change value, operation duration, etc., the key index refers to the statistically significant correlation (such as p<0.05) and can distinguish the characteristic parameters of different classification operation style groups, such as constraint response delay and mode switching compliance.

[0168] Optionally, the cross-mode feature offset of the target user can be calculated by a time sequence feature alignment algorithm based on the drag behavior mode, for example, if the average value of the curvature of the drag trajectory of the target user in the touch screen mode is 0.3 and the average value of the curvature of the drag trajectory of the target user in the mouse mode is 0.7, the initial offset 0.4 can be obtained by the time sequence feature alignment algorithm, the clustering processing of the drag operation of the target user can be realized by the Ward method, and the key indicators strongly associated with the interface layout adaptation degree can be screened out from the gesture dynamic data in combination with the correlation analysis method and the principal component analysis method, for example, the gesture features are extracted from the gesture dynamic data first, then the Spearman rank correlation coefficients of the gesture features and the interface layout adaptation degree are calculated, then the significant test of the strongly associated gesture features is performed, the features with p<0.05 and |p|>=0.3 are reserved, and finally the key indicators with the strongest explanatory power are extracted by using the PCA for dimension reduction.

[0169] Further, the personalized layout adjustment instruction of the interactable element can be generated according to the drag interaction intention and the gesture interaction response feature, which can enhance the adaptation accuracy of the interface layout and the user operation habit, and also can improve the fluency of the live room interaction and the user experience, the personalized layout adjustment instruction refers to the layout adjustment command of the interactable element in the interface generated by the system according to the operation intention of the user in dragging the element in the live room interface and the response feature recognized by the system after the user gesture interaction, for example, the instruction generated by the system can be that the comment display area is fixed at the top of the screen by default and the width is adjusted to 80% of the screen width commonly used by the user.

[0170] As an embodiment of the present application, the personalized layout adjustment instruction of the interactable element is generated according to the drag interaction intention and the gesture interaction response feature, which includes:

[0171] The motion trajectory of the interactable element is reconstructed according to the drag interaction intention and the gesture interaction response feature;

[0172] The motion continuity index of the motion trajectory is calculated;

[0173] The drag behavior corresponding to the interactable element is identified based on the motion trajectory and the gesture interaction response feature;

[0174] The fine-tuning stability index in the drag behavior is extracted;

[0175] quantify a gesture performance index of the interactable element in combination with the motion coherence index and the fine-tuning stability indicator;

[0176] resolve a layout adaptation requirement corresponding to the gesture performance index;

[0177] construct a layout adjustment decision rule corresponding to the interactable element based on the gesture performance index and the layout adaptation requirement;

[0178] identify a typical drag scenario of the interactable element according to the layout adjustment decision rule;

[0179] generate a personalized layout adjustment instruction of the interactable element based on the typical drag scenario.

[0180] The motion trajectory refers to the path of spatial position change of the element in the interface coordinate system over time during the dragging of the interactive element by the target user, the motion continuity index refers to a numerical indicator for quantifying the continuity of the motion trajectory, the smoothness of the movement of the element during the dragging is evaluated by calculating parameters such as the displacement change rate and the direction angle deviation of adjacent coordinate points in the trajectory, and the higher the value, the more coherent the dragging action is, the dragging behavior refers to a specific description of the target user's dragging operation mode in combination with the form of the motion trajectory and the gesture interaction response feature, for example, fast straight-line dragging (straight-line trajectory, fast speed, no pause), reciprocating fine-tuning dragging (short-distance reciprocating trajectory, slow speed, frequent pause), and the like, the fine-tuning stability index refers to an index for measuring the operation stability of the target user when performing small-amplitude position adjustment (such as movement within ±5 pixels before final positioning) during the dragging process, which is determined by calculating the deviation fluctuation range and the adjustment times of the trajectory in the fine-tuning stage from the target position, the gesture performance index refers to a quantitative value calculated by a preset weight (such as 60% for continuity and 40% for fine-tuning stability), the layout adaptation requirement is based on the gesture performance index analysis, and the specific requirements that the interface layout needs to meet to match the user's dragging operation, for example, if the gesture performance index shows that the user's continuity is low (the operation is prone to stuttering), the layout adaptation requirement is to reduce the element occlusion on the dragging path; if the fine-tuning stability is high (the operation is accurate), the requirement is to enhance the adsorption strength of the target position, the layout adjustment decision rule refers to a conditional-action type rule established according to the gesture performance index and the layout adaptation requirement, which is used to determine under what circumstances the interface should perform what kind of layout adjustment, for example, when the fine-tuning stability index in the gesture performance index is ≤0.3 (i.e., the fine-tuning fluctuation is large), the element adsorption range is automatically expanded to ±10 pixels, and the typical dragging scenario refers to a representative dragging situation extracted from actual applications based on the layout adjustment decision rule, which contains specific user operation targets and interface environment features, for example, in the overlapping area of multiple elements, the user performs accurate positioning and dragging of a small-size button in the full-screen range, and the user quickly moves a large-size panel from the left to the right.

[0181] Optionally, the motion trajectory of the interactive element can be reconstructed by a cubic spline interpolation algorithm according to the dragging interaction intention and the gesture interaction response feature, the dragging behavior corresponding to the interactive element can be identified by using a lightweight RandomForest model based on the motion trajectory and the gesture interaction response feature, and the layout adjustment decision rule corresponding to the interactive element can be constructed by using a Drools rule engine based on the gesture performance index and the layout adaptation requirement.

[0182] S5, monitor an interface running state of the live room in real time, set adaptive layout constraint conditions of the interactive element based on the personalized layout adjustment instruction and the interface running state, create a visual feedback view of the live room according to the adaptive layout constraint conditions and the layout adjustment controller.

[0183] The embodiment of the application can accurately capture the operation feedback of the user on the interface by monitoring the interface running state of the live room in real time, and adjust the interface layout or function configuration in combination with the feedback, thereby improving the interactive convenience of the user and the live room. The interface running state refers to the comprehensive state of technical performance, function availability and user interaction response, such as interface loading speed, during the running of the live room interface, whether the functions such as the like button, comment box and gift panel are available.

[0184] Optionally, the interface running state of the live room can be monitored by front-end burying. For example, monitoring code can be embedded in the key components of the live room interface, and when the user operates these components or the state of the components changes, the monitoring code will record related events and data, such as the loading completion time of the component, the click response time, the state change log and the like.

[0185] Further, the embodiment of the application can accurately match the user operation habit and the real-time performance of the interface by setting the adaptive layout constraint conditions of the interactive element based on the personalized layout adjustment instruction and the interface running state, thereby improving the adaptation accuracy of layout adjustment, and also improving the stability and fluency of interface interaction by dynamically optimizing the constraint strength. The adaptive layout constraint condition refers to the parameter standard of the layout of the interactive element (such as button, input box, pop-up window and the like) which can be automatically adapted according to the real-time change of the scene during the dynamic adjustment of the interface layout.

[0186] As an embodiment of the application, the setting of the adaptive layout constraint conditions of the interactive element based on the personalized layout adjustment instruction and the interface running state comprises:

[0187] According to the personalized layout adjustment instruction, the user operation preference corresponding to the interactive element is identified;

[0188] Based on the interface running state, the system real-time performance index corresponding to the interactive element is determined;

[0189] According to the user operation preference and the system real-time performance index, a dynamic layout constraint evaluation system of the interactive element is constructed;

[0190] The layout adaptation degree score of the interactive element under different constraint conditions is calculated through the dynamic layout constraint evaluation system:

[0191] According to the layout adaptation score, a candidate layout constraint condition set of the interactive element is screened out;

[0192] The candidate layout constraint condition set is subjected to a feasibility verification process to obtain a target layout constraint condition;

[0193] Based on the dynamic layout constraint evaluation system, a key indicator of the target layout constraint condition is monitored in real time to establish a dynamic baseline comparison mechanism;

[0194] According to the dynamic baseline comparison mechanism, a double-channel feedback node of the target layout constraint condition is set;

[0195] In combination with the dynamic layout constraint evaluation system, the dynamic baseline comparison mechanism and the double-channel feedback node, an adaptive layout constraint condition of the interactive element is set.

[0196] The user operation preference refers to the stable operation habits and tendencies exhibited by the user during interaction with the interactive element, such as some users are accustomed to quickly dragging elements for large-scale movement, while some users prefer slow dragging for precise positioning. The system real-time performance indicator refers to the quantified parameters of system performance when the interactive element is running, including interface rendering frame rate, element response delay, memory occupancy rate, etc. The dynamic layout constraint evaluation system refers to a comprehensive analysis framework that integrates user operation preference and system real-time performance indicator to evaluate the adaptability of different layout constraint conditions. The layout adaptation score refers to the result of quantitative evaluation of layout constraint conditions by the dynamic layout constraint evaluation system, which can be weighted scored from three dimensions of visual saliency, operation convenience, and system load, with preference weight accounting for ≥60%. The candidate layout constraint condition set refers to a combination of multiple layout constraint conditions with certain adaptability selected according to the layout adaptation score, such as the combination can include element attraction range of 5px, element maximum movement speed limit of 200px / s, element attraction range of 10px, element maximum movement speed limit of 300px / s, etc. The feasibility verification process refers to the process of actual running test and verification of each condition in the candidate layout constraint condition set to determine whether it can be effectively executed in the current interface environment. The key indicator refers to the core parameter for measuring the running effect of the target layout constraint condition, including element click accuracy, mis-touch rate, rendering time, etc. The dynamic baseline comparison mechanism refers to a mechanism that establishes the baseline value of the key indicator of the target layout constraint condition based on the dynamic layout constraint evaluation system, and compares the real-time monitored indicator with the baseline value. For example, if the baseline value of element click accuracy is set to 95%, when the real-time monitoring value is lower than the baseline, a warning will be issued. The double-channel feedback node refers to two ways to collect feedback on the running of layout constraint conditions, including explicit feedback channel (such as user scoring interface operation experience through pop-up window) and implicit feedback channel (such as system automatically recording the smoothness of user operation flow, if user frequently cancels operations, it means the experience is not good).

[0197] Optionally, the user operation preference corresponding to the interactive element can be identified by behavior trajectory clustering analysis to quantify the high-frequency operation area of the interactive element, for example, by analyzing the trajectory of the user dragging the element in the past week, it is found that 70% of the operations are concentrated in the right area of the interface, thus it is determined that the user prefers to place the element on the right side. The dynamic layout constraint evaluation system of the interactive element can be constructed using multi-objective optimization algorithms, such as genetic algorithm. The feasibility verification process of the candidate layout constraint condition set can be performed through A / B testing in a sandbox environment, for example, two candidate constraint conditions are simultaneously run in the sandbox, and user operation efficiency and system running state are respectively counted, and the condition with better performance is selected.

[0198] The embodiment of the application can create a visual feedback view of the live room according to the adaptive layout constraint condition and the layout adjustment controller, can map the adaptive relationship between gesture operation and layout constraint in real time, can enhance the perceptual clarity of the user to the interactive boundary, and can improve the operation accuracy and efficiency of the layout adjustment of the live room. The visual feedback view refers to a visual interface that can intuitively reflect the layout adjustment state and related guidance presented to the user after comprehensively considering multiple aspects of information during the layout adjustment process of the live room. For example, when the user drags the gift panel of the live room, the visual feedback view displays an elastic grid including the area where the gift panel is located. If the gift panel and the barrage area have a position conflict, a red exclamation mark is displayed at the conflict position, and a dashed box is used to mark the reasonable position to which the gift panel can be moved. In addition, the interface pops up a text prompt that reads "please move the gift panel 2 cm to the left to avoid conflict".

[0199] As an embodiment of the application, the visual feedback view of the live room is created according to the adaptive layout constraint condition and the layout adjustment controller, and includes:

[0200] Synchronously collecting a dynamic relaxation parameter of the adaptive layout constraint condition and an instruction conflict marker bit of the layout adjustment controller;

[0201] Determining a stretchable area of the live room according to the dynamic relaxation parameter;

[0202] Performing decoding processing of the instruction conflict marker bit to determine a conflict type;

[0203] Generating an elastic grid layer of the live room based on the stretchable area;

[0204] Setting a fault diagnosis identifier of the live room according to the conflict type;

[0205] Identifying a physical screen boundary and a key element lock area of the live room;

[0206] Setting an adjustable threshold of the elastic grid layer in combination with the dynamic relaxation parameter, the physical screen boundary and the key element lock area;

[0207] Generating a layout adjustment guide line of the live room based on the adjustable threshold;

[0208] Associating and mapping the fault diagnosis identifier with a conflict resolution scheme of the layout adjustment controller to obtain a fault operation guide;

[0209] Integrating the elastic grid layer, the fault diagnosis identifier, the layout adjustment guide line and the fault operation guide to create the visual feedback view of the live room.

[0210] The dynamic relaxation parameter refers to the allowable range parameter of the initial position or size of the layout element in the adaptive layout constraint condition, such as the variable dynamic proportion of element spacing and size. The instruction conflict flag refers to the identification information for marking whether there is a contradiction between multiple instructions received by the layout adjustment controller, such as regarding the instruction conflict that the same element is simultaneously required to be enlarged and reduced. The stretchable area refers to the area in the live room interface that can be stretched or compressed in size under the premise of not affecting the display of key content, such as the background area and non-core information bar. The decoding processing refers to the process of analyzing the encoded information of the instruction conflict flag to convert the abstract flag into specific conflict content, such as analyzing the size adjustment conflict from the flag 101. The conflict type refers to the specific category of instruction conflict, such as size conflict (simultaneously requiring enlargement and reduction), position conflict (simultaneously requiring left and right movement), and hierarchical conflict (element display priority contradiction). The elastic grid layer refers to the virtual grid structure generated based on the stretchable area, which is used to constrain the adjustment range of the layout element. The fault diagnosis identification refers to the visual marker for intuitively prompting the conflict position and type in the layout adjustment process, such as displaying a red exclamation mark icon next to the conflict element or marking the conflict area with a different color border. The physical screen boundary refers to the actual screen edge range of the display device (such as a mobile phone, computer, or tablet) where the live room is located. The key element lock area refers to the fixed area of the live room interface where the core content (such as the anchor window and interactive button) is located. This area is not allowed to be stretched, obscured, or moved during layout adjustment. The adjustable threshold refers to the maximum stretching / compression amplitude limit allowed by the elastic grid layer, such as not exceeding 20% of the original size in horizontal stretching. The layout adjustment guide line refers to the auxiliary line displayed in the visual feedback view, which is used to indicate the adjustable direction, range, or target position of the elastic grid layer, such as marking the movable path of the element with a dashed line box. The conflict resolution refers to the pre-set strategy in the layout adjustment controller for solving different types of instruction conflicts, such as when a size conflict occurs, the instruction to maintain the original size is executed first. The association mapping processing refers to the process of establishing a one-to-one correspondence between the fault diagnosis identification and the corresponding conflict resolution. The fault operation guide refers to the specific step-by-step instructions generated based on the association mapping processing result for guiding users or systems to solve layout conflicts, such as prompting to click the unlock button to release the element lock to solve the position conflict.

[0211] Optionally, the decoding process of the instruction conflict flag bit can be implemented using Python int(mark, 2), and the association mapping process of the fault diagnosis identifier and the conflict resolution solution of the layout adjustment controller can be implemented by constructing a conflict type-solution mapping table, such as pre-classifying all possible conflict types in the layout adjustment controller (for example, using numbers "1-5" to represent different types respectively); binding the corresponding conflict resolution solution for each conflict type to form a basic mapping table.

[0212] S6, based on the drag interaction intention, generating a draggable interactive layout of the live room through the personalized layout adjustment instruction and the visual feedback view.

[0213] The embodiment of the application can ensure that the live room layout accurately matches the operation habits of different users, improve the user's control freedom of the live room layout, realize dynamic adaptation of the layout form in different live scenes, and provide intuitive user behavior data support for iterative innovation of live room interaction design, essentially enhance the content presentation quality and user participation of the live room in complex interactive scenarios, and the draggable interactive layout refers to the live room layout form that supports user free drag adjustment constructed by the system through real-time capture of the intention implied by the user's drag operation on the elements in the live room interface, combined with the personalized layout adjustment instruction of the live room elements, and the real-time generated visual feedback view.

[0214] Compared with the problems described in the background art, the embodiments of the present application can ensure that the drag operation in the live room is carried out within a reasonable and controllable range by determining the drag permission and the operation boundary of the interactive element. Further, the embodiments of the present application can integrate scattered permission rules and boundary limit data to form a multi-dimensional and collaborative layout control system by constructing a layout adjustment controller of the interactive element according to the drag permission and the operation boundary, thereby providing a structured framework for precisely matching user interaction intention and element adjustment logic, ensuring orderly management and control of drag operation in complex live scenes, and improving the overall adaptation capability of interactive element layout adjustment. The embodiments of the present application can significantly enhance the naturalness and intuitiveness of the dragable interaction in the live room, improve the accuracy and flexibility of the layout adjustment in the live room, and further determine the layout change rate and the effective operation range of the interactive element according to the gesture-element association feature, thereby converting abstract gesture interaction rules into executable dynamic adjustment indicators, providing a quantitative benchmark for precise matching of gesture operation and element response, and significantly enhancing the ability to ensure operation fluency and boundary controllability in complex interactive scenes in the live room. The embodiments of the present application can optimize the adjustment accuracy of dynamic gestures on the interface layout of the live room based on the layout change rate and the effective operation range, and can ensure the matching degree of the layout change of the interface element and the user gesture operation, thereby improving the fluency of the live room layout interaction and the user operation experience. Further, the embodiments of the present application can extract the spatial trajectory feature and the motion rhythm rule corresponding to the interactive element based on the real-time gesture action data, thereby accurately identifying the interactive trajectory mode and the operation rhythm feature of the user for a specific interface element, and ensuring that the subsequent interface layout adjustment is highly consistent with the user interaction habits and operation intention. The embodiments of the present application can provide a basis for distinguishing between the effective operation and the mis-touch behavior of the user by identifying the drag interaction intention of the target user according to the spatial trajectory feature and the motion rhythm rule, and can avoid operation interruption or experience fragmentation caused by mismatch between interaction feedback and actual operation intention. Further, the embodiments of the present application can extract the gesture interaction response feature of the target user in the drag process of the interactive element based on the interface layout adaptation degree, thereby dynamically quantifying the real-time matching deviation of user operation and interface layout, and improving the intelligence of the live room layout interaction and the fluency of user operation.The embodiment of the application can enhance the adaptation accuracy of the interface layout and the user operation habit, and improve the fluency of the live room interaction and the user experience, further, the embodiment of the application can accurately match the user operation habit and the real-time performance of the interface by setting the adaptive layout constraint condition of the interactive element based on the personalized layout adjustment instruction and the interface running state, thereby improving the adaptation accuracy of the layout adjustment, and improving the stability of the interface interaction by dynamically optimizing the constraint strength, the embodiment of the application can map the adaptation relationship between the gesture operation and the layout constraint in real time, enhance the perception clarity of the user to the interactive boundary, and improve the operation accuracy and efficiency of the live room layout adjustment by creating the visual feedback view of the live room based on the adaptive layout constraint condition and the layout adjustment controller, finally, the embodiment of the application can ensure that the live room layout accurately matches the operation habit of different users, improve the operation freedom of the user to the live room layout, realize the dynamic adaptation of the layout form in different live scenes, and provide intuitive user behavior data support for the iterative innovation of the live room interaction design, thereby essentially enhancing the content presentation quality and the user participation in the live room in the complex interaction scene. Therefore, the live room dragable layout interaction method and system based on dynamic gesture recognition provided by the embodiment of the application can improve the convenience and accuracy of the live room layout adjustment.

[0215] As Figure 3 shown, it is a functional module diagram of a live room dragable layout interaction system based on dynamic gesture recognition.

[0216] The live room dragable layout interaction system 200 based on dynamic gesture recognition can be installed in an electronic device. According to the functions to be realized, the live room dragable layout interaction system based on dynamic gesture recognition can include a condition recognition module 201, an adaptation analysis module 202, an intention recognition module 203, an instruction generation module 204, a visual feedback module 205 and a layout output module 206. The modules of the application can also be referred to as units, which refer to a series of computer program segments that can be executed by an electronic device processor and can complete fixed functions, and are stored in the memory of the electronic device.

[0217] In the embodiment of the application, the functions of each module / unit are as follows:

[0218] The condition recognition module 201 is configured to acquire an interactive element of a target user in a live room, determine a drag permission and an operation boundary of the interactive element, and construct a layout adjustment controller of the interactive element according to the drag permission and the operation boundary.

[0219] The adaptive analysis module 202 is configured to extract a gesture-element association feature of the live room based on the layout adjustment controller, determine a layout change rate and an effective operation range of the interactive element according to the gesture-element association feature, and calculate an interface layout adaptation degree of the interactive element based on the layout change rate and the effective operation range.

[0220] The intention recognition module 203 is configured to collect real-time gesture action data of the target user according to the interactive element, extract a spatial trajectory feature and a motion rhythm rule corresponding to the interactive element based on the real-time gesture action data, and recognize a drag interaction intention of the target user according to the spatial trajectory feature and the motion rhythm rule.

[0221] The instruction generation module 204 is configured to extract a gesture interaction response feature of the target user in a drag process of the interactive element based on the interface layout adaptation degree, and generate a personalized layout adjustment instruction of the interactive element according to the drag interaction intention and the gesture interaction response feature.

[0222] The visual feedback module 205 is configured to monitor an interface running state of the live room in real time, set an adaptive layout constraint condition of the interactive element based on the personalized layout adjustment instruction and the interface running state, and create a visual feedback view of the live room according to the adaptive layout constraint condition and the layout adjustment controller.

[0223] The layout output module 206 is configured to generate a dragger-interactive layout of the live room through the personalized layout adjustment instruction and the visual feedback view based on the drag interaction intention.

[0224] In detail, the modules in the live room dragger-interactive layout system 200 based on dynamic gesture recognition in the embodiments of the present application adopt the same technical means as the live room dragger-interactive layout method based on dynamic gesture recognition in the above-mentioned Figure 1 , and can produce the same technical effects, which will not be described here.

[0225] It is obvious for those skilled in the art that the present application is not limited to the details of the above-mentioned exemplary embodiments, and the present application can be implemented in other specific forms without departing from the spirit or essential characteristics of the present application.

[0226] Finally, it should be noted that in the above embodiments, each embodiment can be combined with or independent of each other, and deleting any one of them does not affect the technical implementation of the other embodiments. The above embodiments are only used to illustrate the technical solutions of the present application and are not limiting. Although the present application has been described in detail with reference to the preferred embodiments, those skilled in the art should understand that the technical solutions of the present application can be modified or replaced by equivalents without departing from the spirit and scope of the present application.

Claims

1. A draggable layout interaction method for live streaming rooms based on dynamic gesture recognition, characterized in that, The method includes: Obtain the interactive elements of the target user in the live broadcast room, determine the drag permissions and operation boundaries of the interactive elements, and construct the layout adjustment controller of the interactive elements based on the drag permissions and operation boundaries. Based on the layout adjustment controller, the gesture-element association features of the live broadcast room are extracted. Based on the gesture-element association features, the layout change rate and effective operation range of the interactive elements are determined. Based on the layout change rate and the effective operation range, the interface layout adaptability of the interactive elements is calculated. Based on the interactive elements, real-time gesture data of the target user is collected. Based on the real-time gesture data, spatial trajectory features and movement rhythm patterns corresponding to the interactive elements are extracted. Based on the spatial trajectory features and movement rhythm patterns, the drag interaction intention of the target user is identified. Based on the interface layout adaptability, the gesture interaction response features of the target user during the dragging process of the interactive element are extracted, and personalized layout adjustment instructions for the interactive element are generated according to the dragging interaction intention and the gesture interaction response features. The interface operation status of the live room is monitored in real time. Based on the personalized layout adjustment command and the interface operation status, adaptive layout constraints of the interactive elements are set. According to the adaptive layout constraints and the layout adjustment controller, a visual feedback view of the live room is created. Based on the drag-and-drop interaction intent, the draggable interactive layout of the live streaming room is generated through the personalized layout adjustment command and the visual feedback view.

2. The draggable layout interaction method for a live streaming room based on dynamic gesture recognition as described in claim 1, characterized in that, The step of constructing the layout adjustment controller for the interactive elements based on the drag-and-drop permissions and the operation boundaries includes: Obtain the drag-and-drop permission and the operation permission conditions corresponding to the operation boundary; Extract the key restriction parameters from the operation permission conditions; Identify the spatial topological relationships between the interactive elements; Based on the spatial topological relationship, calculate the association coefficient of the interactive elements; Based on the key constraint parameters and the correlation coefficient, a control priority queue for the interactive elements is generated. Based on the control priority queue, set the hierarchical adjustment rules for the interactive elements, and establish a rule conflict arbitration mechanism for the hierarchical adjustment rules; By combining the control priority queue, the hierarchical adjustment rules, and the rule conflict arbitration mechanism, a layout adjustment controller for the interactive elements is constructed.

3. The draggable layout interaction method for a live streaming room based on dynamic gesture recognition as described in claim 1, characterized in that, The step of extracting gesture-element association features of the live stream based on the layout adjustment controller includes: Based on the layout adjustment controller, the gesture input sequence and element response sequence of the live broadcast room are collected; The gesture input sequence and the element response sequence are synchronized and aligned using a dynamic time warping algorithm to obtain a time-matching pair. Based on the time-series matching pairs, construct the gesture-element linkage probability distribution map of the live broadcast room; The gesture-element association features of the live broadcast room are extracted using the gesture-element linkage probability distribution map.

4. The draggable layout interaction method for a live streaming room based on dynamic gesture recognition as described in claim 1, characterized in that, The step of determining the layout change rate and effective operation range of the interactive element based on the gesture-element association features includes: Based on the gesture-element association features, obtain the spatiotemporal sequence data and spatial coordinate data of the interactive element; Based on the spatiotemporal sequence data, extract the gesture dynamics features corresponding to the interactive elements; Based on the gesture dynamics features, a set of dynamic response parameters for the interactive elements is generated; The layout change rate of the interactive elements is determined by the dynamic response parameter set. Based on the spatial coordinate data, establish the spatial coordinate curve of the interactive element; Identify the key coordinate points of the spatial coordinate curve, and determine the gesture convex hull boundary corresponding to the interactive element through the key coordinate points; Based on the gesture convex hull boundary, construct the initial operation range constraint set of the interactive element; By combining the dynamic response parameter set and the initial operation range constraint set, the effective operation range of the interactive element is determined.

5. The draggable layout interaction method for a live streaming room based on dynamic gesture recognition as described in claim 1, characterized in that, The step of identifying the target user's drag-and-drop interaction intent based on the spatial trajectory features and the movement rhythm pattern includes: The spatial trajectory features and the motion rhythm patterns are normalized to generate a standardized feature set; Extract the spatiotemporal correlation features of the standardized feature set, and identify the drag-and-drop operation pattern of the target user based on the spatiotemporal correlation features; Analyze the state evolution pattern of the drag-and-drop operation mode; Based on the state evolution law, generate the drag state transition matrix of the target user; Based on the drag state transition matrix, a drag intent recognition network for the target user is constructed. The drag-and-drop intent recognition network identifies the drag-and-drop interaction intent of the target user.

6. The draggable layout interaction method for a live streaming room based on dynamic gesture recognition as described in claim 1, characterized in that, The step of extracting the gesture interaction response features of the target user during the dragging process of the interactive elements based on the interface layout adaptability includes: The target user's drag speed during the dragging process of the interactive element is obtained, and the rate of change of the drag speed is calculated. Based on the rate of change of speed, the dragging process is segmented to obtain the dragging operation stage; Based on the drag-and-drop operation phase, identify the target user's current drag-and-drop operation intent and determine the current interface element type corresponding to the interactive element; Define the adaptive threshold of the interface layout adaptability based on the current drag operation intent and the current interface element type; Based on the adaptive threshold, the dragging behavior pattern of the target user during the dragging operation phase is divided. Based on the drag-and-drop behavior pattern, calculate the cross-pattern feature offset of the target user; Based on the cross-mode feature offset, the drag-and-drop operations of the target user are clustered to obtain a classification operation style group; Collect the gesture dynamic data of the classified operation style groups, and filter out key indicators that are strongly correlated with the interface layout adaptability from the gesture dynamic data; Based on the aforementioned key indicators, the gesture interaction response features of the target user are extracted.

7. The draggable layout interaction method for a live streaming room based on dynamic gesture recognition as described in claim 1, characterized in that, The step of generating personalized layout adjustment instructions for the interactive elements based on the drag-and-drop interaction intent and the gesture interaction response characteristics includes: Based on the drag-and-drop interaction intent and the gesture interaction response characteristics, reconstruct the motion trajectory of the interactive element; Calculate the motion coherence index of the motion trajectory; Based on the motion trajectory and the gesture interaction response features, identify the dragging behavior corresponding to the interactive element; Extract the fine-tuning stability index from the dragging behavior; The gesture performance index of the interactive element is quantified by combining the motion coherence index and the fine-tuning stability index. Analyze the layout adaptation requirements corresponding to the gesture performance metrics; Based on the gesture performance metrics and the layout adaptation requirements, construct layout adjustment decision rules for the interactive elements. Based on the layout adjustment decision rules, identify typical drag-and-drop scenarios for the interactive elements; Based on the typical drag-and-drop scenario, personalized layout adjustment instructions for the interactive elements are generated.

8. The draggable layout interaction method for a live streaming room based on dynamic gesture recognition as described in claim 1, characterized in that, The step of setting adaptive layout constraints for the interactive elements based on the personalized layout adjustment instructions and the interface running state includes: Based on the personalized layout adjustment instructions, the user operation preferences corresponding to the interactive elements are identified; Based on the interface's operating status, determine the system's real-time performance indicators corresponding to the interactive elements. Based on the user operation preferences and the system's real-time performance indicators, a dynamic layout constraint evaluation system for the interactive elements is constructed. Using the dynamic layout constraint evaluation system, the layout adaptability score of the interactive elements under different constraint conditions is calculated: Based on the layout adaptability score, a set of candidate layout constraints for the interactive elements is selected. The feasibility of the candidate layout constraint set is verified to obtain the target layout constraint. Based on the dynamic layout constraint evaluation system, key indicators of the target layout constraints are monitored in real time to establish a dynamic baseline comparison mechanism. Based on the dynamic baseline comparison mechanism, a dual-channel feedback node is set for the target layout constraints; By combining the dynamic layout constraint evaluation system, the dynamic baseline comparison mechanism, and the dual-channel feedback node, adaptive layout constraints are set for the interactive elements.

9. The draggable layout interaction method for a live streaming room based on dynamic gesture recognition as described in claim 1, characterized in that, The step of creating the visual feedback view of the live streaming room based on the adaptive layout constraints and the layout adjustment controller includes: The dynamic relaxation parameters of the adaptive layout constraints and the instruction conflict flag bits of the layout adjustment controller are collected synchronously. The stretchable area of ​​the live streaming room is determined based on the dynamic relaxation parameter. Perform decoding of the instruction conflict flag bit to determine the conflict type; Based on the stretchable area, generate the elastic grid layer of the live broadcast room; Based on the conflict type, set the fault diagnosis flag for the live broadcast room; Identify the physical screen boundaries and key element lock areas of the live streaming room; By combining the dynamic relaxation parameter, the physical screen boundary, and the key element locking area, an adjustable threshold for the elastic mesh layer is set; Based on the adjustable threshold, the layout adjustment guide lines of the live broadcast room are generated; The fault diagnosis identifier is associated with the conflict resolution of the layout adjustment controller to obtain fault operation guidance. By integrating the elastic grid layer, the fault diagnosis indicator, the layout adjustment guide line, and the fault operation guide, a visual feedback view of the live broadcast room is created.

10. A draggable layout interactive system for live streaming rooms based on dynamic gesture recognition, characterized in that, The system includes: The condition recognition module is used to obtain the interactive elements of the target user in the live broadcast room, determine the drag permission and operation boundary of the interactive elements, and construct the layout adjustment controller of the interactive elements based on the drag permission and the operation boundary. The adaptation analysis module is used to extract the gesture-element association features of the live broadcast room based on the layout adjustment controller, determine the layout change rate and effective operation range of the interactive elements according to the gesture-element association features, and calculate the interface layout adaptation degree of the interactive elements based on the layout change rate and the effective operation range. The intent recognition module is used to collect real-time gesture data of the target user based on the interactive element, extract spatial trajectory features and motion rhythm patterns corresponding to the interactive element based on the real-time gesture data, and identify the drag interaction intent of the target user based on the spatial trajectory features and the motion rhythm patterns. The instruction generation module is used to extract the gesture interaction response features of the target user during the dragging process of the interactive element based on the interface layout adaptability, and generate personalized layout adjustment instructions for the interactive element according to the drag interaction intention and the gesture interaction response features. The visual feedback module is used to monitor the interface operation status of the live broadcast room in real time, set adaptive layout constraints for the interactive elements based on the personalized layout adjustment instructions and the interface operation status, and create a visual feedback view of the live broadcast room according to the adaptive layout constraints and the layout adjustment controller. The layout output module is used to generate a draggable interactive layout for the live streaming room based on the drag-and-drop interaction intent, the personalized layout adjustment instructions, and the visual feedback view.

Images