Human-computer interaction method and system for digital interaction display of costume culture

Abstract

The present application relates to the technical field of human-computer interaction, and discloses a kind of clothing culture digital interactive display human-computer interaction method and system.The present application continuously captures the information of each operator's body movement and hand key point, and analyzes it to obtain the preliminary interaction intention, which provides a rich and accurate data basis for subsequent intelligent decision-making.By calculating the intention weight value of each operator, the importance of each operator's intention can be quantified, so that when an interaction conflict is detected, the instruction can be coordinated according to the intention weight value.Through adaptive adjustment, such as reducing the operation amplitude or speed, the intentions of multiple operators can be satisfied to some extent, while unreasonable physical deformation and violation of cultural norms are avoided.The system response lag problem caused by instruction conflict, physical simulation inauthenticity and cultural norm violation is effectively solved when multiple users operate concurrently.

Description

Technical Field

[0001] This invention relates to the field of human-computer interaction technology, and in particular to a human-computer interaction method and system for digital interactive display of clothing culture. Background Technology

[0002] In the field of digital interactive display of clothing culture, in order to provide an immersive experience, systems typically employ human-computer interaction technology, allowing visitors to interact with digital clothing models through physical movements. With the increasing demand for multi-user collaborative exploration, systems face the challenge of effectively handling concurrent operations and ensuring the physical realism of the clothing and the accuracy of its cultural significance.

[0003] In related technologies, a set of constraint rules based on clothing knowledge is introduced into the system to store the physical attribute data and cultural norms information of specific clothing. When multiple operators perform operations, the system integrates the operational intentions of all operators and then verifies them using the constraint rule set. If a combination of operations results in an unrealistic physical form or violates cultural norms, the system automatically corrects the operation results to ensure that they maintain physical and cultural accuracy while satisfying the operators' exploration intentions.

[0004] However, this seemingly perfect solution revealed new bottlenecks in actual operation. The introduction of constraint rule sets, especially when dealing with complex fabric physics simulations, significantly increased the computational burden on the graphics workstation. This burden was not constant but fluctuated dramatically with changes in operator actions and the environment. This sudden surge in computation caused system response delays. The operator made a gesture, but the digital model of clothing culture on the screen would only respond after a short while, appearing choppy and sluggish. This unstable latency made the originally smooth interaction very awkward, severely impacting the operator's immersion and exploration interest, causing this advanced system to fail to achieve the expected display effect at crucial moments. Summary of the Invention

[0005] The technical problem solved by this invention is to provide a human-computer interaction method and system for digital interactive display of clothing culture, so as to solve the problems of system response lag, unrealistic physical simulation of clothing, and easy violation of cultural norms in the existing digital interactive display of clothing culture when multiple users operate concurrently.

[0006] In a first aspect, the present invention provides a human-computer interaction method for digital interactive display of clothing culture, comprising: Real-time acquisition of body movement information and key hand information of each operator; The limb movement information and the key hand information are analyzed to obtain the preliminary interaction intentions of each operator; Based on the initial interaction intent, the intent weight value of each operator is calculated, and interaction conflicts between different operators are identified; the interaction conflicts include at least one of the following: overlapping target areas, contradiction between global and local operations, violation of clothing physical properties, and violation of clothing cultural norms; In the event of an interaction conflict, instruction coordination is performed based on the intent weight values ​​of each operator to generate an operation instruction. Based on the operation instructions, the digital model of clothing culture is updated.

[0007] In one embodiment, the real-time acquisition of limb movement information and key hand point information of each operator includes: Within the interactive area, the operator's body is scanned and analyzed in real time using a depth sensing device to generate the position and posture information of the operator's skeletal joints in three-dimensional space, thus obtaining the operator's three-dimensional skeletal data. Based on the depth sensing device, the operator's hand is captured in real time at specific points in three-dimensional space to obtain the operator's key point data. The three-dimensional skeletal data is used as the limb movement information, and the hand key point data is used as the hand key point information.

[0008] In one embodiment, parsing the limb movement information and the hand key point information to obtain the preliminary interaction intentions of each operator includes: Based on the posture recognition algorithm, the limb movement information and key hand point information of each operator are analyzed in real time; The parsed limb movement information and hand key point information of each operator are compared and matched with preset interaction intent categories to obtain the preliminary interaction intent of each operator.

[0009] In one embodiment, calculating the intent weight value for each operator based on the initial interaction intent includes: Based on the initial interaction intent, and combined with multiple preset weighting factors, the intent weight value of each operator is obtained through weighted calculation. The preset multiple weighting factors include at least one of the following: the precision of the operator's movements, the spatial distance between the operator's hand and the target interaction area, the operator's continuous attention time to the target interaction area, and the physical simulation complexity of the operation corresponding to the initial interaction intention.

[0010] In one embodiment, the step of coordinating instructions and generating operation instructions based on the intent weight values ​​of each operator in the event of an interaction conflict includes: In the event of an interaction conflict, the intention weight values ​​of each operator are sorted. The initial interaction intent corresponding to the highest intent weight value is executed first. For the other intent weight values, the initial interaction intents corresponding to the intent weight values ​​are adaptively adjusted in descending order of their value to generate the adjusted operation instructions.

[0011] In one embodiment, the adaptive adjustment includes: Reduce the operational magnitude and / or operational speed of the initial interaction intent corresponding to the other intent weight values, and perform constraint processing that conforms to physical and cultural constraints.

[0012] In one embodiment, the constraint processing that conforms to physical and cultural constraints includes: Set local constraints for the target interaction area of ​​the initial interaction intent that conflicts with other said intent weight values ​​or the highest said intent weight value; The local constraint conditions are set based on predefined cultural norms and the inherent physical attribute constraints of the digital model of clothing culture.

[0013] In one embodiment, updating the state of the digital model of clothing culture based on the operation instructions includes: The geometric shape, texture, and physical simulation effect of the digital model of clothing culture are updated in real time based on the operation instructions.

[0014] On the other hand, the present invention also provides a human-computer interaction system for digital interactive display of clothing culture, the system comprising: The information acquisition module is used to acquire real-time information on the body movements and key hand points of each operator; The intent parsing module is used to parse the limb movement information and the key hand information to obtain the preliminary interaction intent of each operator; The conflict identification module is used to calculate the intention weight value of each operator based on the initial interaction intention, and to identify the interaction conflict between different operators; the interaction conflict includes at least one of the following: target area overlap, contradiction between global operation and local operation, violation of clothing physical properties and violation of clothing cultural norms; The instruction generation module is used to coordinate instructions based on the intent weight value of each operator and generate operation instructions when the interaction conflict is detected. The model update module is used to update the status of the digital model of clothing culture based on the operation instructions.

[0015] On the other hand, the present invention also provides a computer-readable storage medium storing computer instructions, which are used to cause a processor to execute and implement the human-computer interaction method for digital interactive display of clothing culture as described above.

[0016] In summary, the present invention provides a human-computer interaction method and system for digital interactive display of clothing culture. This method continuously captures and analyzes the operator's body movements and key hand gestures to obtain preliminary interaction intentions. By calculating the intention weights, it can identify interaction conflicts between different operators. When an interaction conflict is detected, the system coordinates instructions based on each operator's intention weight, generates operation commands, and finally updates the state of the digital model of clothing culture according to the operation commands. This effectively solves the system response delay problems caused by instruction conflicts, unrealistic physical simulations, and violations of cultural norms when multiple users operate concurrently in existing technologies. Through the intention weight and instruction coordination mechanism, it ensures the smoothness of interaction and the accuracy of clothing display. Attached Figure Description

[0017] To more clearly illustrate the specific embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the specific embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present invention. For those skilled in the art, other drawings can be obtained from these drawings without creative effort.

[0018] Figure 1 This is a flowchart illustrating a human-computer interaction method for digital interactive display of clothing culture according to an embodiment of the present invention. Figure 2 This is a flowchart illustrating a human-computer interaction method for digital interactive display of clothing culture, according to another embodiment of the present invention. Figure 3 This is a flowchart illustrating a human-computer interaction method for digital interactive display of clothing culture, according to another embodiment of the present invention. Figure 4 This is a flowchart illustrating a human-computer interaction method for digital interactive display of clothing culture, according to another embodiment of the present invention. Figure 5 This is a schematic diagram of the structure of a human-computer interaction system for digital interactive display of clothing culture according to an embodiment of the present invention; Figure 6 This is a schematic diagram of the structure of an electronic device according to an embodiment of the present invention. Detailed Implementation

[0019] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0020] In the description of this invention, it should be understood that the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of indicated technical features. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of this invention, unless otherwise stated, "a plurality of" means two or more. Those skilled in the art can understand the specific meaning of the above terms in this invention based on the specific circumstances.

[0021] Traditional digital interactive display systems for clothing culture face challenges in effectively handling concurrent operations and ensuring the physical realism of clothing and the accuracy of cultural representation when multiple users explore together. Although related technologies have introduced constraint rules to maintain these characteristics, the complex computational overhead, especially when multiple users are performing precise operations simultaneously or in poor environmental conditions, can lead to system lag and negatively impact the user experience.

[0022] Specifically, when multiple users interact with the digital model of clothing culture simultaneously, the system needs to capture and analyze the body movements and key hand gestures of each user to obtain their initial interaction intentions. When multiple users operate simultaneously, the system faces instruction conflicts. For example, one user might want to zoom in on a detail of the clothing, while another might want to rotate the clothing to observe its back. While related technologies can distinguish between individual users and associate their instructions with specific areas on the digital model of clothing culture, this segmented interaction method raises deeper problems.

[0023] Clothing is an organic whole; its structure, materials, and cultural connotations are closely intertwined. A change in the form of one part of a garment will inevitably trigger a corresponding change in other related parts. In a system with independent control of specific areas, the system simply moves a part of the garment upwards, ignoring this physical, real-world interaction. This results in a stiff final effect, losing the flowing, realistic feel that clothing should possess. More importantly, the way certain garments are worn embodies specific cultural etiquette. Allowing operators to arbitrarily drag parts of the garment might present an incorrect form that violates cultural norms, thus misleading visitors.

[0024] To overcome this deficiency, the relevant technology introduces a set of constraint rules based on clothing knowledge into the system to store the physical attribute data and cultural norms information of specific clothing. When multiple operators perform operations, the system integrates the intentions of all operators and then verifies them using this set of constraint rules. If a combination of operations results in an unrealistic physical form or violates cultural norms, the system automatically corrects the operation result to maintain physical and cultural accuracy while satisfying the operator's exploration intentions. However, this seemingly perfect solution has revealed new bottlenecks in actual operation. The introduction of the constraint rule set, especially when dealing with complex fabric physics simulations, significantly increases the computational burden on the graphics workstation. This burden is not constant but fluctuates dramatically with changes in operator actions and the environment. This sudden surge in computation leads to system response delays. The operator makes a gesture, but the digital model of clothing culture on the screen takes a while to respond, making the movement appear choppy and sluggish. This unstable latency makes the originally smooth interaction very awkward, seriously affecting the operator's immersion and exploration interest, causing this advanced system to fail to achieve the expected display effect at crucial moments.

[0025] The following is combined with Figures 1 to 6 The following describes embodiments of the present invention.

[0026] According to embodiments of the present invention, such as Figure 1 As shown, on the one hand, a human-computer interaction method for digital interactive display of clothing culture is provided, including the following steps: Step S100: Real-time acquisition of limb movement information and key hand information of each operator; Step S200: Analyze the limb movement information and key hand information to obtain the preliminary interaction intentions of each operator; Step S300: Calculate the intention weight value of each operator based on the initial interaction intention, and identify the interaction conflict between different operators; the interaction conflict includes at least one of the following: overlapping target areas, contradiction between global operation and local operation, violation of clothing physical properties, and violation of clothing cultural norms; Step S400: If an interaction conflict is detected, coordinate the instructions based on the intention weight values ​​of each operator and generate an operation instruction. Step S500: Update the status of the digital model of clothing culture based on the operation instructions.

[0027] In this embodiment, limb movement information refers to the position, posture, and motion trajectory data of various parts of the operator's body, such as the torso, limbs, and head, in three-dimensional space. Hand key point information refers to the position data of the operator's hands, such as fingertips, knuckles, and palms, in three-dimensional space. These data are used together to capture the operator's fine gestures and operational intentions. Preliminary interaction intention refers to the action the operator wants to perform, as initially determined by the system based on the operator's limb movements and hand key point information, such as grasping, rotating, zooming in, or zooming out. Intention weight value is a numerical value that measures the importance or priority of each operator's preliminary interaction intention and is used for decision-making when interaction conflicts occur. Interaction conflict is a situation where there are contradictions or incompatibilities between the preliminary interaction intentions of multiple operators, which may lead to an unreasonable state in the digital model of clothing culture. Operation instruction is the instruction that the system finally determines and executes after instruction coordination to update the state of the digital model of clothing culture. The digital model of clothing culture is clothing with specific cultural background and physical attributes presented in the form of a three-dimensional model in a digital display system. It is usually implemented in an interactive system that includes depth sensing devices, high-performance computing units, and display devices. The depth sensing device is responsible for capturing the operator's motion data in real time, the high-performance computing unit is responsible for data parsing, intent recognition, conflict detection and instruction generation, and the display device is responsible for presenting the real-time updated status of the digital model of clothing culture.

[0028] First, it's necessary to continuously capture the limb movement information and hand key point information of each operator. For example, based on computer vision, multiple ordinary cameras can be used to capture multi-view images of the interaction area. Then, multi-view geometry and image processing techniques can be used to reconstruct the operator's 3D skeletal data and hand key point data from the 2D images. Alternatively, the operator can wear an inertial measurement unit (IMU) sensor, which can measure the operator's motion acceleration and angular velocity in real time. Data fusion algorithms can then be used to calculate the operator's limb movement information and hand key point information.

[0029] Next, the captured body movement information and hand key point information are analyzed to obtain the initial interaction intent of each operator. For example, a series of gesture templates and body movement patterns are preset, and then the captured real-time data is matched with the templates. When the operator's hand key point information highly matches the preset grasping gesture template, the system can recognize that their initial interaction intent is grasping. Similarly, when the operator's body movement information matches the preset rotation movement pattern, the system can recognize that their initial interaction intent is rotation.

[0030] Then, an initial weight value is assigned to each operator, and dynamically adjusted based on factors such as the distance between the operator and the digital model of clothing culture, and the duration of the operation. When multiple operators simultaneously operate on the same area of ​​the digital model of clothing culture, or when their operational intentions are logically contradictory, the system can identify an interaction conflict. For example, if one operator tries to enlarge the neckline of the clothing, while another operator simultaneously tries to shrink the entire clothing, this constitutes an interaction conflict.

[0031] When an interaction conflict is detected, instructions are coordinated based on the intent weight value of each operator to generate operation instructions. For example, a priority rule can be set, where the initial interaction intent of operators with higher intent weight values ​​will be given priority. For the initial interaction intent of operators with lower intent weight values, the system can adjust it, such as reducing its operation amplitude or speed, to make it compatible with the intent of high-priority operators, thereby generating coordinated operation instructions.

[0032] Interaction conflicts specifically include overlapping target areas, contradictions between global and local operations, and violations of the physical properties or cultural norms of clothing. Among these, overlapping target areas refer to multiple operators simultaneously attempting to manipulate the same or adjacent parts of the digital model of clothing culture, resulting in spatial overlap of the target areas. For example, two operators might simultaneously attempt to enlarge the same sleeve of a garment, or one operator might attempt to rotate the garment while another attempts to adjust a specific detail.

[0033] The conflict between global and local operations refers to a situation where one operator performs a global operation affecting the entire digital model of clothing culture, such as overall rotation or scaling, while another operator simultaneously performs a local operation affecting only a specific part of the digital model, such as adjusting the collar or cuffs. In this case, the global operation may override or interfere with the intent of the local operation.

[0034] Violations of the physical properties and cultural norms of clothing refer to situations where the operator's initial interactive intent may cause the digital model of the clothing culture to appear inconsistent with its inherent physical characteristics, such as the elasticity of the material and the effects of gravity, or inconsistent with the cultural norms represented by the specific clothing, such as the way it is worn or taboos in matching. For example, stretching a silk garment to an unreasonable length, or wearing or displaying a traditional garment in a way that does not conform to its cultural background.

[0035] By clearly defining the specific types of interaction conflicts, the system can more accurately understand the nature of the conflict when it is identified. When the system can distinguish between overlapping target areas, conflicting global and local operations, and conflicts that violate physical or cultural norms, it can adopt different instruction coordination strategies accordingly. For example, for overlapping target areas, the system may need to determine which operator's intention takes precedence; for conflicting global and local operations, the system may need to coordinate the two to avoid them canceling each other out; and for violations of physical or cultural norms, the system needs to implement constraint processing to ensure the authenticity and accuracy of the display. This detailed conflict classification provides a solid foundation for subsequent instruction coordination and adaptive adjustment, thereby improving the intelligence and robustness of the interaction.

[0036] Furthermore, the system can adjust the geometric shape of the digital model of clothing culture in real time according to operation instructions, such as stretching, folding, and bending; update its texture, such as changing color and pattern; and simulate its physical effects, such as the movement of fabric and the formation of folds, to present a realistic and culturally compliant interactive effect.

[0037] This invention addresses conflicts in multi-user concurrent operations by introducing intent weight values ​​and an instruction coordination mechanism. It continuously captures and analyzes the body movements and key hand points of each operator to obtain preliminary interaction intents, providing a rich and accurate data foundation for subsequent intelligent decision-making. By calculating the intent weight value for each operator, the importance of each operator's intent can be quantified, allowing for instruction coordination based on intent weight values ​​when interaction conflicts are detected. Through adaptive adjustments, such as reducing the amplitude or speed of operations, the intents of multiple operators can be satisfied to a certain extent, while avoiding unreasonable physical deformation and violations of cultural norms. Therefore, this invention effectively balances the interaction needs among multiple users, ensuring that the digital model of clothing culture maintains its inherent physical attributes and cultural connotations, thereby significantly improving the system's response speed and user experience. Compared to existing methods that rely solely on complex constraint rule sets for verification and correction, the instruction coordination mechanism of this invention handles conflicts more proactively and intelligently, reducing unnecessary computational overhead and enabling the system to remain smooth and stable under multi-user concurrent operations and complex environments.

[0038] like Figure 2 As shown, in one embodiment, step S100 includes the following steps: Step S110: Within the interactive area, the operator's body is scanned and analyzed in real time based on the depth sensing device to generate the position and posture information of the operator's skeletal joints in three-dimensional space, thereby obtaining the operator's three-dimensional skeletal data. Step S120: Based on the depth sensing device, capture the specific point information of the operator's hand in three-dimensional space in real time to obtain the key point data of the operator's hand; Step S130: Use the three-dimensional skeleton data as limb motion information and the hand key point data as hand key point information.

[0039] In this embodiment, the depth sensing device is a sensor device capable of acquiring spatial depth information, including but not limited to structured light sensors, time-of-flight sensors, or stereo vision cameras. The depth sensing device can monitor and identify the operator within the interaction area in real time. The interaction area is a pre-defined physical space range where the operator performs human-computer interaction activities. After scanning and analyzing the operator's body using the depth sensing device, the position and posture information of the operator's skeletal joints in three-dimensional space are generated, thereby determining the operator's three-dimensional skeletal data. The three-dimensional skeletal data can accurately reflect the operator's overall limb movements, such as body movement, rotation, and bending. Further, the depth sensing device scans and analyzes the operator's hands, such as fingers and palms, to obtain specific point information of the operator's hands in three-dimensional space, such as fingertips, knuckles, and palms, thereby obtaining the operator's hand key point data. After obtaining the three-dimensional skeletal data and hand key point data, the three-dimensional skeletal data is used as the operator's limb movement information, and the hand key point data is used as hand key point information.

[0040] By continuously capturing 3D skeletal data and hand keypoint data using depth-sensing devices, accurate depth information and fine movement details of the operator can be obtained. This directly acquires the operator's precise position and posture information in 3D space, providing high-quality raw data for subsequent analysis of limb movement and hand keypoint information, making the recognition of the operator's initial interaction intentions more reliable and precise.

[0041] like Figure 3 As shown, in one embodiment, step S200 includes the following steps: Step S210: Analyze the limb movement information and key hand point information of each operator in real time based on the posture recognition algorithm; Step S220: Compare and match the parsed limb movement information and hand key point information of each operator with the preset interaction intent categories to obtain the preliminary interaction intent of each operator.

[0042] In this embodiment, the pose recognition algorithm is a computer vision algorithm used to analyze and understand the posture and movements of the human body in three-dimensional space. The pose recognition algorithm can extract meaningful features, such as joint angles, relative limb positions, and gesture shapes, from captured limb movement information and hand keypoint information. The algorithm then processes the input data with low latency, ensuring that the operator's actions are recognized and responded to by the system in real time. The preset interaction intent categories are a series of predefined standard interactive actions based on common needs and operating modes of digital interactive displays of clothing culture, such as rotating the model, zooming in on details, switching clothing, and dragging textures. These preset interaction intent categories provide a recognition target for the pose recognition algorithm, enabling the system to map complex human movements to specific interactive commands.

[0043] By running a posture recognition algorithm, the system can analyze each operator's limb movements and key hand points in real time and efficiently. The captured raw motion data is then compared and matched with preset interaction intent categories to accurately identify the operator's initial interaction intent, ensuring the conversion from physical actions to digital commands and laying the foundation for subsequent command coordination and model updates. Through real-time analysis, the system can respond instantly to the operator's actions, avoiding interaction disruptions or misjudgments caused by delays.

[0044] In one embodiment, step S300 includes: based on the initial interaction intent, and combined with a number of preset weighting factors, performing a weighted calculation to obtain the intent weight value of each operator; wherein the number of preset weighting factors includes the fineness of the operator's actions, the spatial distance between the operator's hand and the target interaction area, the operator's continuous attention time to the target interaction area, and the physical simulation complexity of the operation corresponding to the initial interaction intent, etc.

[0045] In this embodiment, the intent weight value is obtained by weighting multiple preset weighting factors. These weighting factors are used to more comprehensively and accurately assess the intensity and priority of the operator's interaction intent. By introducing multiple weighting factors and combining them with the initial interaction intents of each operator for weighted calculation, various behavioral characteristics and intent attributes of the operator during the interaction process can be comprehensively considered. The fineness of the operator's movements refers to the precision and detail of the operator's limb or hand movements, reflecting the operator's focus and accuracy; for example, a slow, precise pointing gesture may have a higher degree of fineness than a fast, vague waving gesture. The spatial distance between the operator's hand and the target interaction area refers to the physical distance between the operator's hand and a specific interactive area on the digital model of the clothing culture. The closer the distance, the stronger the interaction intent, reflecting the operator's interest in and tendency to interact with the specific area. The operator's sustained attention time to the target interaction area refers to the time the operator's gaze or limbs are directed towards the area and maintained, reflecting the operator's interest in and tendency to interact with the area. The physical simulation complexity of the initial interaction intent refers to the computational resources and simulation difficulty required to realize the interaction intent on the digital model of clothing culture. This helps to assign higher priority or handle more cautiously complex operations when there are conflicts among multiple users; for example, fine-tuning the texture of clothing may have a higher physical simulation complexity than a simple rotation operation. By scientifically weighting and combining multiple preset weighting factors, the intensity of each operator's interaction intent can be quantified more accurately, thus providing a more reliable basis for subsequent command coordination.

[0046] like Figure 4 As shown, in one embodiment, step S400 includes the following steps: Step S410: If an interaction conflict is detected, sort the intention weight values ​​of each operator. Step S420: Prioritize the execution of the initial interaction intent corresponding to the highest intent weight value; Step S430: For other intent weight values, the preliminary interaction intents corresponding to the intent weight values ​​are adaptively adjusted in descending order of their weight values ​​to generate adjusted operation instructions.

[0047] In this embodiment, instruction coordination refers to the process in a multi-user interaction environment where, when the system detects interaction conflicts between different operators, it processes and integrates these conflicting instructions using certain strategies and algorithms to generate a unified, reasonable, and executable operation instruction. The intent weight value reflects the importance or priority of each operator's interaction intent, and can be calculated by weighting multiple factors such as the fineness of the operator's actions, the spatial distance between the operator's hand and the target interaction area, the operator's continuous attention time to the target interaction area, and the physical simulation complexity of the operation corresponding to the initial interaction intent.

[0048] When the system detects an interaction conflict, it needs to sort the intention weight values ​​of each operator, such as sorting the intention weight values ​​of each operator in descending order. The system will identify the intention with the highest weight value among all conflicting intentions and take it as the dominant or primary instruction to be executed. Then, the system will prioritize the execution of the preliminary interaction intention corresponding to the highest intention weight value, so that the system can initially identify the action or command that the operator wants to perform based on the operator's body movement information and hand key point information, and execute that action or command.

[0049] For preliminary interaction intentions corresponding to intention weight values ​​lower than the highest intention weight value, the system will not simply ignore or reject them. Instead, it will modify, restrict, or optimize them according to preset rules or algorithms to make them compatible with the highest-weighted intention. Furthermore, it will adaptively adjust the preliminary interaction intentions corresponding to other intention weight values ​​in descending order of weight, such as changing the operation range, speed, and area of ​​effect. This coordination and adaptive adjustment process allows the system to generate adjusted operation instructions, effectively resolving conflicts and guiding the digital model of clothing culture to update its state.

[0050] By introducing a mechanism that prioritizes the execution of the initial interaction intent corresponding to the highest intent weight value, the system can clearly define the intent of the dominant operator when multi-user interaction conflicts occur, avoiding system chaos or uncertainty in the model state caused by the simultaneous execution of multiple conflicting instructions. This gives the system a clear decision-making logic when handling complex interactions. Furthermore, by adaptively adjusting the initial interaction intents corresponding to other intent weight values ​​below the highest intent weight value, the system can retain some of the intents of other operators to the greatest extent possible, rather than simply discarding them. This improves the inclusivity of the interaction and the user experience, enabling the system to resolve conflicts while also considering the needs of different operators. It generates a comprehensive operation instruction that satisfies the dominant intent and reasonably incorporates secondary intents, ensuring that the updates to the clothing culture digital model are both accurate and in line with the overall interaction expectations of multiple users.

[0051] Furthermore, adaptive adjustment includes: reducing the operational magnitude and / or operational speed of the initial interaction intent corresponding to other intent weight values, and performing constraint processing that conforms to physical and cultural constraints.

[0052] Specifically, for operators whose intent weight value is lower than the highest intent weight value, the spatial range or temporal rate of the action corresponding to their initial interaction intent will be appropriately reduced during execution. For example, if an operator attempts to pull a digital model of clothing culture significantly, and their intent weight value is low, the range of their action may be limited to a smaller area, or the response speed of their action may be slowed down. By weakening the influence of secondary operators, more space is made for the actions of primary operators, while avoiding visual confusion or physical inconsistencies caused by multiple simultaneous actions.

[0053] When adjusting the initial interaction intent, not only are reductions in the range or speed of operations considered, but additional rules and restrictions are also introduced to ensure that the adjusted operation instructions are authentic, believable, and culturally appropriate in the digital model of clothing culture. For example, the material characteristics of clothing (such as elasticity and drape) and its wearing methods and taboos in specific cultural contexts will all be taken into consideration to prevent unnatural deformations or inappropriate interaction behaviors.

[0054] By reducing the magnitude and / or speed of the initial interactive intentions of secondary operators, their influence on the digital model of clothing culture is effectively weakened. This provides a clearer and higher-priority interaction channel for operators with higher intention weights, avoiding model instability or visual confusion caused by conflicts between multiple operators. Through adaptive adjustments to the magnitude and speed of operations, the system maintains responsiveness and fluency to primary operational intentions even in complex scenarios with simultaneous multi-user interactions. Furthermore, by executing constraint processing that conforms to physical and cultural constraints, the adjusted operational instructions on the digital model of clothing culture not only resolve interaction conflicts but also strictly adhere to the inherent physical attributes of clothing and the cultural norms it embodies. This avoids non-physical deformations or inappropriate cultural displays that may occur during the coordination process, thus maintaining the authenticity and seriousness of the digital model of clothing culture.

[0055] In one embodiment, the constraint processing that conforms to physical and cultural constraints includes: setting local constraints for the target interaction area of ​​a preliminary interaction intent that conflicts with other intent weight values ​​or the highest intent weight value; and setting local constraints based on predefined cultural norm constraints and the inherent physical attribute constraints of the clothing culture digital model.

[0056] In this embodiment, restrictive rules are applied to specific interactive areas or objects on the digital model of clothing culture to ensure that interactive operations, while satisfying user intentions, do not violate the inherent physical characteristics of the clothing and the cultural norms it embodies. For example, for an ancient garment, its material and structure determine its physical properties, such as not being able to be excessively stretched or penetrated; at the same time, its wearing methods and matching taboos constitute cultural normative constraints.

[0057] Predefined cultural norms refer to a set of rules regarding clothing, presentation, etiquette, historical context, and other aspects. These rules are established by experts or historical data at the outset of the system design, with the aim of maintaining the authenticity and seriousness of clothing culture. For example, certain garments may not be allowed to have their colors or textures altered arbitrarily, certain accessories must be paired with specific outfits, or certain display actions may be considered disrespectful.

[0058] The inherent physical properties of digital clothing models specifically guide the rules governing how clothing behaves physically in a virtual environment, similar to that in the real world. For example, the fabric simulation of clothing should follow physical laws such as elasticity, gravity, and friction, and its folds and drape should correspond to real materials. These constraints ensure that the digital model does not exhibit unnatural deformation or clipping during interaction, thereby enhancing the realism and immersion of the interaction.

[0059] By setting local constraints on the target interaction area for other intention weight values ​​or initial interaction intentions that conflict with the highest intention weight value, and by setting these local constraints based on predefined cultural norms and the inherent physical attribute constraints of the clothing culture digital model, distortion of the digital model or distortion of cultural connotations caused by operational conflicts can be effectively avoided in multi-user or complex interaction scenarios. When multiple operators simultaneously operate on the same area of ​​the clothing culture digital model, or when an operational intention may cause the clothing to deform in a way that does not conform to its physical characteristics or cultural background, the local constraints can intervene in a timely manner to restrict or adjust the conflicting operations. For example, if an operator attempts to stretch a silk garment to an unreasonable degree, the physical attribute constraints will prevent such excessive deformation; if another operator attempts to match a garment from a specific dynasty with accessories from a different dynasty, the cultural norms constraints will provide a prompt or prevent it. This ensures the authenticity, rationality, and cultural accuracy of the clothing culture digital model during the interaction process.

[0060] In one embodiment, step S500 includes: updating the geometry, texture, and physical simulation effects of the digital model of clothing culture in real time based on operation instructions.

[0061] Specifically, the operation instructions are generated after coordination and are used to guide the digital model of clothing culture to change its state. Real-time updates mean that the system can respond to operation instructions instantly and adjust the state of the digital model of clothing culture in a very short time to ensure smooth interaction and immediate feedback. The digital model of clothing culture is the three-dimensional representation of clothing in a digital environment, which includes the visual and physical attributes of clothing. Geometric form refers to the spatial structure and shape of the digital model of clothing culture, such as the folds, drape, and pattern of clothing. Texture refers to the visual features of the surface of the digital model of clothing culture, such as the pattern, color, gloss, and material details of the fabric. Physical simulation effect refers to the dynamic behavior of the digital model of clothing culture when it is subjected to force or interacts with other objects in the virtual environment, such as the deformation, swaying, and collision of clothing when it moves, is blown by the wind, or comes into contact with the human body.

[0062] By updating the geometry, texture, and physical simulation effects of the digital model of clothing culture in real time, it is ensured that the operator's intentions during human-computer interaction are accurately, comprehensively, and realistically reflected in the digital model. Once an operation command is generated, the system immediately parses it and translates it into specific modifications to various attributes of the digital model. For example, if the command instructs to stretch the sleeves, the geometry will be adjusted to simulate the stretching effect; if the command instructs to change the fabric, the texture will be updated to display the new fabric pattern and feel; if the command instructs to simulate wind, the physical simulation effects will be activated, causing the clothing to sway and deform accordingly. This multi-dimensional, real-time update mechanism allows the digital model of clothing culture to dynamically respond to the operator's interactions, thus providing a highly immersive experience.

[0063] According to embodiments of the present invention, such as Figure 5 As shown, on the other hand, a human-computer interaction system for digital interactive display of clothing culture is also provided, including: The information acquisition module 100 is used to acquire the limb movement information and key hand point information of each operator in real time; The intent parsing module 200 is used to parse body movement information and key hand information to obtain the preliminary interaction intent of each operator; The conflict identification module 300 is used to calculate the intention weight value of each operator based on the initial interaction intention and identify the interaction conflict between different operators; the interaction conflict includes at least one of the following: overlapping target areas, contradiction between global operation and local operation, violation of clothing physical properties and violation of clothing cultural norms; The instruction generation module 400 is used to coordinate instructions based on the intent weight value of each operator and generate operation instructions when an interaction conflict is detected. The model update module 500 is used to update the status of the digital model of clothing culture based on operation instructions.

[0064] In one embodiment, the information acquisition module 100 includes: The first acquisition unit is used to scan and analyze the operator's body in real time within the interactive area based on the depth sensing device, generate the position and posture information of the operator's skeletal joints in three-dimensional space, and obtain the operator's three-dimensional skeletal data. The second acquisition unit is used to capture the specific point information of the operator's hand in three-dimensional space in real time based on the depth sensing device, and obtain the key point data of the operator's hand. The unit is used to use three-dimensional skeletal data as limb motion information and hand keypoint data as hand keypoint information.

[0065] In one embodiment, the intent parsing module 200 includes: The first parsing unit is used to analyze the limb movement information and key hand point information of each operator in real time based on the posture recognition algorithm; The third acquisition unit is used to compare and match the parsed limb movement information and hand key point information of each operator with the preset interaction intent category to obtain the preliminary interaction intent of each operator.

[0066] In one embodiment, the collision identification module 300 includes: The calculation unit is used to perform weighted calculations based on the initial interaction intent and in combination with multiple preset weighting factors to obtain the intent weight value of each operator. The multiple preset weighting factors include at least one of the following: the fineness of the operator's action, the spatial distance between the operator's hand and the target interaction area, the operator's continuous attention time to the target interaction area, and the physical simulation complexity of the operation corresponding to the initial interaction intent.

[0067] In one embodiment, the instruction generation module 400 includes: The sorting unit is used to sort the intent weight values ​​of each operator when an interaction conflict is detected. The execution unit is used to prioritize the execution of the initial interaction intent corresponding to the highest intent weight value; The generation unit is used to adaptively adjust the initial interaction intents corresponding to other intent weight values ​​in descending order of their weight values, in order to generate adjusted operation instructions.

[0068] In one embodiment, the generation unit includes: The adjustment subunit is used to reduce the operational scope and / or speed of the initial interaction intent corresponding to other intent weight values, and to perform constraint processing that conforms to physical and cultural constraints. The constraint processing that conforms to physical and cultural constraints includes: setting local constraint conditions for the target interaction area of ​​other intent weight values ​​or initial interaction intents that conflict with the highest intent weight value; and setting local constraint conditions based on predefined cultural norm constraints and the inherent physical attribute constraints of the clothing culture digital model.

[0069] In one embodiment, the model update module 500 includes: The update unit is used to update the geometric shape, texture, and physical simulation effects of the digital model of clothing culture in real time based on operation instructions.

[0070] Figure 6 The diagram shows a structural schematic of an embodiment of an electronic device provided by the present invention. The specific embodiments of the present invention do not limit the specific implementation of the electronic device.

[0071] like Figure 6 As shown, the electronic device may include: a processor 1002, a communications interface 1004, a memory 1006, and a communications bus 1008.

[0072] The processor 1002, communication interface 1004, and memory 1006 communicate with each other via communication bus 1008. Communication interface 1004 is used to communicate with other network elements such as clients or other servers. The processor 1002 executes program 1010, specifically performing the relevant steps in the above-described human-computer interaction method embodiment for digital interactive display of clothing culture.

[0073] Specifically, program 1010 may include program code, which includes computer-executable instructions.

[0074] The processor 1002 may be a central processing unit (CPU), an application-specific integrated circuit (ASIC), or one or more integrated circuits configured to implement embodiments of the present invention. The electronic device includes one or more processors, which may be processors of the same type, such as one or more CPUs; or they may be processors of different types, such as one or more CPUs and one or more ASICs.

[0075] Memory 1006 is used to store program 1010. Memory 1006 may include high-speed RAM memory, and may also include non-volatile memory, such as at least one disk storage device.

[0076] Specifically, program 1010 can be called by processor 1002 to cause the electronic device to execute the relevant steps in the above-described human-computer interaction method embodiment for digital interactive display of clothing culture.

[0077] Those skilled in the art will understand that Figure 6 The structure shown is for illustrative purposes only and does not limit the structure of the aforementioned device. For example, electronic devices may also include components that are more... Figure 6 The more or fewer components shown, or having the same Figure 6 The different configurations shown.

[0078] This invention also provides a computer-readable storage medium. The methods described above according to embodiments of the invention can be implemented in hardware or firmware, or implemented as computer code that can be recorded on a storage medium, or implemented as computer code downloaded via a network and originally stored on a remote storage medium or a non-transitory machine-readable storage medium and then stored on a local storage medium. Thus, the methods described herein can be processed by software stored on a storage medium using a general-purpose computer, a dedicated processor, or programmable or dedicated hardware. The storage medium can be a magnetic disk, optical disk, read-only memory, random access memory, flash memory, hard disk, or solid-state drive, etc.; further, the storage medium can also include combinations of the above types of memory. It is understood that computers, processors, microprocessor controllers, or programmable hardware include storage components capable of storing or receiving software or computer code, which, when accessed and executed by the computer, processor, or hardware, implements the methods shown in the above embodiments.

[0079] In the specific implementation of the above embodiments, the technical features can be combined in any non-contradictory way. For the sake of brevity, not all possible combinations of the above technical features are described. However, as long as the combination of these technical features is not contradictory, it should be considered to be within the scope of this specification.

[0080] The specific embodiments described above are merely illustrative of several implementations of the present invention, and while the descriptions are detailed, they should not be construed as limiting the scope of the present invention. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of the present invention, and these modifications and improvements all fall within the scope of protection of the present invention. Therefore, the scope of protection of this patent should be determined by the appended claims.

Claims

1. A human-computer interaction method for digital interactive display of clothing culture, characterized in that, include: Real-time acquisition of body movement information and key hand information of each operator; The limb movement information and the key hand information are analyzed to obtain the preliminary interaction intentions of each operator; Based on the initial interaction intent, the intent weight value of each operator is calculated, and interaction conflicts between different operators are identified; the interaction conflicts include at least one of the following: overlapping target areas, contradiction between global and local operations, violation of clothing physical properties, and violation of clothing cultural norms; In the event of an interaction conflict, instruction coordination is performed based on the intent weight values ​​of each operator to generate an operation instruction. Based on the operation instructions, the digital model of clothing culture is updated.

2. The human-computer interaction method for digital interactive display of clothing culture according to claim 1, characterized in that, The real-time acquisition of limb movement information and key hand point information of each operator includes: Within the interactive area, the operator's body is scanned and analyzed in real time using a depth sensing device to generate the position and posture information of the operator's skeletal joints in three-dimensional space, thus obtaining the operator's three-dimensional skeletal data. Based on the depth sensing device, the operator's hand is captured in real time at specific points in three-dimensional space to obtain the operator's key point data. The three-dimensional skeletal data is used as the limb movement information, and the hand key point data is used as the hand key point information.

3. The human-computer interaction method for digital interactive display of clothing culture according to claim 2, characterized in that, The process of parsing the limb movement information and the key hand information to obtain the preliminary interaction intentions of each operator includes: Based on the posture recognition algorithm, the limb movement information and key hand point information of each operator are analyzed in real time; The parsed limb movement information and hand key point information of each operator are compared and matched with preset interaction intent categories to obtain the preliminary interaction intent of each operator.

4. The human-computer interaction method for digital interactive display of clothing culture according to claim 1, characterized in that, The calculation of the intent weight value for each operator based on the initial interaction intent includes: Based on the initial interaction intent, and combined with multiple preset weighting factors, the intent weight value of each operator is obtained through weighted calculation. The preset multiple weighting factors include at least one of the following: the precision of the operator's movements, the spatial distance between the operator's hand and the target interaction area, the operator's continuous attention time to the target interaction area, and the physical simulation complexity of the operation corresponding to the initial interaction intention.

5. The human-computer interaction method for digital interactive display of clothing culture according to claim 1, characterized in that, In the event of an interaction conflict, the method of coordinating instructions based on the intent weight values ​​of each operator to generate an operation instruction includes: In the event of an interaction conflict, the intention weight values ​​of each operator are sorted. The initial interaction intent corresponding to the highest intent weight value is executed first. For the other intent weight values, the initial interaction intents corresponding to the intent weight values ​​are adaptively adjusted in descending order of their value to generate the adjusted operation instructions.

6. The human-computer interaction method for digital interactive display of clothing culture according to claim 5, characterized in that, The adaptive adjustment includes: Reduce the operational magnitude and / or operational speed of the initial interaction intent corresponding to the other intent weight values, and perform constraint processing that conforms to physical and cultural constraints.

7. The human-computer interaction method for digital interactive display of clothing culture according to claim 6, characterized in that, The constraint processing that conforms to both physical and cultural constraints includes: Set local constraints for the target interaction area of ​​the initial interaction intent that conflicts with other said intent weight values ​​or the highest said intent weight value; The local constraint conditions are set based on predefined cultural norms and the inherent physical attribute constraints of the digital model of clothing culture.

8. The human-computer interaction method for digital interactive display of clothing culture according to claim 1, characterized in that, The process of updating the state of the digital model of clothing culture based on the operation instructions includes: The geometric shape, texture, and physical simulation effect of the digital model of clothing culture are updated in real time based on the operation instructions.

9. A human-computer interaction system for digital interactive display of clothing culture, characterized in that, The system includes: The information acquisition module is used to acquire real-time information on the body movements and key hand points of each operator; The intent parsing module is used to parse the limb movement information and the key hand information to obtain the preliminary interaction intent of each operator; The conflict identification module is used to calculate the intention weight value of each operator based on the initial interaction intention, and to identify the interaction conflict between different operators; the interaction conflict includes at least one of the following: target area overlap, contradiction between global operation and local operation, violation of clothing physical properties and violation of clothing cultural norms; The instruction generation module is used to coordinate instructions based on the intent weight value of each operator and generate operation instructions when the interaction conflict is detected. The model update module is used to update the status of the digital model of clothing culture based on the operation instructions.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer instructions, which are used to cause a processor to execute the human-computer interaction method for digital interactive display of clothing culture as described in any one of claims 1-8.

Images