Virtual mapping creation method and system of intelligent Internet of Things equipment in meta universe

Abstract

The invention provides a virtual mapping creation method and system of intelligent Internet of Things equipment in a meta-universe, and relates to the technical field of meta-universe, and the method comprises the steps: determining an initialization position in a virtual space of the meta-universe through receiving equipment identification information, and selecting a matched virtual mapping model; constructing a multi-level virtual mapping adaptive system which comprises a physical layer adaptive module and an interaction layer synchronization module, and realizing physical attribute consistency mapping and interaction state real-time synchronization; and generating a virtual mapping object interaction behavior by adopting a sphere bounding box algorithm. According to the method, the virtual mapping precision and the interaction synchronization are improved, the user experience is enhanced, and seamless connection between the physical world and the virtual world is realized.

Description

Technical Field

[0001] The present invention relates to the technical field of the metaverse, and particularly to a method and system for creating virtual mappings of intelligent IoT devices in the metaverse. Background Art

[0002] With the rapid development of metaverse technology, mapping intelligent IoT devices in the real world into the virtual space has become an important way to achieve digital twins and immersive experiences. As a bridge connecting the real world and the digital world, the virtual mapping technology of intelligent IoT devices has received extensive attention. These devices include, but are not limited to, various IoT terminals such as smart home devices, industrial control devices, and wearable devices. At present, the integration of IoT technology and the metaverse has been applied in multiple fields, such as smart cities, intelligent manufacturing, and remote healthcare. By mapping the functions, states, and interaction capabilities of physical devices into the virtual space, users can perceive and control real devices in the metaverse environment, breaking the limitations of space and time and providing new possibilities for human-computer interaction.

[0003] Existing virtual mapping technologies mainly adopt the methods of static model matching and simple state synchronization, generating corresponding virtual objects by collecting basic device information and according to preset templates. In the metaverse platform, these virtual objects can display the basic states of the devices and support limited interaction functions. With the improvement of computing power and network transmission technology, real-time data transmission and complex interaction simulation have become possible, but there is still much room for improvement in the accuracy, real-time performance, and interaction naturalness of existing virtual mapping technologies.

[0004] There is a problem of inaccurate mapping of physical properties in the existing virtual mapping technology of intelligent IoT devices in the metaverse. Traditional mapping methods often only focus on the basic functions and simple states of devices, and the mapping of physical properties such as deformation, mass, and inertia of devices is not accurate enough, resulting in obvious differences in physical behaviors between virtual objects in the metaverse and real devices, making it difficult to achieve a real physical interaction experience. Especially in application scenarios involving complex physical environments, this difference will significantly reduce the user's immersion.

[0005] There are obvious lags in real-time synchronization and interaction state consistency in the existing technology. Due to factors such as network latency and data processing time, there is often a time difference in the state updates between virtual mapping objects and actual devices, and there is a lack of an effective delay compensation mechanism, resulting in that when users operate virtual objects in the metaverse environment, it cannot be reflected in physical devices in a timely manner, or the state changes of physical devices cannot be updated to the virtual space in a timely manner, seriously affecting the coherence and reliability of the interaction experience.

[0006] Existing virtual mapping technologies lack systematic solutions in terms of spatial constraints and interaction behavior generation. In the virtual space of the metaverse, the interaction behavior of devices needs to consider the particularities of the virtual environment, such as spatial layout, object collision, environmental rules, etc. However, most existing technologies adopt simple state transition models, ignoring the complexity and diversity of the virtual space, and are unable to effectively handle the problems of multi-device collaborative interaction and behavior adaptation in complex environments, resulting in the interaction behavior of virtual mapping objects in the metaverse being insufficiently natural and intelligent, restricting the depth and breadth of user-device interaction. Summary of the Invention

[0007] Embodiments of the present invention provide a method and system for creating virtual mapping of intelligent IoT devices in the metaverse, which can solve the problems in the prior art.

[0008] In the first aspect of the embodiments of the present invention, a method for creating virtual mapping of intelligent IoT devices in the metaverse is provided, including: Receiving device identification information sent by the intelligent IoT device, where the device identification information includes device type information, device location information, and device function parameter information; Based on the device identification information, determining the initial position of the virtual mapping object in the metaverse virtual space, and selecting a virtual mapping model that matches the device type information according to the preset correspondence between the device type and the virtual mapping model, to generate the virtual mapping object of the intelligent IoT device; Constructing a multi-level virtual mapping adaptive system, the multi-level virtual mapping adaptive system includes a physical layer adaptation module and an interaction layer synchronization module, where the physical layer adaptation module is used to implement the consistent mapping of the physical attributes of the virtual mapping object and the real device, and the interaction layer synchronization module is used to ensure the real-time synchronization of the interaction state of the virtual mapping object and the real device through an adaptive compensation algorithm; Generating an action sequence according to the output result of the multi-level virtual mapping adaptive system combined with the metaverse space constraints, and adopting a sphere bounding box algorithm to generate the interaction behavior of the virtual mapping object in the metaverse virtual space.

[0009] Based on the device identification information, determining the initial position of the virtual mapping object in the metaverse virtual space, and selecting a virtual mapping model that matches the device type information according to the preset correspondence between the device type and the virtual mapping model, to generate the virtual mapping object of the intelligent IoT device includes: Using a spatial coordinate transformation matrix to convert the device location information of the intelligent IoT device into the initial position coordinates in the metaverse virtual space, where the spatial coordinate transformation matrix includes rotation matrix parameters and translation vector parameters; Converting the device type information and the device function parameter information into device feature vectors; Based on the device feature vector, calculate the matching degree between each virtual mapping model in the preset virtual mapping model library and the intelligent IoT device, and the calculation of the matching degree includes the calculation of the cosine similarity of the feature vectors; Take the virtual mapping model with the highest matching degree as the optimal virtual mapping model, and generate the virtual mapping object of the intelligent IoT device.

[0010] The method further includes: Determine the attribute set of the virtual mapping object according to the optimal virtual mapping model, and the attribute set includes basic attributes, functional attributes, and interaction attributes. The basic attributes include geometric feature parameters and material property parameters, the functional attributes correspond to the device function parameter information, and the interaction attributes define the interaction method and interaction ability of the virtual mapping object; Generate the state vector of the virtual mapping object according to the attribute set, the device feature vector, and the initial position coordinates, and establish the mapping relationship between the state vector and the intelligent IoT device.

[0011] The physical layer adaptation module is used to realize the consistent mapping of the physical attributes of the virtual mapping object and the real device, including: Perform hierarchical processing on the physical attributes, establish the geometric feature mapping relationship and the material property mapping relationship respectively, and generate the initial physical feature data of the virtual mapping object; Calculate the physical feature consistency evaluation data between the virtual mapping object and the real device, and the physical feature consistency evaluation data is obtained by weighted calculation of the feature differences between the virtual mapping object and the real device in each physical feature dimension; When the physical feature consistency evaluation data exceeds the preset threshold, calculate the physical feature compensation data based on the gradient descent method, and dynamically correct the physical feature data of the virtual mapping object by combining the historical compensation data; Update the physical feature data of the virtual mapping object in real time. When the geometric feature error data and the material property error data are both less than the corresponding error thresholds, complete the physical layer adaptation of the virtual mapping object.

[0012] The interaction layer synchronization module is used to ensure the real-time synchronization of the interaction states of the virtual mapping object and the real device through an adaptive compensation algorithm, including: Calculate the interaction state deviation between the virtual mapping object and the real device in real time. When the interaction state deviation exceeds the preset deviation threshold, use the adaptive compensation algorithm to dynamically adjust the interaction parameters of the virtual mapping object; Update the interaction state parameters of the virtual mapping object in real time to achieve the real-time synchronization of the interaction states of the virtual mapping object and the real device.

[0013] Generate an action sequence based on the output result of the multi-level virtual mapping adaptive system and the constraints of the metaverse space. The generation of the interaction behavior of the virtual mapping object in the metaverse virtual space using the sphere bounding box algorithm includes: Generate an action sequence based on the output result of the multi-level virtual mapping adaptive system and the constraints of the metaverse space; Use the sphere bounding box method to calculate the minimum distance between the virtual mapping object and the surrounding environment. When the minimum distance is less than the preset safety distance, trigger obstacle avoidance processing, and calculate the interaction feedback force based on the displacement deviation, speed deviation, and contact energy.

[0014] In the second aspect of the embodiments of the present invention, there is provided a virtual mapping creation system of an intelligent IoT device in the metaverse, including: A first unit for receiving the device identification information sent by the intelligent IoT device, where the device identification information includes device type information, device location information, and device function parameter information; A second unit for determining the initial position of the virtual mapping object in the metaverse virtual space based on the device identification information, and selecting a virtual mapping model that matches the device type information according to the preset correspondence between the device type and the virtual mapping model, and generating the virtual mapping object of the intelligent IoT device; A third unit for constructing a multi-level virtual mapping adaptive system, where the multi-level virtual mapping adaptive system includes a physical layer adaptation module and an interaction layer synchronization module. The physical layer adaptation module is used to implement the consistency mapping of the physical attributes of the virtual mapping object and the real device, and the interaction layer synchronization module is used to ensure the real-time synchronization of the interaction states of the virtual mapping object and the real device through an adaptive compensation algorithm; A fourth unit for generating an action sequence based on the output result of the multi-level virtual mapping adaptive system and the constraints of the metaverse space, and generating the interaction behavior of the virtual mapping object in the metaverse virtual space using the sphere bounding box algorithm.

[0015] In the third aspect of the embodiments of the present invention, there is provided an electronic device, including: A processor; A memory for storing instructions executable by the processor; Wherein, the processor is configured to call the instructions stored in the memory to execute the method described above.

[0016] In the fourth aspect of the embodiments of the present invention, there is provided a computer-readable storage medium, on which computer program instructions are stored, and when the computer program instructions are executed by a processor, the method described above is implemented.

[0017] The beneficial effects of this application are as follows: By constructing a multi-level virtual mapping adaptive system, high-precision mapping of intelligent IoT devices in the metaverse is achieved, ensuring the consistency of physical properties and real-time synchronization of interaction states between virtual objects and real devices, and improving the realism and reliability of users' manipulation of intelligent IoT devices in the metaverse.

[0018] The sphere bounding box algorithm is used to generate the interaction behavior of virtual mapping objects, effectively solving the problems of collision detection and dynamic response of different types of intelligent IoT devices in the virtual space of the metaverse, optimizing the utilization efficiency of system resources, and ensuring a smooth interaction experience in complex scenarios.

[0019] By automatically matching the appropriate virtual model through the preset correspondence between device types and virtual mapping models, the mapping process of intelligent IoT devices in the metaverse is simplified, the technical threshold is reduced, enabling various intelligent IoT devices to quickly access the metaverse platform, achieving seamless connection between the physical world and the virtual world, and providing users with a more convenient smart home management experience. Brief Description of the Drawings

[0020] Figure 1 It is a schematic flowchart of the method for creating virtual mapping of intelligent IoT devices in the metaverse according to an embodiment of the present invention; Figure 2 It is a schematic diagram for comparing the matching accuracy of feature vectors under different environmental conditions according to an embodiment of the present invention; Figure 3 It is a complete flowchart of the optimal virtual mapping model according to an embodiment of the present invention; Figure 4 It is a schematic diagram for comparing the calculation accuracy of interaction feedback force under different scenarios according to an embodiment of the present invention. Detailed Description of the Embodiments

[0021] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

[0022] The technical solutions of the present invention will be described in detail below with specific embodiments. These specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments.

[0023] Figure 1 It is a schematic flowchart of the method for creating virtual mapping of intelligent IoT devices in the metaverse according to an embodiment of the present invention, as Figure 1 shown, the method includes: Receive the device identification information sent by the intelligent Internet of Things device, where the device identification information includes device type information, device location information, and device function parameter information; Based on the device identification information, determine the initial position of the virtual mapping object in the metaverse virtual space, and select a virtual mapping model that matches the device type information according to the preset correspondence between the device type and the virtual mapping model, and generate the virtual mapping object of the intelligent Internet of Things device; Construct a multi-level virtual mapping adaptive system, where the multi-level virtual mapping adaptive system includes a physical layer adaptation module and an interaction layer synchronization module, and the physical layer adaptation module is used to achieve the consistent mapping of the physical attributes of the virtual mapping object and the real device, and the interaction layer synchronization module is used to ensure the real-time synchronization of the interaction state between the virtual mapping object and the real device through an adaptive compensation algorithm; Generate an action sequence according to the output result of the multi-level virtual mapping adaptive system combined with the metaverse space constraints, and use the sphere bounding box algorithm to generate the interaction behavior of the virtual mapping object in the metaverse virtual space.

[0024] In an optional implementation manner, based on the device identification information, determining the initial position of the virtual mapping object in the metaverse virtual space, and selecting a virtual mapping model that matches the device type information according to the preset correspondence between the device type and the virtual mapping model, and generating the virtual mapping object of the intelligent Internet of Things device includes: Use a space coordinate transformation matrix to convert the device location information of the intelligent Internet of Things device into the initial position coordinates in the metaverse virtual space, where the space coordinate transformation matrix includes rotation matrix parameters and translation vector parameters; Convert the device type information and the device function parameter information into a device feature vector; Based on the device feature vector, calculate the matching degree between each virtual mapping model in the preset virtual mapping model library and the intelligent Internet of Things device, and the calculation of the matching degree includes the calculation of the cosine similarity of the feature vectors; Use the virtual mapping model with the highest matching degree as the optimal virtual mapping model, and generate the virtual mapping object of the intelligent Internet of Things device.

[0025] According to the obtained intelligent Internet of Things device identification information, it is first necessary to determine the initial position of the device in the metaverse virtual space. The real physical position of the device is usually represented by three-dimensional coordinates (x, y, z), and the coordinate system in the metaverse virtual space may be different from the coordinate system in the physical world, so space coordinate conversion is required.

[0026] The physical location information of the device is converted into the initial position coordinates in the virtual space by using a spatial coordinate transformation matrix. The spatial coordinate transformation matrix includes rotation matrix parameters and translation vector parameters, which are used to realize the mapping between coordinate systems.

[0027] The rotation matrix parameters are used to adjust the orientation of the device to ensure that the orientation of the virtual mapping object in the virtual space is consistent with that of the real device. For example, if the orientation of the intelligent IoT device in the physical space is northeast, then through the setting of the rotation matrix parameters, the virtual mapping object is also oriented in the corresponding direction in the virtual space. When specifically implemented, Euler angles or quaternions can be used to represent the rotation.

[0028] The translation vector parameters are used to correspond to the actual position of the device in the physical space. For example, if the physical coordinates of the intelligent IoT device are (10, 20, 0) meters, and there is an offset of (100, 100, 10) meters between the origin of the metaverse virtual space and the origin of the physical space, then through the translation vector parameters, the device position is mapped to (110, 120, 10) in the virtual space.

[0029] Suppose an intelligent lighting device in the physical world is located at coordinates (5.2, 3.7, 1.8) meters, with an orientation angle of 30 degrees, and there is an offset of (50, 30, 0) between the virtual space and the physical space, and the coordinate axes are rotated by 45 degrees. Then, through the calculation of the spatial coordinate transformation matrix, the initial position of the device in the virtual space can be obtained as (53.6, 35.4, 1.8), and the orientation angle is 75 degrees.

[0030] In order to accurately select a virtual mapping model that matches the device type, it is necessary to convert the device type information and functional parameter information into a device feature vector. The device feature vector is a multi-dimensional numerical representation that describes the attributes and functions of the device and is used for subsequent model matching calculations.

[0031] The device type information usually exists in text form, such as "intelligent lighting", "intelligent door lock", "intelligent speaker", etc. During the conversion process, the one-hot encoding method can be used to convert the text type into a vector representation. For example, if there are 10 preset device types in total, and the type of a certain device is "intelligent lighting", with the corresponding type number being 3, then it can be represented as a 10-dimensional vector, where the third element is 1 and the remaining elements are 0, that is, [0, 0, 1, 0, 0, 0, 0, 0, 0, 0].

[0032] The device function parameter information includes the specific functional characteristics of the device, such as the brightness adjustment range, color temperature adjustment ability, remote control function, etc. These parameters can be directly converted into vector form. For example, a certain intelligent lighting device has functions such as brightness adjustment (0 - 100%), color temperature adjustment (2700K - 6500K), timing switch, and remote control, then it can be represented as the vector [100, 3800, 1, -1], where 100 represents the maximum brightness adjustment range, 3800 represents the color temperature adjustment range, 1 represents the presence of a timing switch function, and -1 represents the presence of a remote control function.

[0033] Concatenate the device type vector and the function parameter vector to form a complete device feature vector. Taking the above intelligent lighting device as an example, its complete feature vector may be: [0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 100, 3800, 1, 1].

[0034] After determining the device's feature vector, it is necessary to select the most suitable virtual mapping model from the preset virtual mapping model library. This process is achieved by calculating the matching degree between the device feature vector and each virtual mapping model in the model library.

[0035] The matching degree calculation uses the feature vector cosine similarity method. Cosine similarity is an index to measure the similarity of the directions of two vectors. The closer its value is to 1, the more similar the two vectors are; the closer it is to 0, the less similar the two vectors are. In this embodiment, the most matching virtual mapping model is determined by calculating the cosine similarity between the device feature vector and the feature vectors of each virtual mapping model in the model library.

[0036] A virtual mapping model library is established in advance, and each model has a corresponding feature vector. For example, there is a "standard intelligent lamp" model in the model library, and its feature vector is [0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 100, 4000, 1, 1]; an "advanced intelligent lamp" model, and its feature vector is [0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 150, 5000, 1, 1, 1], where the last 1 represents the presence of a music rhythm function.

[0037] For the above intelligent lighting device, calculate the cosine similarity between its feature vector [0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 100, 3800, 1, 1] and the feature vector of the "standard intelligent lamp" model: [0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 100, 4000, 1, 1], and the result is approximately 0.999; And the feature vector of the "advanced intelligent lamp" model: The cosine similarity of [0,0,1,0,0,0,0,0,0,0,150,5000,1,1,1] is approximately 0.95.

[0038] Through comparison, the "standard smart lamp" model has a higher matching degree with the device. Therefore, the "standard smart lamp" model is selected as the virtual mapping model of the device.

[0039] After determining the initial position of the device and the optimal virtual mapping model, the last step is to generate the virtual mapping object of the device. The virtual mapping object is the digital twin of the device in the virtual space of the metaverse. It not only has a three-dimensional model similar to the appearance of the device but also includes the virtual implementation of the device's functions.

[0040] Load the selected virtual mapping model, which includes the basic three-dimensional model and functional interfaces of the device; configure the functional interfaces of the model according to the functional parameter information of the device so that it can accurately reflect the actual functions of the device; place the model at the calculated initial position coordinates and adjust the direction of the model according to the orientation information of the device; establish a data communication mechanism between the device and its virtual mapping object so that the changes in the device state can be reflected on the virtual mapping object in real time, and the operations of the virtual mapping object can also be converted into control instructions for the actual device.

[0041] For the aforementioned intelligent lighting device, its virtual mapping object will be a three-dimensional model similar to the appearance of the actual lamp, located at the position of (53.6, 35.4, 1.8) in the virtual space, with an orientation angle of 75 degrees. This virtual mapping object can display the current state of the lamp, such as the on / off state, brightness, color temperature, etc. Users can adjust these parameters interactively in the virtual space, and the corresponding control instructions will be sent to the actual device to change its state according to the virtual operation.

[0042] Figure 2 Schematic diagram for comparing the matching accuracy of feature vectors under different environmental conditions in the embodiments of the present invention: This figure shows the comparison of the recognition accuracies of three different technical solutions under various environmental conditions. It is presented in the form of a line chart in the figure. The horizontal axis represents six different environmental conditions (from left to right are standard indoor, strong light environment, low light environment, noisy background, multi-device interference, and large open space), and the vertical axis represents the percentage of recognition accuracy (70% - 100%).

[0043] The three technical solutions are represented by dotted lines (this technical solution), diamond lines (vector dot product method), and square lines (normalized vector matching) respectively. It can be seen from the data trend that under all environmental conditions, this technical solution always maintains the highest recognition accuracy, gradually decreasing from approximately 97% in a standard indoor environment to approximately 90% in a large open space. The vector dot product method ranks second, with the accuracy decreasing from approximately 92% in a standard indoor environment to approximately 80% in a large open space. The performance of the normalized vector matching is the worst, decreasing from approximately 89% in a standard indoor environment to approximately 74% in a large open space.

[0044] All three curves show a downward trend as the environmental conditions change, but the decline amplitudes are different. The curve of this technical solution is the flattest, indicating that it has the strongest adaptability to various environmental conditions and the most stable performance; while the curve of the normalized vector matching drops the steepest, indicating that this method is greatly affected by environmental factors and has poor stability. This visual comparison clearly demonstrates the performance differences of the three technical solutions in different application scenarios, which helps in the decision-making of technology selection.

[0045] In an alternative implementation, the method further includes: Determine the attribute set of the virtual mapping object according to the optimal virtual mapping model, where the attribute set includes basic attributes, functional attributes, and interaction attributes. Among them, the basic attributes include geometric feature parameters and material property parameters, the functional attributes correspond to the device function parameter information, and the interaction attributes define the interaction methods and interaction capabilities of the virtual mapping object; Generate the state vector of the virtual mapping object according to the attribute set, the device feature vector, and the initialized position coordinates, and establish the mapping relationship between the state vector and the intelligent IoT device.

[0046] After obtaining the optimal virtual mapping model, it is necessary to determine the attribute set of the virtual mapping object. This attribute set includes three main parts: basic attributes, functional attributes, and interaction attributes.

[0047] The basic attributes mainly include geometric feature parameters and material property parameters, which determine the basic appearance and physical properties of the virtual mapping object in the virtual space.

[0048] 1. Determination of geometric feature parameters: According to the real size data of the intelligent IoT device, determine the geometric parameters such as the length, width, and height of the virtual mapping object. For example, for an intelligent lighting device, its geometric feature parameters may include: length of 300 millimeters, width of 200 millimeters, and height of 100 millimeters.

[0049] Determine the shape parameters of the virtual mapping object according to the shape characteristics of the device. For example, the device may be cylindrical, cubic, or irregularly shaped, and needs to be accurately described in a parametric way.

[0050] For complex devices with multiple components, it is necessary to determine the relative positions and connection relationships between the components to ensure that the virtual mapping object can accurately reflect the overall structure of the device.

[0051] 2. Determination of material property parameters: Determine the surface material properties of the virtual mapping object according to the actual material information of the device, including parameters such as color, texture, gloss, and transparency.

[0052] For intelligent lamps, their material properties may include: the housing material is matte plastic, the color is pure white (RGB value: 255, 255, 255), the transparency is 0%, the lampshade material is semi-transparent, and the transparency is 60%.

[0053] For devices with a display screen, it is also necessary to determine the light-emitting characteristics and display effect parameters of the screen area.

[0054] The function attributes directly correspond to the device function parameter information and reflect the various function characteristics and operation capabilities of the intelligent IoT device.

[0055] 1. Function status attributes: Determine the function status attributes that the virtual mapping object needs to display according to the device function parameter information. For example, for intelligent lamps, their function status attributes include: switch status (Boolean value: on / off), brightness level (integer value: 0 - 100), color temperature value (integer value: 2700K - 6500K), RGB color value (triple of RGB values: 0 - 255).

[0056] For multi-functional devices, it is necessary to determine the status attributes of all function modules. For example, the function status attributes of an intelligent air conditioner may include: working mode (enumeration value: cooling / heating / dehumidifying / air supply), set temperature (integer value: 16 - 30 °C), wind speed level (enumeration value: low / medium / high / automatic).

[0057] 2. Function operation attributes: Determine the function operation attributes that the virtual mapping object can execute, and these attributes correspond to the control instructions that the device can respond to. For example, the function operation attributes of intelligent lamps include: switch control (operation type: on / off), brightness adjustment (operation type: brightness value setting, parameter range: 0 - 100), color temperature adjustment (operation type: color temperature value setting, parameter range: 2700K - 6500K).

[0058] For functions with multi-level operations, it is necessary to define the hierarchical structure of the operations and parameter limitations. For example, the channel switching function of a smart TV may have two operation methods: directly inputting the channel number and switching up and down.

[0059] The interaction property defines how the virtual mapping object responds to user operations and interacts with other virtual objects or system components.

[0060] 1. User interaction methods: Determine the interaction methods supported by the virtual mapping object, such as operation types like clicking, long pressing, swiping, dragging, etc. For smart lighting fixtures, its user interaction methods may include: clicking on the lamp body to switch the switch state, long pressing on the lamp body to bring up the brightness controller, and swiping on the brightness controller to adjust the brightness value.

[0061] Define the response behavior and visual feedback effect for each interaction method. For example, after clicking the switch, the color of the virtual lamp will change accordingly, accompanied by a short transition animation.

[0062] 2. Interaction ability parameters: Determine the interaction ability parameters of the virtual mapping object, including the interaction sensitive area, interaction response time, interaction feedback intensity, etc. For example, the interaction sensitive area of the switch button of a smart lighting fixture is a circular area with a diameter of 50 pixels; the interaction response time is 100 milliseconds, and a slight vibration feedback is generated after the interaction is successful.

[0063] For complex devices with a multi-level interaction interface, it is necessary to define the interface hierarchical structure and the switching conditions between each level.

[0064] After determining the attribute set, it is necessary to generate the state vector of the virtual mapping object based on the attribute set, device feature vector, and initial position coordinates, and establish the mapping relationship between the state vector and the intelligent IoT device.

[0065] 1. State vector structure design: Design a structured state vector, including basic state components, functional state components, and interaction state components.

[0066] The basic state components include: position coordinates (x, y, z), rotation angles (pitch, yaw, roll), scaling ratios (sx, sy, sz), and basic attribute parameters.

[0067] The functional state components include: the current values of all functional attributes, such as switch state, brightness value, temperature value, etc.

[0068] The interaction state components include: the current interaction state identifier, interaction history records, etc.

[0069] 2. Initial state assignment: Set the position information in the state vector according to the initialization position coordinates. For example, the initial position coordinates of the smart lamp are (120, 85, 200), indicating its position in the virtual space.

[0070] Initialize the functional status component according to the current device status information in the device feature vector. For example, if the device feature vector indicates that the smart lamp is currently on, with a brightness of 75% and a color temperature of 5000K, then assign these values to the corresponding functional status components in the state vector.

[0071] Initialize the interaction status component, usually set to the default non - interaction status.

[0072] 3. State vector update mechanism: Design a dynamic update mechanism for the state vector. When the device status changes, update the corresponding components in the state vector accordingly.

[0073] When the user turns on the smart lamp through the physical switch, the device sends a status change message to the system. After receiving this message, the system updates the switch status component in the state vector from 0 (off) to 1 (on).

[0074] When the user operates the virtual mapping object in the virtual environment, the system updates the corresponding components in the state vector and sends control instructions to the actual device.

[0075] 1. Unique identifier mapping: Assign a unique identifier to each virtual mapping object and establish a one - to - one correspondence between this identifier and the device ID of the corresponding intelligent IoT device. For example, if the device ID of the smart lamp is "LIGHT_001", then the identifier of its corresponding virtual mapping object can be set as "VM_LIGHT_001".

[0076] Record these corresponding relationships in the system's mapping relation table to ensure that the system can accurately perform message passing and status synchronization between virtual objects and actual devices.

[0077] 2. Status synchronization mapping: Establish a synchronization mapping relationship between each component in the state vector and the actual device parameters. For example, the brightness component value 75 in the state vector is mapped to the brightness parameter value 75% of the device.

[0078] Design the trigger conditions and synchronization frequencies for status synchronization to ensure that the virtual mapping object can timely reflect the device status changes. For important status changes, such as the switch status change, use the real - time push method for synchronization; for non - critical status, such as small temperature changes, use the periodic polling method for synchronization.

[0079] 3. Control instruction mapping: Establish a mapping relationship between the operation behavior of the virtual mapping object and the device control instruction. For example, the dragging operation on the brightness slider of the intelligent lamp in the virtual environment will be mapped to sending a brightness adjustment instruction to the device.

[0080] Define parameter conversion rules in the mapping relationship to ensure that the virtual operation can be accurately converted into the control instruction format recognizable by the device. For example, the brightness scale of 0 - 100 in the virtual environment needs to be converted into the brightness parameter format of 0% - 100% accepted by the device API.

[0081] Figure 3 The complete flowchart of the optimal virtual mapping model for the embodiment of the present invention is as follows: This figure shows the complete flowchart of an optimal virtual mapping model, which details the entire process from model establishment to the formation of the final mapping relationship. The process starts with the "optimal virtual mapping model" and is then decomposed by determining the attribute set of the virtual mapping object. These attribute sets are divided into three main categories: basic attributes (including geometric feature parameters and material property parameters), functional attributes (corresponding to device function parameter information), and interaction attributes (including interaction methods and interaction capabilities). These three categories of attributes jointly act on the subsequent processing links.

[0082] The middle part of the flowchart shows that the system needs to integrate and process two input parameters, namely the "device feature vector" and the "initial position coordinates", with the aforementioned three categories of attributes to finally generate the state vector of the virtual mapping object. This state vector is the key link connecting the virtual and the real. In the final stage of the process, the system will establish a mapping relationship between the state vector and the intelligent IoT device to achieve an effective connection between the virtual space and the real world.

[0083] The entire flowchart adopts a top - down hierarchical structure, clearly showing the logical relationship and data flow between each processing link through blue boxes and connection lines. This systematic mapping model design effectively solves the interaction mapping problem between virtual objects and actual devices, providing a theoretical basis and implementation framework for realizing the combination of virtual and real in the intelligent IoT system. Each link in the figure is an indispensable component, jointly constituting a complete virtual mapping system.

[0084] In an alternative embodiment, the physical layer adaptation module is used to implement the consistency mapping of the physical attributes of the virtual mapping object and the real device, including: Perform hierarchical processing on the physical attributes, respectively establish geometric feature mapping relationships and material property mapping relationships, and generate the initial physical feature data of the virtual mapping object; Calculate the physical feature consistency evaluation data between the virtual mapping object and the real device, where the physical feature consistency evaluation data is obtained by weighted calculation of the feature differences between the virtual mapping object and the real device in each physical feature dimension; When the physical feature consistency evaluation data exceeds the preset threshold, calculate the physical feature compensation data based on the gradient descent method, and dynamically correct the physical feature data of the virtual mapping object by combining historical compensation data; Update the physical feature data of the virtual mapping object in real time. When the geometric feature error data and the material property error data are both less than the corresponding error thresholds, complete the physical layer adaptation of the virtual mapping object.

[0085] The physical layer adaptation module first performs hierarchical processing on physical attributes, divides physical attributes into two levels: geometric features and material properties, and establishes mapping relationships respectively.

[0086] Geometric features include, but are not limited to, attributes such as the size, shape, mass, center of gravity position, and inertia matrix of the real device. For example, for an industrial robotic arm, its length is 1200 mm, width is 300 mm, weight is 35 kg, and the center of gravity position is 250 mm directly above the base of the robotic arm. The system will obtain the device surface point cloud data through a high-precision 3D scanner. The accuracy of the point cloud data reaches 0.1 mm, about 500,000 points are collected in total, and each point contains spatial three-dimensional coordinates and normal vector information. After processing the point cloud data, a 3D mesh model is generated, and the number of triangular mesh patches is about 100,000. The system uses this mesh model as the basic representation of geometric features.

[0087] Material properties include elastic modulus, friction coefficient, density distribution, surface roughness, thermal conductivity, etc. For example, the friction coefficients of the joints of the robotic arm are 0.25 - 0.35, the Ra value of the surface roughness is 3.2 μm, the main material of the body is aluminum alloy, and the thermal conductivity is 237 W / (m·K). The system collects the above parameters in real time through a material sensor array, and the sampling frequency is 100 Hz.

[0088] The system combines the above physical feature data to generate an initial physical feature data set of the virtual mapping object, which contains a feature vector of 89 dimensions and covers all key physical attributes.

[0089] The physical layer adaptation module calculates the physical feature consistency evaluation data between the virtual mapping object and the real device. In the evaluation process, first standardize the physical features in each dimension, convert features with different dimensions into dimensionless values, and the value range is limited between 0 and 1.

[0090] Calculate the feature differences between the virtual mapped object and the real device in each physical feature dimension. For example, for geometric dimensions, if a certain dimension of the real device is 120 mm and the corresponding dimension of the virtual object is 121.5 mm, the difference value in this dimension is 1.5 mm, and after normalization, it is 0.0125.

[0091] Adopt a weighted calculation method to synthesize the differences in each dimension, and different weights are assigned to different dimensions. For example, for an industrial robotic arm, the weight of joint position accuracy is 0.3, the weight of surface shape accuracy is 0.15, the weight of mass distribution is 0.25, and the weight of material properties is 0.3. The system can dynamically adjust the weight values according to specific application scenarios.

[0092] After the consistency evaluation data is calculated, the system compares this value with a preset threshold. The preset threshold is usually set to 0.15, indicating that when the comprehensive physical feature difference exceeds 15%, the compensation mechanism needs to be activated.

[0093] When the physical feature consistency evaluation data exceeds the preset threshold, the physical layer adaptation module calculates the physical feature compensation data based on the gradient descent method.

[0094] The compensation calculation process first identifies the feature dimension with the largest difference. For example, if it is found that the contribution of the surface friction coefficient difference is the largest, then this parameter is adjusted first. The system uses a prediction model trained with historical data to infer the direction and step size of parameter adjustment. The initial value of the step size is set to 50% of the difference value. For example, if the current difference is 0.08, the initial step size is 0.04.

[0095] Adopt an iterative optimization strategy. Adjust the physical feature parameters once in each iteration and re-evaluate the consistency. If the consistency improves, continue to adjust in the current direction; if the consistency decreases, reduce the step size and try to adjust in the reverse direction. During the iteration process, the step size gradually shrinks, successively decreasing from the initial value to 80%, 64%, 51%, etc., until the step size is less than the preset minimum value of 0.001 or the maximum number of iterations of 30 times is reached.

[0096] The physical feature compensation data not only considers the current real-time calculation results but also combines historical compensation data. The system maintains a historical database containing the last 50 compensation records, and integrates the historical compensation data through time-weighted averaging, with more recent data having a higher weight. For example, the weight of the most recent compensation is 0.2, the previous one is 0.15, and the one before that is 0.1, and so on.

[0097] Based on the calculated compensation data, the physical layer adaptation module dynamically corrects the physical feature data of the virtual mapped object. The correction process is divided into two modes: batch correction and incremental correction.

[0098] Batch correction is performed during the system initialization phase to adjust all physical parameters of the virtual object at once, including the eigenvalue features of 89 dimensions. Incremental correction is continuously carried out during the running process, updated every 100 milliseconds, and each time only a subset of parameters with obvious differences is adjusted, usually 5 - 10 parameters.

[0099] After the correction is completed, the physical feature data of the virtual mapping object is updated in real time. The update frequency is adaptively adjusted, increased to 200Hz during the critical interaction phase and decreased to 50Hz during the non - critical phase to save computing resources.

[0100] Continuously monitor the geometric feature error data and material property error data. When the geometric feature error is less than 3% and the material property error is less than 5%, the system considers that the physical layer adaptation of the virtual mapping object is completed. At this time, the physical behavior of the virtual object is basically the same as that of the real device, and it can accurately simulate the physical response of the real device under various environmental conditions.

[0101] In an actual application, when the system initially adapts the robotic arm model, the geometric error is 7.8% and the material property error is 9.2%. After 12 iterations of adjustment, the geometric error is reduced to 2.1% and the material property error is reduced to 3.5%, meeting the preset threshold requirements and completing the physical layer adaptation. After the adaptation is completed, when the virtual robotic arm is subjected to an external force, the deformation behavior error from the real robotic arm does not exceed 2.5mm, and the response time error does not exceed 15 milliseconds, meeting the requirements of industrial applications.

[0102] In an alternative embodiment, the interaction layer synchronization module is used to ensure the real - time synchronization of the interaction state between the virtual mapping object and the real device through an adaptive compensation algorithm, including: Real - time calculate the interaction state deviation between the virtual mapping object and the real device. When the interaction state deviation exceeds the preset deviation threshold, use the adaptive compensation algorithm to dynamically adjust the interaction parameters of the virtual mapping object; Real - time update the interaction state parameters of the virtual mapping object to achieve the real - time synchronization of the interaction state between the virtual mapping object and the real device.

[0103] The interaction layer synchronization module receives the state information from the real device and the state information of the virtual mapping object. By comparing the differences between the two, it calculates the interaction state deviation, and when the deviation exceeds the preset threshold, it uses the adaptive compensation algorithm to dynamically adjust the interaction parameters of the virtual mapping object to achieve the synchronization of their interaction states.

[0104] The interaction layer synchronization module first obtains the interaction state parameters of the real device and the virtual mapping object. These parameters include but are not limited to physical parameters such as position coordinates, rotation angles, motion speeds, accelerations, and device - specific working state parameters, such as the joint angles of the robotic arm and the motor speeds of the robot.

[0105] Taking an industrial robot as an example, the interactive state parameters include: The angle values of each joint of the robot (J1, J2, J3, J4, J5, J6); The position coordinates of the end effector of the robot (X, Y, Z); The attitude angles of the end effector of the robot (A, B, C); The movement speed and acceleration of each joint of the robot; The calculation method of the interactive state deviation is as follows: 1. Obtain the real-time state parameter set R_state from the real device, which contains the current values of all relevant parameters; 2. Obtain the corresponding state parameter set V_state from the virtual mapping object; 3. Calculate the relative deviation of each parameter: For position parameters: Calculate the Euclidean distance as the deviation value; For angle parameters: Calculate the absolute value of the angle difference as the deviation value; For speed parameters: Calculate the modulus of the speed vector difference as the deviation value; 4. Assign weights (W_i) according to the importance of each parameter, and calculate the comprehensive deviation value; For example, for a six-axis industrial robot, the deviation calculation can be specific as follows: Position deviation = ; Attitude deviation = |A_r - A_v| + |B_r - B_v| + |C_r - C_v|; Joint angle deviation = Σ|J_i_r - J_i_v| (i ranges from 1 to 6); Comprehensive deviation = W_pos × position deviation + W_att × attitude deviation + W_joint × joint angle deviation; W_pos, W_att, and W_joint are the weight coefficients of position, attitude, and joint angle respectively, which are usually set according to the application scenario. For example, W_pos = 0.5, W_att = 0.3, and W_joint = 0.2.

[0106] The preset deviation threshold is set according to different types of devices and application scenarios, and usually the following factors are considered: The accuracy requirements of the device; The real-time requirements; The network latency situation; The calculation resource limitations; High-precision processing equipment may need to set a lower deviation threshold (such as a position deviation of 0.01 mm), while general transportation robots may be able to accept a higher deviation threshold (such as a position deviation of 10 mm).

[0107] In practical applications, the system can set multiple levels of deviation thresholds. For example: Slight deviation threshold: 0.5 mm (position) / 0.5° (angle); Moderate deviation threshold: 2 mm (position) / 2° (angle); Severe deviation threshold: 5 mm (position) / 5° (angle); Deviations at different levels will trigger compensation adjustments of different intensities.

[0108] When it is detected that the interaction state deviation exceeds the preset threshold, the interaction layer synchronization module starts an adaptive compensation algorithm to dynamically adjust the interaction parameters of the virtual mapping object. The adaptive compensation algorithm dynamically adjusts the compensation parameters according to the magnitude, change trend, and historical synchronization data of the deviation.

[0109] The implementation steps of the adaptive compensation algorithm are as follows: 1. Calculate the deviation change rate: By comparing the difference between the current deviation and the previous N deviations, calculate the change trend of the deviation.

[0110] Deviation change rate = (current deviation - average value of previous N deviations) / time interval; 2. Determine the basic compensation coefficient: According to the ratio of the current deviation value to the preset threshold, determine the basic compensation coefficient.

[0111] Basic compensation coefficient = Min(deviation value / preset threshold × maximum compensation coefficient, maximum compensation coefficient); For example, if the current position deviation is 3 mm, the preset threshold is 2 mm, and the maximum compensation coefficient is 1.5, then the basic compensation coefficient = Min(3 / 2 × 1.5, 1.5) = 1.5; 3. Adaptively adjust the compensation coefficient: Adjust the compensation coefficient according to the deviation change rate. Increase the compensation intensity when the deviation increases, and decrease the compensation intensity when the deviation decreases.

[0112] If the deviation change rate > 0, it means the deviation is increasing, and enhance the compensation: Adjusted compensation coefficient = basic compensation coefficient × (1 + rate change coefficient × deviation change rate); If the deviation change rate < 0, it means the deviation is decreasing, and weaken the compensation: Adjusted compensation coefficient = basic compensation coefficient × (1 - rate suppression coefficient × |deviation change rate|); For example, assume the base compensation coefficient is 1.2, the change rate coefficient is 0.5, and the current deviation change rate is 0.2. Then the adjusted compensation coefficient = 1.2 × (1 + 0.5 × 0.2) = 1.32; 4. Consider historical compensation effects: Analyze the effects of historical compensation operations and adjust the compensation strategy.

[0113] Calculate the effectiveness index for the most recent N compensations = Degree of deviation reduction after compensation / Compensation intensity; Adjust the current compensation strategy based on the effectiveness index. If the effectiveness is high, maintain the strategy; if the effectiveness is low, adjust the strategy; 5. Perform the compensation operation: Calculate the compensation value based on the finally determined compensation coefficient and apply it to the interaction parameters of the virtual mapping object.

[0114] Compensation value = (Real device parameter - Virtual object parameter) × Adjusted compensation coefficient; Updated virtual object parameter = Current virtual object parameter + Compensation value; Taking an industrial robot as an example, if the position of the end effector of the real robot is (100, 150, 200) mm and the position of the virtual mapping object is (98, 152, 197) mm, the calculated position deviation is 5.1 mm, which exceeds the preset threshold of 4 mm and compensation is required. Assume the adjusted compensation coefficient is 1.2, then: Compensation value in the X direction = (100 - 98) × 1.2 = 2.4 mm; Compensation value in the Y direction = (150 - 152) × 1.2 = -2.4 mm; Compensation value in the Z direction = (200 - 197) × 1.2 = 3.6 mm; The updated position of the virtual mapping object is (100.4, 149.6, 200.6) mm, which is closer to the position of the real device at this time.

[0115] After completing the compensation calculation, the interaction layer synchronization module applies the updated parameters to the virtual mapping object to achieve synchronization of the interaction state between the virtual mapping object and the real device. The update process includes: 1. Write the calculated compensated parameters into the status cache of the virtual object; 2. Trigger the status update event of the virtual object; 3. The virtual environment engine re - renders the virtual object according to the updated parameters; 4. Record the timestamp, deviation value, and compensation value of this synchronization for subsequent compensation strategy optimization; To ensure the smoothness of synchronization, the interactive layer synchronization module can dynamically adjust the synchronization frequency according to network latency and computing resources. When the network is good, the synchronization frequency can be increased (such as 50Hz), and when the network is congested, the synchronization frequency can be appropriately reduced (such as 10Hz), but the single compensation intensity is increased.

[0116] Through the above implementation method, the interactive layer synchronization module can effectively ensure the real-time synchronization of the interaction state between the virtual mapping object and the real device. In actual application tests, this method can control the position deviation within the millimeter level (usually less than 2mm) and the angle deviation within 1 degree, and can maintain a good synchronization effect even when the network latency reaches 200ms.

[0117] This method is applicable to various human-computer interaction systems that require real-time synchronization, such as industrial robot remote control, surgical robot remote guidance, virtual reality interaction, etc., and can effectively improve the synchronization accuracy between virtual and real and the user experience.

[0118] In an optional implementation manner, an action sequence is generated according to the output result of the multi-level virtual mapping adaptive system in combination with the metaverse space constraints. The interactive behavior of the virtual mapping object in the metaverse virtual space is generated by using the sphere bounding box algorithm, including: Generating an action sequence according to the output result of the multi-level virtual mapping adaptive system in combination with the metaverse space constraints; Using the sphere bounding box method to calculate the minimum distance between the virtual mapping object and the surrounding environment. When the minimum distance is less than the preset safety distance, obstacle avoidance processing is triggered, and the interaction feedback force is calculated according to the displacement deviation, speed deviation, and contact energy.

[0119] The multi-level virtual mapping adaptive system will generate initial output results, which need to be combined with the metaverse space constraints to generate an action sequence that conforms to physical rules and space limitations. The metaverse space constraints mainly include three categories: physical constraints, geometric constraints, and interaction constraints.

[0120] Physical constraints include physical rules such as gravity, friction, and collision detection. Geometric constraints include space limitations such as space boundaries, obstacles, and passable areas. Interaction constraints include interaction rules with other virtual objects and user input responses.

[0121] The action sequence generation process adopts a hierarchical planning strategy, which is divided into two levels: global path planning and local action optimization. Global path planning is based on the A* algorithm to search for the optimal path from the starting point to the target point in the metaverse space. The path evaluation function comprehensively considers path length, energy consumption, and smoothness. For example, for the task of moving from coordinates (10, 20, 30) to coordinates (50, 60, 70), the system will search in the three-dimensional grid space to obtain the best path point sequence that avoids obstacles {(10,20,30), (15,25,35), (25,35,45), (40,50,60), (50,60,70)}.

[0122] Local action optimization adopts a sampling optimization method. Under the guidance of the global path, it generates smooth actions that conform to the motion characteristics of the object. For example, for a humanoid virtual mapping object, the system will generate a complete action sequence including gait parameters, torso posture, and arm movements. The action sequence is stored in the form of key frames, and each key frame contains information such as position, rotation, and speed. Continuous actions are generated between adjacent key frames through an interpolation algorithm. The typical data structure of action key frames includes attributes such as timestamp, joint position, joint rotation, linear velocity, and angular velocity.

[0123] To ensure that the generated action sequence conforms to the metaverse space constraints, the system adopts an iterative optimization strategy. After each generation of the action sequence, it checks whether there are any violations of the constraints. If there are violations, it adjusts the optimization parameters and regenerates until all constraints are met. For example, when it is detected that there is a wall-passing behavior in the action sequence, the system will increase the obstacle avoidance weight and re-optimize the action sequence.

[0124] After the action sequence is generated, the system uses the sphere bounding box algorithm for collision detection and interactive feedback force calculation. This algorithm first simplifies the virtual mapping object into a combination of multiple spheres to improve the calculation efficiency. For example, a humanoid character can be simplified into a model composed of multiple spheres such as the head, torso, and limbs, and each sphere is defined by the center coordinates and radius. Specifically, the head can be represented as a sphere with the center at (0, 175, 0) and a radius of 15 units, the torso is represented as a sphere with the center at (0,140, 0) and a radius of 25 units, and so on.

[0125] For static objects and other dynamic objects in the environment, the sphere bounding box or sphere bounding box hierarchy is also used for representation. The system regularly calculates the minimum distance between the virtual mapping object and all objects in the surrounding environment. The minimum distance calculation method is to calculate the distance between the centers of the two spheres and then subtract the sum of the radii of the two spheres. If the calculation result is negative, it means that the two spheres have penetrated; if it is positive, it means the minimum distance between the two spheres.

[0126] When the detected minimum distance is less than the preset safety distance, the system will trigger obstacle avoidance processing. The preset safety distance is dynamically adjusted according to the moving speed of the virtual mapping object. The faster the moving speed, the greater the safety distance. Taking a humanoid virtual character as an example, when the walking speed is 1.5 m / s, the preset safety distance is 0.5 m; when the running speed reaches 5 m / s, the preset safety distance increases to 1.5 m.

[0127] The obstacle avoidance processing adopts a potential field-based method, regarding the obstacle as a repulsive potential field source and the target point as an attractive potential field source. The virtual mapping object adjusts its moving direction and speed under the action of the combined potential field. For example, when an obstacle is detected 0.3 m to the right, the system will generate an obstacle avoidance displacement to the left, enabling the object to bypass the obstacle and continue moving forward.

[0128] The calculation of the interactive feedback force is based on three key parameters: displacement deviation, speed deviation, and contact energy. The displacement deviation refers to the difference between the actual position of the virtual object after being blocked and the expected position. The speed deviation refers to the difference between the actual speed and the expected speed. The contact energy is related to the contact area, contact depth, and relative speed.

[0129] The feedback force calculation uses a spring-damper model. The magnitude of the feedback force is proportional to the displacement deviation and the direction is opposite to the direction of the displacement deviation, while also considering the damping effect caused by the speed deviation. For example, when a virtual character hits a wall at a speed of 3 m / s, resulting in a displacement deviation of 0.1 m, the system will calculate a rebound force of approximately 300 Newtons, causing the character to bounce back and decelerate.

[0130] For interactive objects of different materials, the system sets different stiffness and damping parameters. For example, the stiffness parameter of a metal material is 10000 N / m, and the damping parameter is 1000 N·s / m; while the stiffness parameter of a cork material is 3000 N / m, and the damping parameter is 500 N·s / m. The interactive feedback force not only affects the motion state of the virtual mapping object but also can trigger visual, auditory, and tactile feedback, enhancing the user's immersion. For example, a strong collision will produce vibration effects, collision sounds, and particle effects, etc.

[0131] Feedback strategies for different interaction intensities have also been implemented. Slight contact (contact energy less than 10 Joules) only produces minor deformation and tactile feedback; medium collision (contact energy between 10 and 100 Joules) produces obvious changes in the motion state and sound effects; strong collision (contact energy greater than 100 Joules) may cause changes in the state of the virtual object, such as falling, damage, or functional failure, etc.

[0132] Figure 4 This is a schematic diagram for comparing the calculation accuracy of the interactive feedback force in different scenarios of the embodiment of the present invention: This figure shows the comparison of the recognition accuracies of three different technical solutions in eight interaction scenarios. The chart is in the form of a line chart, with the horizontal axis representing different interaction scenarios (touch scenario, fast sliding, continuous pressure, multi-point contact, vibration environment, high-speed collision, deformable object, low-friction surface), and the vertical axis representing the recognition accuracy percentage (60% - 100%).

[0133] Judging from the data performance, this technical solution (blue dot line) maintains high stability in various scenarios, and the accuracy rate generally remains above 90%. Among them, it reaches the highest value of about 95% in the continuous pressure scenario, and remains at about 88% even in the most challenging deformable object scenario. The solution based on the spring model (red square line) ranks second overall, with the accuracy rate fluctuating between 70% - 90%, reaching a peak of about 90% in the continuous pressure scenario, but performing poorly in scenarios such as the vibration environment and low-friction surface, dropping to about 72%. The linear feedback model (green triangle line) shows the most unstable performance, with the accuracy rate fluctuating in the range of 65% - 85%, dropping to the lowest of about 66% in the deformable object scenario.

[0134] The performance curves of the three solutions all show a certain degree of volatility, but the amplitudes of volatility are different. The curve of this technical solution is the smoothest, indicating that it has the best scenario adaptability and stability; while the performances of the other two solutions vary greatly in different scenarios, especially in some complex interaction scenarios, the performance drops significantly. This comparative analysis effectively demonstrates the advantages and disadvantages of the three technical solutions in practical applications, providing an important reference basis for technology selection.

[0135] In the second aspect of the embodiments of the present invention, there is provided a virtual mapping creation system of an intelligent IoT device in the metaverse, including: The first unit is used to receive the device identification information sent by the intelligent IoT device, where the device identification information includes device type information, device location information, and device function parameter information; The second unit is used to determine the initial position of the virtual mapping object in the metaverse virtual space based on the device identification information, and select a virtual mapping model that matches the device type information according to the preset correspondence between the device type and the virtual mapping model, and generate the virtual mapping object of the intelligent IoT device; The third unit is used to construct a multi-level virtual mapping adaptive system, and the multi-level virtual mapping adaptive system includes a physical layer adaptation module and an interaction layer synchronization module, where the physical layer adaptation module is used to realize the consistency mapping of the physical attributes of the virtual mapping object and the real device, and the interaction layer synchronization module is used to ensure the real-time synchronization of the interaction state between the virtual mapping object and the real device through an adaptive compensation algorithm; The fourth unit is used to generate an action sequence according to the output result of the multi-level virtual mapping adaptive system in combination with the metaverse space constraints, and adopts a sphere bounding box algorithm to generate the interaction behavior of the virtual mapping object in the metaverse virtual space.

[0136] In a third aspect of the embodiments of the present invention, an electronic device is provided, including: A processor; A memory for storing instructions executable by the processor; Wherein, the processor is configured to call the instructions stored in the memory to execute the method described above.

[0137] In a fourth aspect of the embodiments of the present invention, a computer-readable storage medium is provided, on which computer program instructions are stored, and when the computer program instructions are executed by a processor, the method described above is implemented.

[0138] The present invention may be a method, apparatus, system, and / or computer program product. The computer program product may include a computer-readable storage medium having computer-readable program instructions thereon for performing various aspects of the present invention.

[0139] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention and are not intended to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions described in the foregoing embodiments, or perform equivalent replacements on some or all of the technical features; and these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. A method for creating a virtual mapping of an intelligent IoT device in a metaverse, characterized in that: include: Receiving device identification information sent by the smart IoT device, wherein the device identification information includes device type information, device location information, and device function parameter information; Based on the device identification information, determine the initialization position of the virtual mapping object in the metaverse virtual space, and select a virtual mapping model that matches the device type information according to the preset correspondence between the device type and the virtual mapping model, and generate a virtual mapping object for the smart IoT device; Constructing a multi-level virtual mapping adaptive system, the multi-level virtual mapping adaptive system includes a physical layer adaptation module and an interactive layer synchronization module, wherein the physical layer adaptation module is used to achieve consistent mapping of physical properties of virtual mapping objects with real devices, and the interactive layer synchronization module is used to ensure real-time synchronization of the interactive states of virtual mapping objects and real devices through an adaptive compensation algorithm; An action sequence is generated according to the output results of the multi-level virtual mapping adaptive system combined with the metaverse space constraints, and a spherical bounding box algorithm is used to generate the interactive behavior of the virtual mapping object in the metaverse virtual space.

2. The method according to claim 1, characterized in that Based on the device identification information, determining the initialization position of the virtual mapping object in the metaverse virtual space, and selecting a virtual mapping model matching the device type information according to a preset correspondence between the device type and the virtual mapping model, and generating the virtual mapping object of the smart IoT device includes: The device position information of the smart IoT device is converted into the initialization position coordinates in the virtual space of the metaverse using a spatial coordinate transformation matrix, wherein the spatial coordinate transformation matrix includes rotation matrix parameters and translation vector parameters; Converting the device type information and the device function parameter information into a device feature vector; Based on the device feature vector, calculating the matching degree between each virtual mapping model in a preset virtual mapping model library and the smart IoT device, wherein the matching degree calculation includes feature vector cosine similarity calculation; The virtual mapping model with the highest matching degree is used as the optimal virtual mapping model to generate a virtual mapping object for the smart IoT device.

3. The method according to claim 2, characterized in that The method further comprises: Determine an attribute set of a virtual mapping object according to the optimal virtual mapping model, wherein the attribute set includes basic attributes, functional attributes, and interactive attributes, wherein the basic attributes include geometric feature parameters and material characteristic parameters, the functional attributes correspond to the device functional parameter information, and the interactive attributes define the interactive mode and interactive capability of the virtual mapping object; A state vector of a virtual mapping object is generated according to the attribute set, the device feature vector and the initialization position coordinates, and a mapping relationship between the state vector and the smart IoT device is established.

4. The method according to claim 1, characterized in that: The physical layer adaptation module is used to achieve consistent mapping between the physical attributes of the virtual mapping object and the real device, including: Performing layered processing on the physical attributes, respectively establishing a geometric feature mapping relationship and a material property mapping relationship, and generating initial physical feature data of a virtual mapping object; Calculating physical feature consistency evaluation data between the virtual mapping object and the real device, wherein the physical feature consistency evaluation data is obtained by weighted calculation of feature differences between the virtual mapping object and the real device in each physical feature dimension; When the physical feature consistency evaluation data exceeds a preset threshold, the physical feature compensation data is calculated based on a gradient descent method, and the physical feature data of the virtual mapping object is dynamically corrected in combination with the historical compensation data; The physical feature data of the virtual mapping object is updated in real time, and when the geometric feature error data and the material characteristic error data are both smaller than the corresponding error thresholds, the physical layer adaptation of the virtual mapping object is completed.

5. The method according to claim 1, characterized in that: The interaction layer synchronization module is used to ensure real-time synchronization of the interaction state between the virtual mapping object and the real device through an adaptive compensation algorithm, including: Calculate the interaction state deviation between the virtual mapping object and the real device in real time, and when the interaction state deviation exceeds a preset deviation threshold, use an adaptive compensation algorithm to dynamically adjust the interaction parameters of the virtual mapping object; The interactive state parameters of the virtual mapping object are updated in real time to synchronize the interactive state of the virtual mapping object with the real device.

6. The method according to claim 1, characterized in that The output results of the multi-level virtual mapping adaptive system are combined with the metaverse space constraints to generate an action sequence, and the spherical bounding box algorithm is used to generate the interactive behavior of the virtual mapping object in the metaverse virtual space, including: Generate an action sequence based on the output results of the multi-level virtual mapping adaptive system combined with the metaverse space constraints; The spherical bounding box method is used to calculate the minimum distance between the virtual mapping object and the surrounding environment. When the minimum distance is less than the preset safety distance, the obstacle avoidance process is triggered, and the interactive feedback force is calculated according to the displacement deviation, speed deviation and contact energy.

7. A virtual mapping creation system for smart IoT devices in the metaverse, used to implement the method as described in any one of claims 1 to 6, characterized in that: include: The first unit is used to receive device identification information sent by the smart IoT device, wherein the device identification information includes device type information, device location information and device function parameter information; The second unit is used to determine the initialization position of the virtual mapping object in the metaverse virtual space based on the device identification information, and select a virtual mapping model matching the device type information according to the preset correspondence between the device type and the virtual mapping model, so as to generate the virtual mapping object of the smart IoT device; The third unit is used to construct a multi-level virtual mapping adaptive system, which includes a physical layer adaptation module and an interactive layer synchronization module, wherein the physical layer adaptation module is used to achieve consistent mapping of physical properties of virtual mapping objects with real devices, and the interactive layer synchronization module is used to ensure real-time synchronization of the interactive state of virtual mapping objects with real devices through an adaptive compensation algorithm; The fourth unit is used to generate an action sequence according to the output results of the multi-level virtual mapping adaptive system combined with the metaverse space constraints, and use a spherical bounding box algorithm to generate the interactive behavior of the virtual mapping object in the metaverse virtual space.

8. An electronic device, characterized in that: include: processor; a memory for storing processor-executable instructions; The processor is configured to call the instructions stored in the memory to execute the method according to any one of claims 1 to 6.

9. A computer-readable storage medium having computer program instructions stored thereon, characterized in that: When the computer program instructions are executed by a processor, the method according to any one of claims 1 to 6 is implemented.

Images