Virtual-real binding smart home control system and method

Abstract

The invention discloses a virtual-real binding smart home control system and method. The system comprises a virtual reality creation module, a virtual reality display module, a virtual reality interaction module and a smart home integration module. The virtual reality creating module is used for creating a layout scene of a virtual household appliance; the virtual reality display module is used for reading the layout scene; the virtual reality interaction module is used for binding the virtual household electrical appliances in the layout scene with actual household electrical appliances corresponding to the virtual household electrical appliances; and the smart home integration module is used for controlling the virtual home appliances to execute corresponding actions. The virtual home appliance layout scene is constructed through the virtual reality creation module, and the virtual home appliance and the actual equipment are accurately bound by means of the virtual reality interaction module, so that the home appliance control process is deeply combined with the three-dimensional space operation, and a user can intuitively adjust the equipment layout and operation state in an immersive environment; and a complete closed loop of operation-execution-feedback is formed.

Description

Technical Field

[0001] The present invention relates to the field of smart home technology, and in particular to a virtual-real binding smart home control system and method. Background Art

[0002] With the improvement of living standards and the acceleration of the pace of life, the information society has profoundly changed people's lifestyles, driving the demand for smart home systems to become an increasingly urgent consumer demand. However, existing smart home technologies still face many problems and challenges in their implementation.

[0003] The current system has stringent requirements for the intelligence of home appliances. Users need to make large-scale renovations to their homes or completely replace highly intelligent devices, resulting in high renovation costs. For example, cross-brand devices are difficult to connect directly to each other due to different protocols (such as WiFi, ZigBee, Bluetooth, etc.), and often rely on third-party platforms for transfer, which not only increases system complexity but also drives up integration costs. At the same time, the industry lacks unified interoperability standards. To protect the closed loop of the ecosystem, companies tend to adopt proprietary protocols, exacerbating the problem of device fragmentation. Users are forced to download multiple apps or purchase products from the same brand, further limiting their choice.

[0004] At the same time, traditional smart homes rely on menu-based operations or voice commands, and the interaction method is not intuitive enough. Although existing virtual reality technology attempts to improve the naturalness of control through three-dimensional scenes, there are still bottlenecks in actual application: First, there is a deviation between the virtual model and the actual device parameters, which requires repeated calibration and lacks an automated adjustment mechanism, resulting in a low match between the virtual environment and the physical world; second, VR devices are highly versatile but lack personalization, and cannot adapt to the operating habits of different users, reducing usage efficiency. In addition, VR hardware performance limitations (such as rendering delays and wearing discomfort) and data security risks (such as privacy leaks) also restrict the implementation of the technology.

[0005] Furthermore, in terms of technology integration and ecosystem collaboration, smart homes involve the fusion of multiple technologies, including the Internet of Things, AI, and edge computing. However, existing solutions lack maturity in terms of real-time response (e.g., insufficient computing power for large local models), multimodal interactive collaboration (e.g., voice + gesture linkage), and proactive service capabilities (e.g., scenario prediction). Furthermore, user trust in smart devices is impacted by privacy concerns, further hindering the widespread adoption of this technology.

[0006] Therefore, the development of smart homes urgently needs to break through core obstacles such as high-cost transformation, inefficient interaction, and ecological fragmentation, and achieve a leap from "single-point intelligence" to "full-area collaboration" through technological innovation and standard unification.

[0007] Currently, no effective solutions have been proposed for the problems in related technologies. Summary of the Invention

[0008] In response to the problems in the related art, the present invention proposes a virtual-real binding smart home control system and method to overcome the above-mentioned technical problems existing in the existing related art.

[0009] To this end, the specific technical solutions adopted in the present invention are as follows:

[0010] According to one aspect of the present invention, a virtual-real binding smart home control system is provided, comprising:

[0011] Virtual reality creation module, used to create layout scenes of virtual home appliances;

[0012] A virtual reality display module is used to read the layout scene, perform simulation calculations on the layout scene, and display the simulation results on the VR device;

[0013] The virtual reality interaction module is used to bind the virtual appliances in the layout scene with the actual appliances corresponding to the virtual appliances, and provides a virtual library and an interaction channel between the user command acquisition module and the virtual reality display module;

[0014] The smart home integration module is used to control the virtual home appliances to perform corresponding actions, obtain the working status of the virtual home appliances, send the working status to the virtual reality interaction module, and display it on the VR device;

[0015] Among them, the virtual reality creation module is connected to the virtual reality interaction module through the virtual reality display module, and the virtual reality interaction module is connected to the smart home integration module.

[0016] Furthermore, the virtual reality display module includes:

[0017] The home appliance model reading module is used to select the initial model file of the virtual home appliance and the operating status information of the virtual home appliance from the layout scene;

[0018] The home appliance model adjustment module is used to adjust the parameters of the initial model file read by the model reading module and arrange the home appliance model selected by the user in the 3D house model;

[0019] The home appliance simulation module is used to realize the construction of simulation models by adjusting the parameters of the model file and implementing the virtual reality interaction module.

[0020] Further, adjusting the parameters of the initial model file read by the model reading module, and sending the adjusted model file to the home appliance simulation module;

[0021] Displaying the parameters of the home appliance model file in a list format in the virtual reality display module; wherein the parameters include simulation parameters and simulation conditions;

[0022] Compare the simulation parameters of the initial model file with the actual parameters of the actual home appliance product and record the comparison results;

[0023] Adjust the parameters of the initial model file and obtain the adjusted model file;

[0024] The home appliance model of the adjustment model file selected by the user is received, and the home appliance model selected by the user is arranged in the 3D house model.

[0025] Furthermore, the error comparison formula is as follows:

[0026]

[0027] Where LSB is the maximum value of the difference between the simulated parameters and the ideal parameters, V i is the simulation error of the i-th point, V i+1 is the simulation error of the i+1th point, and || is the absolute value.

[0028] Furthermore, creating a layout scenario for virtual appliances includes:

[0029] Obtain an input image and fuse the input image into a rendered physical virtual model;

[0030] Overlaying the element model to be laid out in the physical virtual model, wherein the element model includes a three-dimensional model of the home appliance product drawn in proportion to the actual size;

[0031] The user's movements are captured by a somatosensory device, and the element model is adjusted according to the posture of the user's movement to obtain a layout scene, and the element model in the layout scene is used as a virtual home appliance in the layout scene;

[0032] The operating status information of home appliances is transmitted to the virtual reality interaction module for storage.

[0033] Furthermore, the smart home integration module includes:

[0034] A user command acquisition module is used to collect user command information and transmit it to the control device;

[0035] The control device is used to analyze the collected command information and generate corresponding instructions to send to the smart home integration module;

[0036] The home appliance control module receives instructions from the control device, controls the virtual home appliances to perform corresponding actions, obtains the current working status of the virtual home appliances, and displays it on the VR device.

[0037] Furthermore, collecting user instruction information and transmitting it to the control device includes:

[0038] Users wear VR devices to read the layout of home appliance models and the operating status information of virtual appliances in the 3D house model;

[0039] Issue adjustment instructions for the layout of home appliance models in the 3D house model, and perform control instructions based on the operating status information of the virtual home appliances;

[0040] Transmit adjustment and control instructions to the control device.

[0041] Furthermore, by wearing VR equipment, users can read the layout of home appliance models and the operating status information of virtual home appliances in the 3D house model, including:

[0042] Add a voice recognition module, a fingerprint recognition module, and a face recognition module to the virtual reality interaction module of the VR device, and record the user's voice information, fingerprint information, and face information;

[0043] If the voice recognition fails three times in a row, the switch's human-computer interaction system enters a self-locking state and sounds an alarm through the alarm light. Voice recognition will be performed again after one hour.

[0044] If fingerprint recognition fails three times in a row, the switch's human-computer interaction system enters a self-locking state and sounds an alarm through the alarm light. Fingerprint recognition will be performed again after two hours.

[0045] After three consecutive facial recognition errors, the switch's human-computer interaction system enters a self-locking state and sounds an alarm through the alarm light, and facial recognition is performed again after three hours.

[0046] Furthermore, analyzing the collected command information and generating corresponding instructions to send to the smart home integration module includes:

[0047] Get the voice commands issued by the user;

[0048] Extract audio features from voice commands;

[0049] Determine whether the audio characteristics match the pre-stored audio characteristics of the user;

[0050] If there is a match, the keywords in the voice command are extracted to obtain the control command issued by the user;

[0051] If there is no match, the voice prompts the user to re-issue the control command until the command is received and stops the voice broadcast;

[0052] The VR device receives control commands from the user and adjusts the models of home appliances in the 3D house model according to the control commands;

[0053] The adjustments include changing the position of the home appliance in the 3D house model, adjusting the operating status of the home appliance, and detecting whether the home appliance has any faults.

[0054] According to another aspect of the present invention, a virtual-real binding smart home control method is provided, the home appliance control method comprising:

[0055] S1. Create a layout scene for virtual home appliances;

[0056] S2. Read the layout scene, perform simulation calculation on the layout scene, and display the simulation results on the VR device;

[0057] S3. Binding the virtual appliances in the layout scene with the actual appliances corresponding to the virtual appliances, providing a virtual library and an interaction channel between the user instruction acquisition module and the virtual reality display module;

[0058] S4. Control the virtual home appliance to perform corresponding actions, obtain the working status of the virtual home appliance, send the working status to the virtual reality interaction module, and display it in the VR device.

[0059] The beneficial effects of the present invention are:

[0060] 1. Build virtual home appliance layout scenarios through the VR creation module, and precisely bind virtual appliances to actual devices with the help of the VR interaction module, deeply integrating the appliance control process with three-dimensional spatial operations. Users can intuitively adjust device layout and operating status in an immersive environment. The smart home integration module simultaneously obtains the working status of actual devices and feeds back to the VR display module, forming a complete closed loop of "operation-execution-feedback", significantly lowering the cognitive threshold of traditional menu-based control. At the same time, the VR interaction module provides multi-modal authentication mechanisms such as voice, fingerprint, and face recognition to ensure operational security and avoid the risk of unauthorized operation, thus achieving immersive, intuitive, and secure smart home control as a whole.

[0061] 2. To address the parameter deviation problem between the virtual model and the actual home appliance, the appliance model adjustment module in the virtual reality display module is used to compare and dynamically adjust the parameter errors of the initial model file. That is, the difference between the simulation parameters and the actual parameters is calculated through the error comparison formula and visualized in the form of a parameter list. Users can manually or automatically calibrate the model parameters based on the error results. The calibrated model file is integrated with the 3D house scene to ensure that the device status in the virtual scene is synchronized with the actual device, solving the problem of control command failure caused by model distortion in traditional VR systems and improving the reliability of virtual-reality mapping.

[0062] 3. A triple biometric authentication mechanism, comprising voice recognition, fingerprint recognition, and facial recognition, is integrated into the VR interaction module, and a hierarchical self-locking strategy is implemented: three consecutive errors in any verification method will trigger system lockout, accompanied by an alarm light warning. Different verification methods have corresponding differentiated unlocking wait times, effectively preventing the risk of device miscontrol caused by malicious hacking or misoperation. Furthermore, voice commands extract pre-stored user audio features for matching. If a match fails, the user is prompted to re-enter the command in real time until the command is legally received, thus avoiding false triggering caused by non-users or environmental noise and enhancing system security in sensitive operating scenarios. BRIEF DESCRIPTION OF THE DRAWINGS

[0063] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0064] Figure 1 This is a principle block diagram of a virtual-real binding smart home control system according to an embodiment of the present invention.

[0065] In the picture:

[0066] 1. Virtual reality creation module; 2. Virtual reality display module; 3. Virtual reality interaction module; 4. Smart home integration module. DETAILED DESCRIPTION

[0067] To further illustrate each embodiment, the present invention provides drawings, which are part of the disclosure of the present invention. They are mainly used to illustrate the embodiments and can be used in conjunction with the relevant descriptions in the specification to explain the operating principles of the embodiments. By referring to these contents, ordinary technicians in this field should be able to understand other possible implementation methods and advantages of the present invention. The components in the figures are not drawn to scale, and similar component symbols are generally used to represent similar components.

[0068] According to an embodiment of the present invention, a virtual-real binding smart home control system and method are provided.

[0069] The present invention will now be further described with reference to the accompanying drawings and specific embodiments. Figure 1 As shown, the virtual-reality binding smart home control system according to an embodiment of the present invention includes a virtual reality creation module 1, a virtual reality display module 2, a virtual reality interaction module 3 and a smart home integration module 4;

[0070] The virtual reality creation module 1 is connected to the virtual reality interaction module 3 through the virtual reality display module 2, and the virtual reality interaction module 3 is connected to the smart home integration module 4;

[0071] Virtual reality creation module 1, used to create a layout scene of virtual home appliances;

[0072] In one embodiment, creating a layout scenario of a virtual appliance includes:

[0073] Obtain an input image and fuse the input image into a rendered physical virtual model;

[0074] Overlaying the element model to be laid out in the physical virtual model, wherein the element model includes a three-dimensional model of the home appliance product drawn in proportion to the actual size;

[0075] The user's movements are captured by a somatosensory device, and the element model is adjusted according to the user's posture to obtain a layout scene, and the element model in the layout scene is used as a virtual home appliance in the layout scene;

[0076] The operating status information of home appliances is transmitted to the virtual reality interaction module for storage.

[0077] In specific applications, VR uses computer simulation to create a three-dimensional virtual world, providing users with simulation of visual and other senses, allowing users to feel immersed in the world and observe things in the three-dimensional space instantly and without restrictions. The virtual reality modeling in this invention uses the existing CAD software to perform three-dimensional modeling of mechanical systems, and converts them through the conversion interface between CAD software and the virtual reality modeling language VRML, and can directly or indirectly convert them into VRML format files.

[0078] The virtual reality display module 2 is used to read the layout scene, perform simulation calculations on the layout scene, and display the simulation results on the VR device;

[0079] In specific applications, VR devices include VR gloves and VR helmets. VR gloves can be configured to capture user movements, allowing the user to interact with virtual images output by the VR helmet. VR gloves can be sensing devices that capture user movements using inertial sensing, optical sensing, tactile sensing, or a combination thereof.

[0080] In one embodiment, the virtual reality display module includes a home appliance model reading module, a home appliance model adjustment module, and a home appliance simulation module;

[0081] The home appliance model reading module is used to select the initial model file of the virtual home appliance and the operating status information of the virtual home appliance from the layout scene;

[0082] In specific applications, the characteristic information of each virtual home appliance is input into the modeling tool to obtain the simulation analysis results, the relevant range is determined by calculating the weighted moving average, and the initialized virtual home appliance is obtained.

[0083] Improve data based on the initialized virtual appliance model range and establish a curve model to determine data trends;

[0084] Calculate the elasticity change value according to the curve and calculate the elasticity range of change;

[0085] Virtual home appliance analysis data after data simulation based on the transformation elastic range;

[0086] Calculate the hysteresis of virtual home appliance simulation data and output the final 3D scene of virtual home appliances;

[0087] The formula for calculating the weighted moving average is:

[0088] Q=eQ n +e(1-e)Q n-1 +e(1-e) 2 Q n-2 +…

[0089] Where Q represents the weighted moving average, n represents the number of input data, Qn represents the input data, e is the weight, and e=1 / n;

[0090] The calculation formula of elastic change value is:

[0091]

[0092] In the formula, T represents the elastic change value, Q represents the weighted moving average, and i represents the average value of the two endpoints of the difference interval.

[0093] The home appliance model adjustment module is used to adjust the parameters of the initial model file read by the model reading module and arrange the home appliance model selected by the user in the 3D house model;

[0094] The home appliance simulation module is used to build a simulation model by adjusting the parameters of the model file to realize the virtual reality interaction module;

[0095] In one embodiment, the parameters of the initial model file read by the model reading module are adjusted, and the adjusted model file is sent to the home appliance simulation module;

[0096] Displaying the parameters of the home appliance model file in a list format in the virtual reality display module; wherein the parameters include simulation parameters and simulation conditions;

[0097] Compare the simulation parameters of the initial model file with the actual parameters of the actual home appliance product and record the comparison results;

[0098] Adjust the parameters of the initial model file and obtain the adjusted model file;

[0099] The home appliance model of the adjustment model file selected by the user is received, and the home appliance model selected by the user is arranged in the 3D house model.

[0100] In one embodiment, the error comparison formula is as follows:

[0101]

[0102] Where LSB is the maximum value of the difference between the simulated parameters and the ideal parameters, V i is the simulation error of the i-th point, V i+1 is the simulation error of the i+1th point, and || is the absolute value.

[0103] The virtual reality interaction module 3 is used to bind the virtual appliances in the layout scene with the actual appliances corresponding to the virtual appliances, and provide a virtual library and an interaction channel between the user command acquisition module and the virtual reality display module;

[0104] The smart home integration module 4 is used to control the virtual home appliances to perform corresponding actions, obtain the working status of the virtual home appliances, send the working status to the virtual reality interaction module, and display it in the VR device.

[0105] In one embodiment, the smart home integration module includes a user command acquisition module, a control device, and a home appliance control module;

[0106] A user command acquisition module is used to collect user command information and transmit it to the control device;

[0107] The control device is used to analyze the collected command information and generate corresponding instructions to send to the smart home integration module;

[0108] The home appliance control module receives instructions from the control device, controls the virtual home appliances to perform corresponding actions, obtains the current working status of the virtual home appliances, and displays it on the VR device.

[0109] In one embodiment, collecting user instruction information and transmitting it to the control device includes:

[0110] Users wear VR devices to read the layout of home appliance models and the operating status information of virtual appliances in the 3D house model;

[0111] Issue adjustment instructions for the layout of home appliance models in the 3D house model, and perform control instructions based on the operating status information of the virtual home appliances;

[0112] Transmit adjustment and control instructions to the control device.

[0113] In one embodiment, a user wearing a VR device reads the layout of the home appliance model and the operating status information of the virtual home appliances in the 3D house model, including:

[0114] Add a voice recognition module, a fingerprint recognition module, and a face recognition module to the virtual reality interaction module of the VR device, and record the user's voice information, fingerprint information, and face information;

[0115] If the voice recognition fails three times in a row, the switch's human-computer interaction system enters a self-locking state and sounds an alarm through the alarm light. Voice recognition will be performed again after one hour.

[0116] If fingerprint recognition fails three times in a row, the switch's human-computer interaction system will enter a self-locking state and sound an alarm through the alarm light. Fingerprint recognition will be performed again after two hours.

[0117] After three consecutive facial recognition errors, the switch's human-computer interaction system enters a self-locking state and sounds an alarm through the alarm light, and facial recognition is performed again after three hours.

[0118] In one embodiment, analyzing the collected command information and generating corresponding instructions to send to the smart home integration module includes:

[0119] Get the voice commands issued by the user;

[0120] Extract audio features from voice commands;

[0121] Determine whether the audio characteristics match the pre-stored audio characteristics of the user;

[0122] If there is a match, the keywords in the voice command are extracted to obtain the control command issued by the user;

[0123] If there is no match, the voice prompts the user to re-issue the control command until the command is received and stops the voice broadcast;

[0124] The VR device receives control commands from the user and adjusts the models of home appliances in the 3D house model according to the control commands;

[0125] The adjustments include changing the position of the home appliance in the 3D house model, adjusting the operating status of the home appliance, and detecting whether the home appliance has any faults.

[0126] According to another embodiment of the present invention, a virtual-real binding smart home control method is provided, and the home appliance control method includes:

[0127] S1. Create a layout scene for virtual home appliances;

[0128] S2. Read the layout scene, perform simulation calculation on the layout scene, and display the simulation results on the VR device;

[0129] S3. Binding the virtual appliances in the layout scene with the actual appliances corresponding to the virtual appliances, providing a virtual library and an interaction channel between the user instruction acquisition module and the virtual reality display module;

[0130] S4. Control the virtual home appliance to perform corresponding actions, obtain the working status of the virtual home appliance, send the working status to the virtual reality interaction module, and display it in the VR device.

[0131] To sum up, with the help of the above technical solutions of the present invention, a virtual home appliance layout scene is constructed through the virtual reality creation module, and the virtual home appliances are accurately bound to the actual devices with the help of the virtual reality interaction module, so that the home appliance control process is deeply integrated with the three-dimensional space operation, and the user can intuitively adjust the device layout and operating status in an immersive environment; the smart home integration module synchronously obtains the working status of the actual device and feeds back to the virtual reality display module, forming a complete closed loop of "operation-execution-feedback", which greatly reduces the cognitive threshold of traditional menu-based control; at the same time, the virtual reality interaction module provides multi-modal identity authentication mechanisms such as voice, fingerprint, and face to ensure operational security and avoid the risk of unauthorized operation, thereby realizing the immersive, intuitive and secure smart home control as a whole. To address the issue of parameter deviations between the virtual model and actual appliance parameters, the appliance model adjustment module within the VR display module performs parameter error comparison and dynamic adjustment on the initial model file. This error comparison formula calculates the extreme differences between the simulated and actual parameters and displays them visually as a parameter list. Users can manually or automatically calibrate the model parameters based on the error results. The calibrated model file is integrated with the 3D house scene to ensure that device states in the virtual scene are synchronized with the actual devices. This addresses the issue of control command failure caused by model distortion in traditional VR systems and improves the reliability of virtual-reality mapping. A triple biometric authentication mechanism, including voice recognition, fingerprint recognition, and facial recognition, is integrated into the VR interaction module, along with a hierarchical self-locking strategy: three consecutive authentication errors in any one authentication method trigger a system lock, accompanied by an alarm light. Different authentication methods have different unlocking wait times, effectively preventing the risk of device miscontrol caused by malicious hacking or misoperation. Furthermore, voice commands are matched against pre-stored user audio features. If a match fails, the user is prompted to re-enter the command in real time until it is legitimately received. This prevents false triggering caused by non-users or ambient noise, enhancing system security in sensitive operating scenarios.

[0132] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the scope of protection of the present invention.

Claims

1. A virtual-real binding smart home control system, the system comprising: Virtual reality creation module, used to create layout scenes of virtual home appliances; A virtual reality display module is used to read the layout scene, perform simulation calculations on the layout scene, and display the simulation results on the VR device; The virtual reality interaction module is used to bind the virtual appliances in the layout scene with the actual appliances corresponding to the virtual appliances, and provides a virtual library and an interaction channel between the user command acquisition module and the virtual reality display module; The smart home integration module is used to control the virtual home appliances to perform corresponding actions, obtain the working status of the virtual home appliances, send the working status to the virtual reality interaction module, and display it on the VR device; Among them, the virtual reality creation module is connected to the virtual reality interaction module through the virtual reality display module, and the virtual reality interaction module is connected to the smart home integration module.

2. A virtual-real binding smart home control system according to claim 1, characterized in that: The virtual reality display module includes: The home appliance model reading module is used to select the initial model file of the virtual home appliance and the operating status information of the virtual home appliance from the layout scene; The home appliance model adjustment module is used to adjust the parameters of the initial model file read by the model reading module and arrange the home appliance model selected by the user in the 3D house model; The home appliance simulation module is used to realize the construction of simulation models by adjusting the parameters of the model file and implementing the virtual reality interaction module.

3. A virtual-real binding smart home control system according to claim 2, characterized in that: The initial model file read by the model reading module is adjusted in parameters, and the adjusted model file is sent to the home appliance simulation module; Display the parameters of the home appliance model file in a list format in the virtual reality display module; Among them, the parameters include simulation parameters and simulation conditions; Compare the simulation parameters of the initial model file with the actual parameters of the actual home appliance product and record the comparison results; Adjust the parameters of the initial model file and obtain the adjusted model file; The home appliance model of the adjustment model file selected by the user is received, and the home appliance model selected by the user is arranged in the 3D house model.

4. The virtual-real binding smart home control system according to claim 3, characterized in that: The error comparison formula is as follows: Where LSB is the maximum value of the difference between the simulated parameters and the ideal parameters, V i is the simulation error of the i-th point, V i+1 is the simulation error of the i+1th point, and || is the absolute value.

5. The virtual-real binding smart home control system according to claim 1, characterized in that: The layout scenario of creating a virtual appliance includes: Obtain an input image and fuse the input image into a rendered physical virtual model; Overlaying the element model to be laid out in the physical virtual model, wherein the element model includes a three-dimensional model of the home appliance product drawn in proportion to the actual size; The user's movements are captured by a somatosensory device, and the element model is adjusted according to the user's posture to obtain a layout scene, and the element model in the layout scene is used as a virtual home appliance in the layout scene; The operating status information of home appliances is transmitted to the virtual reality interaction module for storage.

6. The virtual-real binding smart home control system according to claim 1, characterized in that: The smart home integration module includes: A user command acquisition module is used to collect user command information and transmit it to the control device; Control device, used to analyze the collected command information and generate corresponding instructions to send to the smart home integration module; The home appliance control module receives instructions from the control device, controls the virtual home appliances to perform corresponding actions, obtains the current working status of the virtual home appliances, and displays it on the VR device.

7. The virtual-real binding smart home control system according to claim 6, characterized in that: The analyzing and collecting command information and generating corresponding instructions to send to the smart home integration module includes: Get the voice commands issued by the user; Extracting audio features from the voice command; Determining whether the audio feature matches a pre-stored user's audio feature; If there is a match, extract the keywords in the voice command to obtain the control command issued by the user; If there is no match, the voice prompts the user to re-issue the control command until the command is received and stops the voice broadcast; The VR device receives control commands from the user and adjusts the models of home appliances in the 3D house model according to the control commands; The adjustments include changing the position of the home appliance in the 3D house model, adjusting the operating status of the home appliance, and detecting whether the home appliance has any faults.

8. The virtual-real binding smart home control system according to claim 6, characterized in that: The collecting of user instruction information and transmitting it to the control device includes: Users wear VR devices to read the layout of home appliance models and the operating status information of virtual appliances in the 3D house model; Issue adjustment instructions for the layout of home appliance models in the 3D house model, and perform control instructions based on the operating status information of the virtual home appliances; Transmit adjustment and control instructions to the control device.

9. The virtual-real binding smart home control system according to claim 8, characterized in that: The user wears a VR device to read the layout of the home appliance model and the operating status information of the virtual home appliances in the 3D house model, including: Add a voice recognition module, a fingerprint recognition module, and a face recognition module to the virtual reality interaction module of the VR device, and record the user's voice information, fingerprint information, and face information; If the voice recognition fails three times in a row, the switch's human-computer interaction system enters a self-locking state and sounds an alarm through the alarm light. Voice recognition will be performed again after one hour. If fingerprint recognition fails three times in a row, the switch's human-computer interaction system enters a self-locking state and sounds an alarm through the alarm light. Fingerprint recognition will be performed again after two hours. After three consecutive facial recognition errors, the switch's human-computer interaction system enters a self-locking state and sounds an alarm through the alarm light, and facial recognition is performed again after three hours.

10. A virtual-real binding smart home control method, using the virtual-real binding smart home control system according to any one of claims 1 to 9, characterized in that: It is characterized in that The method includes: S1. Create a layout scene for virtual home appliances; S2. Read the layout scene, perform simulation calculation on the layout scene, and display the simulation results on the VR device; S3. Binding the virtual appliances in the layout scene with the actual appliances corresponding to the virtual appliances, providing a virtual library and an interaction channel between the user instruction acquisition module and the virtual reality display module; S4. Control the virtual home appliance to perform corresponding actions, obtain the working status of the virtual home appliance, send the working status to the virtual reality interaction module, and display it in the VR device.

Images