Equipment control method based on object visibility

Abstract

The invention discloses an equipment control method based on object visibility, and relates to the technical field of Internet of Things, and the method comprises the following specific steps: S1, equipment identification: identifying equipment needing to be controlled by a user through an identification assembly; s2, state feedback: acquiring equipment state information in real time, and displaying the equipment state information to a user through a visual interface; s3, user interaction: a user interacts with the visual interface through a touch control or voice command and selects an operation instruction; s4, instruction execution: controlling the equipment to execute corresponding operation according to the user instruction, and updating the equipment state in real time; and S5, intelligent learning: the system learns according to the operation habit of the user, and equipment setting is automatically optimized. According to the device control method based on object visualization, the operation state of the device is monitored through the sensor, and when abnormity is detected, the system automatically pushes an alarm and provides visual troubleshooting guidance.

Description

Technical Field

[0001] The present invention relates to the technical field of Internet of Things, and in particular to a device control method based on object visualization. Background Art

[0002] With the development of Internet of Things technology, more and more devices are connected through the network and realize intelligent control. However, the existing device control methods have the following problems: the user operation is complicated and easy to cause misoperation; there is a lack of intuitive feedback mechanism, and it is difficult for users to understand the device status in real time; the degree of intelligence is insufficient, and the settings cannot be automatically adjusted according to user habits. Therefore, we propose a device control method based on object visibility. Summary of the invention

[0003] The purpose of the present invention is to provide a device control method based on object visualization to solve the problems that the existing device control methods proposed in the above background technology are complex for users to operate and easy to cause misoperation; lack of intuitive feedback mechanism, it is difficult for users to understand the device status in real time; insufficient intelligence, and unable to automatically adjust settings according to user habits.

[0004] To achieve the above objectives, the present invention is implemented through the following technical solutions: a device control method based on object visualization, the specific steps are as follows: S1. Device identification: The device that the user wants to control is identified through the identification component. The identification component scans the environment in real time, determines the device that the user wants to operate in the current scene, and provides basic information for subsequent operations; S2, Status Feedback: Real-time acquisition of device status information, and display to the user through a visual interface. The system acquires the status information of the controlled device in real time, including the current working status, energy consumption, fault information, etc. of the device, and displays it to the user through a visual interface to understand the operating status of the device; S3, User interaction: The user interacts with the visual interface through touch or voice commands and selects operation instructions. The interface provides clear operation options and the user selects the required operation instructions; S4, command execution: According to the user's command, the device is controlled to perform the corresponding operation and the device status is updated in real time. The system sends the control signal to the corresponding device to perform the selected operation. The system updates the device status information in real time and provides corresponding feedback on the visual interface to ensure that the user can see the operation results; S5. Intelligent learning: The system learns based on the user's operating habits and automatically optimizes the device settings. When the user frequently performs certain operations, the system automatically optimizes the device settings to suit the user's preferences.

[0005] Optionally, the recognition component in step S1 is a sensor or a camera.

[0006] Optionally, the status feedback in step S2 includes a sensor module and a display module, the sensor module monitors the operating status of the device in real time, and the display module displays the operating status information of the device in a visual form on an interface.

[0007] Optionally, the user interaction in step S3 includes a touch screen module and a voice recognition module.

[0008] Optionally, the touch screen module is used to receive a touch operation from a user.

[0009] Optionally, the voice recognition module is used to receive a user's voice command.

[0010] Optionally, the instruction execution in step S4 includes a controller module and a network communication module, the controller module controls the running state of the device according to the instruction issued by the user, and the network communication module uploads the running state information of the device to the cloud.

[0011] Optionally, the intelligent learning in step S5 includes a machine learning module and a device setting optimization module, the machine learning module learns according to the user's operating habits, and the device setting optimization module automatically optimizes the device settings according to the results of machine learning.

[0012] Optionally, the device identification in step S1 includes a camera module and a recognition algorithm module, the camera module captures the user's actions, and the recognition algorithm module identifies the device required by the user according to the identified actions.

[0013] The device control method based on object visualization of the present invention has the following advantages: the device control method provides a more intuitive user experience, reduces the difficulty of operation, and improves the intelligent management level of the device; through intuitive device status display and intelligent user interaction mode, the convenience and efficiency of device control are significantly improved; the device operation status is monitored by sensors, and when an abnormality is detected, the system automatically pushes an alarm and provides visual troubleshooting guidance; Through device identification, the device that the artificial intelligence system needs to control can be accurately identified; through status feedback, the operating status of the device can be obtained in real time and displayed to the user on a visual interface; through user interaction, the user can control the device through a touch screen or voice command; through instruction execution, the operating status of the device can be adjusted in real time according to the user's instructions; through intelligent learning, the system can automatically optimize the settings of the device according to the user's operating habits. The implementation of the present invention greatly improves the user's control experience of smart home devices and also reduces the maintenance cost of the system. Through device recognition and an intuitive visual interface, the complexity of user operations is reduced and the possibility of misoperation is reduced; the real-time display of device status enables users to understand the operation of the device at any time, enhancing the user's sense of control; the system's intelligent learning function enables the device to automatically adjust according to user habits, improving the user experience and the intelligence level of the device. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] Figure 1 The figure is a control flow diagram of a device control method based on object visualization according to the present invention. DETAILED DESCRIPTION

[0015] In order to make the purpose, technical scheme and advantages of the present invention clearer, the present invention is further described in detail below in conjunction with the embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention. Unless otherwise specified, the raw materials and equipment selected in the present invention are all commercially available. And all raw materials meet the relevant national health standards.

[0016] The present invention provides a technical solution: a device control method based on object visualization, the specific steps of which are as follows: S1. Device identification: The goal of this step is to identify the device that the user needs to control through the identification component. This step mainly uses the camera module to capture the user's actions, and then the recognition algorithm module determines the device required by the user based on the identified actions. Some pre-set markers, such as stickers or other visual identifiers, are placed at the location where the camera is set to facilitate the algorithm to match the actions. Machine learning technologies such as deep learning are used to train a device identification model to classify different types of actions and identify the corresponding device types. Natural language processing technology is used to convert the user's voice commands into corresponding device action commands and match them with the model to further narrow the recognition range.

[0017] S2, Status Feedback: In this step, we will obtain the operating status information of the equipment in real time and display it to the user through a visual interface. This visual interface can be a touch screen or other forms of interface. We use sensor modules and display modules to achieve real-time monitoring and display of the operating status information of the equipment. The sensor module can be used to monitor the operating status of the equipment in real time, while the display module can display this status information in a graphical way on the interface. Network transmission technology, such as Wi-Fi or Bluetooth, is used to transmit the equipment status information to the cloud server in real time to reduce the delay time. Different data update frequencies are used for different equipment types. For example, for low-frequency equipment, the number of data updates can be reduced, and the equipment can be regularly maintained to ensure its normal working state.

[0018] S3. User interaction: Users can interact with our visual interface through touch or voice to select the operation instructions they want. We can use the touch screen module and the voice recognition module to achieve this user interaction. The touch screen module is responsible for receiving the user's touch operation, while the voice recognition module is responsible for receiving the user's voice command. Through the two interaction methods of touch and voice, users can more conveniently perform device identification and status feedback. It can be combined with gesture recognition, gesture tracking and other technologies to provide a higher level of interaction, such as gesture control, gesture tracking, etc., to further enhance the experience and device usability.

[0019] S4, instruction execution: In this step, we will control the operation status of the device according to the user's instructions. At the same time, we will also update the operation status of the device in real time so that the user can understand the operation status of the device in time. The control process of this step is completed by the controller module. The controller module will adjust the operation status of the device according to the user's instructions. At the same time, the network communication module will upload the operation status information of the device to the cloud so that the user can view it anytime and anywhere.

[0020] S5. Intelligent learning: In our system, we can also learn the user's operating habits and automatically optimize the device settings based on this data. This process mainly relies on our machine learning module. The machine learning module can self-learn and improve according to the user's operating habits to achieve the best device control effect.

[0021] Furthermore, the recognition component in step S1 is a sensor or a camera. The camera captures images and video streams, and performs intelligent visual processing such as target detection and behavior analysis through algorithms. It generates an optical image through a lens and projects it onto an image sensor. The optical signal is then converted into a digital signal. Finally, a digital signal processor is used to operate on these signals to extract the features of the target, thereby completing the classification and recognition of objects in the image.

[0022] Furthermore, the status feedback in step S2 includes a sensor module and a display module. The sensor module monitors the operating status of the equipment in real time, and the display module displays the operating status information of the equipment in a visual form on the interface. The core function of the sensor module is to monitor the operating status of the equipment in real time. By integrating various sensors, such as optical sensors, thermistors, etc., it can obtain various status parameters of the equipment during operation in real time, such as temperature, voltage, current, etc., which are important basis for judging whether the equipment is operating normally. The main function of the display module is to display the equipment operating status information collected by the sensor module in a visual form on the interface, so that the operator can intuitively understand the operating status of the equipment and promptly discover and deal with potential problems.

[0023] Furthermore, the user interaction in step S3 includes a touch screen module and a voice recognition module, wherein the touch screen module is used to receive the user's touch operation, and the voice recognition module is used to receive the user's voice command. The touch screen module allows the user to operate by touching the screen, and realizes intuitive and efficient interaction. It can respond to the user's touch command in real time, and convert the command into a signal recognizable by the system, so as to realize the control of the device. The voice recognition module performs corresponding operations by recognizing the user's voice command, and can accurately convert the user's voice into text, and execute corresponding commands or operations according to the text content. This interaction method is more natural and convenient, and improves the user's experience.

[0024] Furthermore, the instruction execution in step S4 includes a controller module and a network communication module. The controller module controls the operation status of the device according to the instructions issued by the user. The network communication module uploads the operation status information of the device to the cloud. The controller module converts the program instructions into corresponding machine language control signals and transmits them to the corresponding components for execution, including the key steps of instruction fetching, execution, control and interrupt processing. The controller ensures that the various parts of the computer work together to achieve accurate execution of instructions.

[0025] Furthermore, the intelligent learning in step S5 includes a machine learning module and a device setting optimization module. The machine learning module learns according to the user's operating habits, and the device setting optimization module automatically optimizes the device settings according to the results of machine learning. The device setting optimization module monitors and manages the operating status of the device in real time through an intelligent algorithm to achieve efficient operation of the equipment, which includes functions such as equipment fault warning, preventive maintenance, and remote diagnosis, aiming to reduce equipment downtime.

[0026] Furthermore, the device identification in step S1 includes a camera module and a recognition algorithm module, the camera module captures the user's actions, and the recognition algorithm module identifies the device required by the user according to the identified actions.

[0027] Although the present invention is disclosed as above, the present invention is not limited thereto. Any person skilled in the art can make various changes and modifications without departing from the spirit and scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the scope defined by the claims.

Claims

1. A device control method based on object visualization, characterized in that: The specific steps are as follows: S1. Device identification: The device that the user wants to control is identified through the identification component. The identification component scans the environment in real time, determines the device that the user wants to operate in the current scene, and provides basic information for subsequent operations; S2, Status Feedback: Real-time acquisition of device status information, and display to the user through a visual interface. The system acquires the status information of the controlled device in real time, including the current working status, energy consumption, fault information, etc. of the device, and displays it to the user through a visual interface to understand the operating status of the device; S3, User interaction: The user interacts with the visual interface through touch or voice commands and selects operation instructions. The interface provides clear operation options and the user selects the required operation instructions; S4, command execution: According to the user's command, the device is controlled to perform the corresponding operation and the device status is updated in real time. The system sends the control signal to the corresponding device to perform the selected operation. The system updates the device status information in real time and provides corresponding feedback on the visual interface to ensure that the user can see the operation results; S5. Intelligent learning: The system learns based on the user's operating habits and automatically optimizes the device settings. When the user frequently performs certain operations, the system automatically optimizes the device settings to suit the user's preferences.

2. The device control method based on object visualization according to claim 1, characterized in that: The recognition component in step S1 is a sensor or a camera.

3. The device control method based on object visualization according to claim 1, characterized in that: The state feedback in step S2 includes a sensor module and a display module. The sensor module monitors the running state of the device in real time, and the display module displays the running state information of the device in a visual form on the interface.

4. The device control method based on object visualization according to claim 3, characterized in that: The user interaction in step S3 includes a touch screen module and a voice recognition module.

5. The device control method based on object visualization according to claim 4, characterized in that: The touch screen module is used to receive a user's touch operation.

6. The device control method based on object visualization according to claim 4, characterized in that: The voice recognition module is used to receive a user's voice command.

7. The device control method based on object visualization according to claim 1, characterized in that: The instruction execution in step S4 includes a controller module and a network communication module. The controller module controls the operating state of the device according to the instructions issued by the user, and the network communication module uploads the operating state information of the device to the cloud.

8. The device control method based on object visualization according to claim 1, characterized in that: The intelligent learning in step S5 includes a machine learning module and a device setting optimization module. The machine learning module learns according to the user's operating habits, and the device setting optimization module automatically optimizes the device settings according to the results of machine learning.

9. The device control method based on object visualization according to claim 1, characterized in that: The device identification in step S1 includes a camera module and a recognition algorithm module. The camera module captures the user's actions, and the recognition algorithm module identifies the device required by the user based on the identified actions.

Images