Distribution network guiding method, device and equipment for home equipment and storage medium

Abstract

The embodiment of the invention provides a home equipment distribution network guiding method and device, equipment and a storage medium, and the method comprises the steps: obtaining and displaying a real scene picture of a house; determining home equipment in the live-action picture, and obtaining distribution network guidance information of the home equipment; and the AR technology is utilized to combine and display the distribution network guidance information of the home equipment in the real scene picture, wherein the distribution network guidance information is used for guiding the distribution network personnel to complete the distribution network of the home equipment. The network distribution guidance information of the home equipment is displayed in the live-action picture through the AR augmented reality technology, network distribution personnel are helped to complete network distribution of the home equipment, and the equipment management and network distribution efficiency can be remarkably improved.

Description

Technical Field

[0001] The present invention relates to the technical field of network configuration guidance for home appliances, and particularly to a method for guiding network configuration of home appliances, a device for guiding network configuration of home appliances, an electronic device, and a computer-readable storage medium. Background Art

[0002] Today, with the increasing popularity of smart home and Internet of Things (IoT) devices, device management and network configuration (hereinafter referred to as network configuration) have become an indispensable part of users' daily lives. However, traditionally, the device management and network configuration processes have heavily relied on paper manuals and on-site technicians' manual guidance, and this mode has several obvious limitations.

[0003] First of all, paper manuals are not only prone to being lost or damaged during long-term use, but also inconvenient to update, resulting in information often lagging behind and unable to timely reflect the latest device status or operation guides. This not only reduces the user experience, but may also lead to incorrect operations due to misleading information, thereby affecting the device performance and even causing hardware failures.

[0004] Secondly, the process of relying on manual guidance for device management and network configuration is inefficient. Whether for first-time users or users with certain experience, understanding complex device installation steps and technical parameters is a challenge. In addition, the quality of manual guidance highly depends on the professional knowledge level and communication skills of the guiding personnel, increasing the risk of human errors. Especially in the case of rapid deployment and debugging of a large number of devices, this method obviously cannot meet the requirements of modern efficient work processes. Summary of the Invention

[0005] In view of the above problems, embodiments of the present invention are proposed to provide a method for guiding network configuration of home appliances, a device for guiding network configuration of home appliances, an electronic device, and a corresponding computer-readable storage medium that overcome the above problems or at least partially solve the above problems.

[0006] To solve the above problems, embodiments of the present invention disclose a method for guiding network configuration of home appliances, including:

[0007] Obtaining and displaying a real scene picture of a house;

[0008] Determining home appliances in the real scene picture and obtaining network configuration guidance information of the home appliances;

[0009] Displaying the network configuration guidance information of the home appliances in the real scene picture, where the network configuration guidance information is used to guide network configuration personnel to complete the network configuration of the home appliances.

[0010] Optionally, it further includes:

[0011] At the position corresponding to the home device in the real scene image, display a device card of the home device, where the device card includes device information;

[0012] Displaying the network configuration guidance information of the home device in the real scene image includes:

[0013] In response to a user operation on the device card of the target home device, display the network configuration guidance information of the target home device in the real scene image.

[0014] Optionally, it further includes:

[0015] Display a device management control in the real scene image, and display the number of home devices in the current real scene image in the device management control;

[0016] Displaying the network configuration guidance information of the home device in the real scene image includes:

[0017] In response to a user operation on the device management control, display a device list in the device management control; the device list includes the network configuration guidance information of the home devices in the real scene image.

[0018] Optionally, displaying the network configuration guidance information of the home device in the real scene image includes:

[0019] In response to a user voice, determine the target home device corresponding to the user voice, and display the network configuration guidance information of the target home device in the real scene image.

[0020] Optionally, displaying the network configuration guidance information of the home device in the real scene image includes:

[0021] In response to a user gesture, determine the target home device pointed to by the user gesture, and display the network configuration guidance information of the target home device in the real scene image.

[0022] Optionally, it further includes:

[0023] Determine the actual position of the home device in the real scene image;

[0024] Determine the navigation information from the current shooting position to the actual position of the home device;

[0025] Display the navigation information in the real scene image.

[0026] Optionally, the navigation information includes the distance from the current shooting position to the actual position of the home device, and / or the navigation route from the current shooting position to the actual position of the home device.

[0027] Optionally, determining the home appliances in the real scene picture includes:

[0028] Determining the appearance features of the home appliances in the real scene picture;

[0029] Matching the appearance features of the home appliances with the appearance features in the preset feature database;

[0030] Determining the home appliances in the real scene picture according to the matching result.

[0031] Optionally, it further includes: displaying the network connection status of the home appliances in the real scene picture.

[0032] In a second aspect, an embodiment of the present invention provides a network configuration guiding device for home appliances, including:

[0033] An acquisition module, configured to acquire and display a real scene picture of a house;

[0034] A first determination module, configured to determine the home appliances in the real scene picture and acquire the network configuration guiding information of the home appliances;

[0035] A first display module, configured to display the network configuration guiding information of the home appliances in the real scene picture, where the network configuration guiding information is used to guide a network configuration personnel to complete the network configuration of the home appliances.

[0036] Optionally, it further includes:

[0037] A second display module, configured to display a device card of the home appliances at a position corresponding to the home appliances in the real scene picture, where the device card includes device information;

[0038] The first display module includes:

[0039] A first display sub-module, configured to display the network configuration guiding information of the target home appliances in the real scene picture in response to a user operation on the device card of the target home appliances.

[0040] Optionally, it further includes:

[0041] A third display module, configured to display a device management control in the real scene picture and display the number of home appliances in the current real scene picture in the device management control;

[0042] The first display module includes:

[0043] A second display sub-module, configured to display a device list in the device management control in response to a user operation on the device management control; the device list includes the network configuration guiding information of the home appliances in the real scene picture.

[0044] Optionally, the first display module includes:

[0045] A third display sub-module, configured to determine a target home device corresponding to the user voice in response to the user voice, and display network configuration guidance information of the target home device in the real scene picture.

[0046] Optionally, the first display module includes:

[0047] A fourth display sub-module, configured to determine a target home device pointed to by the user gesture in response to the user gesture, and display network configuration guidance information of the target home device in the real scene picture.

[0048] Optionally, it further includes:

[0049] A second determination module, configured to determine the actual position of the home device in the real scene picture;

[0050] A third determination module, configured to determine navigation information from the current shooting position to the actual position of the home device;

[0051] A fourth display module, configured to display the navigation information in the real scene picture.

[0052] Optionally, the navigation information includes the distance from the current shooting position to the actual position of the home device, and / or the navigation route from the current shooting position to the actual position of the home device.

[0053] Optionally, the first determination module includes:

[0054] A first determination sub-module, configured to determine the appearance feature of the home device in the real scene picture;

[0055] A matching sub-module, configured to match the appearance feature of the home device with the appearance features in a preset feature database;

[0056] A second determination sub-module, configured to determine the home device in the real scene picture according to the matching result.

[0057] In a third aspect, an embodiment of the present invention provides an electronic device, including: a processor, a memory, and a computer program stored on the memory and capable of running on the processor, where when the computer program is executed by the processor, the steps of the above-mentioned network configuration guidance method for home devices are implemented.

[0058] In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the steps of the above-mentioned network configuration guidance method for home devices are implemented.

[0059] The embodiments of the present invention have the following advantages:

[0060] The embodiments of the present invention provide a method for guiding network configuration of home appliances, including: obtaining and displaying a real scene picture of a house; determining home appliances in the real scene picture and obtaining network configuration guiding information of the home appliances; using AR (Augmented Reality) technology to combine and display the network configuration guiding information of the home appliances in the real scene picture, where the network configuration guiding information is used to guide network configuration personnel to complete the network configuration of the home appliances. By using AR technology to display the network configuration guiding information of home appliances in the real scene picture to help network configuration personnel complete the network configuration of home appliances, the efficiency of device management and network configuration can be significantly improved. Description of the Drawings

[0061] Figure 1 is a flowchart of steps of a method for guiding network configuration of home appliances provided by an embodiment of the present invention;

[0062] Figure 2 is a scanning schematic diagram of scanning a real scene picture of a method for guiding network configuration of home appliances provided by an embodiment of the present invention;

[0063] Figure 3 is a flowchart of steps of another method for guiding network configuration of home appliances provided by an embodiment of the present invention;

[0064] Figure 4 is a schematic diagram of an equipment information card and a device list of a method for guiding network configuration of home appliances provided by an embodiment of the present invention;

[0065] Figure 5 is a schematic diagram of an interaction instruction of a method for guiding network configuration of home appliances provided by an embodiment of the present invention;

[0066] Figure 6 is a schematic diagram of real scene picture navigation information of a method for guiding network configuration of home appliances provided by an embodiment of the present invention;

[0067] Figure 7 is a schematic diagram of the device state of a method for guiding network configuration of home appliances provided by an embodiment of the present invention;

[0068] Figure 8 is a block diagram of the structure of a device for guiding network configuration of home appliances provided by an embodiment of the present invention. Detailed Embodiments

[0069] To make the above objects, features, and advantages of the present invention more obvious and understandable, the present invention will be further described in detail below with reference to the drawings and specific embodiments.

[0070] One of the core concepts of the embodiments of the present invention is to consider using assembly software with Augmented Reality (AR) technology to assist workers in solving problems faced by installation and maintenance workers during the device configuration process, such as missing device connections, complex scenario processes, and a large number of devices. By using advanced computer vision and sensor technologies, accurate identification, information display, and path planning of devices in the home decoration environment can be achieved, thereby significantly improving the efficiency and accuracy of the assembly work.

[0071] Referring to Figure 1 , a step flowchart of a network configuration guiding method for a home device provided by an embodiment of the present invention is shown. The method may specifically include the following steps:

[0072] Step 101, obtain and display the real scene picture of the house;

[0073] In recent years, with the development of Augmented Reality (AR) technology, new possibilities have been brought to the home decoration industry. AR real-time recognition technology is a technology that uses computer vision and sensor technologies to achieve real-time recognition and display of virtual information in the real environment. Specifically, this technology captures environmental images through a camera, uses image processing algorithms to identify specific objects, and superimposes virtual information such as device information and operation guides on these objects. Its applications in multiple fields are becoming increasingly widespread. By using technical means to enhance the user's perception and experience of the real world. This technology is not limited to visual enhancement and may also include enhancements of multiple sensory experiences such as hearing and touch. By superimposing virtual information onto the real world, AR technology enables users to more intuitively feel the actual effects of the design scheme in the home decoration environment, thereby improving the accuracy of the design and customer satisfaction.

[0074] Referring to Figure 2 , a scanning schematic diagram of the real scene picture for a network configuration guiding method for a home device provided by an embodiment of the present invention is shown. In this embodiment, the present invention can be applied to a mobile terminal, and a corresponding AR-assisted APP software is installed in the application terminal to use this method of AR augmented reality technology. Use the camera to scan the house to capture the real scene picture of the house, and display the real scene picture in the APP software of the mobile terminal. The camera can be the built-in camera of a smart phone, a tablet computer, or a dedicated AR device. Select scanning in the real scene picture displayed on the AR software page, and the real scene picture of the house can be scanned and displayed on the software page, and a digital map of the real scene picture can be generated. The advantage of the digital map is that it can clearly display the spatial structure and spatial relationship of the complex world.

[0075] In other embodiments, other scanning devices may also be used for scanning, and the present invention does not limit this.

[0076] It should be noted that the scanning information obtained by scanning the house is acquired with the knowledge and consent of the house owner and is only used to assist the installer in network configuration for the devices.

[0077] Step 102: Identify the home devices in the real scene picture and obtain the network configuration guidance information for the home devices.

[0078] While using the camera to scan the house to generate a real scene picture, all the home devices to be connected in the house are identified, and at the same time, the network configuration guidance information can be obtained from the home devices to be connected. Home devices that need network configuration (network connection) usually refer to those smart home devices that can be connected to the Internet so that they can be remotely controlled and monitored via a smartphone, tablet or other network terminals. With the development of the Internet of Things (IoT) technology, more and more household devices can be used online, providing users with a more convenient and intelligent living experience.

[0079] Home devices can include, for example, smart TVs, audio systems, smart sockets, smart thermostats, smart security devices, projectors, health and fitness devices, smart curtains and awnings, pet care devices, and smart lighting control, etc.; To ensure the normal operation of these devices, network configuration usually needs to be completed according to the guidelines provided by the manufacturer, which may involve connecting to Wi-Fi, entering network credentials, downloading the corresponding application, and in some cases integrating with other smart home platforms. The network configuration information for home devices can include device connection tutorials.

[0080] Step 103: Display the network configuration guidance information for the home devices in the real scene picture, and the network configuration guidance information is used to guide the network configurator to complete the network configuration of the home devices.

[0081] Home device network configuration usually refers to the process of connecting smart home devices to the home wireless network (Wi-Fi) so that these devices can communicate with the Internet to achieve functions such as remote control and automated scene setting.

[0082] Its main functions include: remote control. Once the device is successfully connected to the network, users can remotely monitor and control these home devices through smartphones, tablets or other networked devices; automated scenario setting. After being connected to the network, home devices can be linked with other smart devices to achieve automated operations; data synchronization and analysis. Networked devices can upload operation data to the cloud for data analysis; software update. Internet connection enables device manufacturers to push software updates through the network to fix known vulnerabilities, add new functions and enhance the user experience; enhanced security. Some security devices (such as smart doorbells, security cameras, etc.) need to be connected to the network to achieve the maximum security protection effect; energy management. Through networking, smart meters and other energy management devices can help users better monitor and manage household energy consumption, improve energy efficiency and reduce electricity bills.

[0083] The network configuration of home devices not only makes daily life more convenient and comfortable, but also helps to improve the security and energy utilization efficiency of the home. With the development of Internet of Things technology, the functions and services of networked devices are constantly expanding and improving.

[0084] In some embodiments of the present invention, considering the problems faced by home decoration equipment network configuration workers during the equipment configuration process, such as missing device connections, complex scenario processes, and a large number of devices, it is considered to use AR augmented reality technology to directly display the network configuration guidance information of home devices in the real scene to assist the workers.

[0085] In some other embodiments of the present invention, assembly workers need to configure multiple smart security cameras and sensors in a large villa. The villa has a large area and the devices are widely distributed. Workers need to manually record the location of each device, which is easy to miss or confuse. As a result, the device network configuration location is inaccurate, leading to difficulties in subsequent debugging and maintenance. Using the software of the AR augmented reality method of this solution, the location and status of the devices can be displayed in real time. Open the software, select the "device location" function, and use the camera to scan the interior of the villa. The software automatically identifies and marks the locations of all networked devices. In the real scene view, each device has clear network configuration guidance information. You can click on any device to view detailed device information, and the device location is clear at a glance, achieving the purpose of quickly and accurately completing the network configuration and debugging work.

[0086] The embodiments of the present invention provide a method for guiding the network configuration of home devices, including obtaining and displaying the real scene picture of the house; determining the home devices in the real scene picture and obtaining the network configuration guidance information of the home devices; using AR augmented reality technology to combine and display the network configuration guidance information of the home devices in the real scene picture, and the network configuration guidance information is used to guide the network configuration personnel to complete the network configuration of the home devices. By using AR augmented reality technology to display the network configuration guidance information of home devices in the real scene to help the network configuration personnel complete the network configuration of home devices, the efficiency of device management and network configuration can be significantly improved.

[0087] Refer to Figure 3 , which shows the step flowchart of another method for guiding network configuration of a home device provided by an embodiment of the present invention. The method may specifically include the following steps:

[0088] Step 301, obtain and display the real scene picture of the house;

[0089] Step 302, determine the home device in the real scene picture, and obtain the network configuration guidance information of the home device;

[0090] In the field of informatization, image recognition is a technology that uses a computer to process, analyze, and understand images to identify various different patterns of targets and objects. For example: In geography, it refers to the technology of classifying remote sensing images. The key information of image recognition technology should include both the information that enters the senses (i.e., the computer system) at that time and the information stored in the system. Only through the processing process of comparing the stored information with the current information can the recognition of the image be realized.

[0091] In some embodiments of the present invention, the image recognition technology and image matching technology in the AR software are required to detect the device status.

[0092] In some embodiments, the step 302 specifically includes the following sub-steps:

[0093] Sub-step S11, determine the appearance characteristics of the home device in the real scene picture;

[0094] In this embodiment, it is the device feature recognition and information association. First, image feature matching and comparison with the reference library: The AR software captures the device appearance characteristics (such as brand logo, interface type, specific shape, etc.) through the camera, and compares them with the preset device feature database to determine the device model and basic parameters. If there is a QR code or NFC tag on the device surface, the unique identification code (such as MAC address) can be directly scanned and obtained.

[0095] Sub-step S12, match the appearance characteristics of the home device with the appearance characteristics in the preset feature database;

[0096] In this embodiment, dynamic data integration is used. After successful recognition, the software retrieves the device's communication protocol (such as Wi-Fi, Bluetooth), API interface document, and status detection rules from the cloud or local, and generates an information card containing device parameters and status detection logic. The scanning range is within the room where the worker is located, and the AR camera identifies and scans the device to present the device information. The software captures the appearance of the device (such as brand logo, shape, interface type, etc.) through the camera, and compares it with the preset device feature data to determine the device model and basic parameters. Through the pre-trained device feature library, the visual features such as the device appearance and logo in the real-time AR screen are compared (feature similarity of more than 95% is considered a successful match).

[0097] Sub-step S13, determining the home appliances in the real scene according to the matching result.

[0098] In this embodiment, determining the information of home appliances in the real-life scene requires the technology of device status detection. The acquisition of device status and information may need to be integrated with smart home protocols, such as MQTT (message queue telemetry transmission), HomeKit (a smart home platform released by Apple in 2014), etc. The configuration and control of smart homes should require devices to be connected to the Internet and obtain status through APIs. For example, after scanning and identifying the device, the cloud service is queried through the device's unique identifier (such as MAC address) to return real-time data. It is also necessary to combine network communication, such as checking whether the device is online through the background interface after identifying the device model. When scanning any device, the positioning data is combined with Wi-Fi matching to automatically associate with other smart devices in the room.

[0099] Step 303: display the network configuration guidance information of the home appliance in the real scene image, wherein the network configuration guidance information is used to guide the network configuration personnel to complete the network configuration of the home appliance.

[0100] In some embodiments, at a position corresponding to a household device in the real scene, a device card of the household device is displayed, and the device card includes device information;

[0101] When the AR assistive software waves the device in real time, the device card of the corresponding device will be displayed on the software screen at the position corresponding to the device in reality. The device card will display device-related information, such as the device name.

[0102] The step 303 specifically includes the following sub-steps:

[0103] Sub-step S21, in response to a user operation on a device card of a target home device, displaying network configuration guidance information of the target home device in the real scene.

[0104] When the user operates the device card, detailed network configuration guidance information for the home device can be further displayed. For devices with successful network configuration connections, corresponding reminder information will be displayed below the device card.

[0105] Meanwhile, if there are multiple devices, after opening the device card, if you want to view information about other devices, without having to exit the detailed page of the device card, you can swipe left or right to view other products that are simultaneously recognized, eliminating the need for the worker to return to the previous level of operation and achieving the purpose of rapid network configuration.

[0106] In some embodiments, the assembly worker is responsible for installing smart sockets and thermostats in a smart home system. The worker is not familiar with the network configuration connection steps for certain devices and needs to repeatedly consult the paper manual, which is prone to errors during the operation process. This results in a long connection process and low work efficiency. By using the AR home improvement assistance software, when clicking on the device card during the process of network-configuring the device, device network configuration guidance information will appear, including a usage tutorial. The tutorial includes detailed step-by-step instructions and video demonstrations, and you can follow the tutorial to operate step by step. If you encounter problems, you can also click the "Seek Help" button to obtain online technical support. The device connection process becomes simple and intuitive, improving work efficiency.

[0107] In other embodiments of the present invention, device management controls are displayed in the real scene image, and the number of home devices in the current real scene image is displayed on the device management controls; the step 303 further includes the following sub-steps:

[0108] With the help of augmented reality (AR) technology, displaying device management controls in the real scene image and showing the number of home devices in the current scene on the device management controls can significantly enhance the intuitiveness and efficiency of home device management and control.

[0109] Once a device is recognized, relevant management controls can be superimposed on the real scene image in the form of virtual icons. At the same time, the total number of home devices detected in the current scene is displayed on the device management controls. As the user moves or the device status in the environment changes (such as adding or removing devices), the system should be able to update the displayed information in real time, including adjusting the number of devices and the status of the corresponding management controls.

[0110] Sub-step S31, in response to a user operation on the device management control, a device list is displayed in the device management control; the device list includes network configuration guidance information for the home devices in the real scene image.

[0111] When a specific user operation on the device management control is detected, the system should respond to this operation and call the corresponding functional module to generate a device list. This list will display all the recognized home devices in the current scene.

[0112] For each identified home device, the system needs to collect relevant information to generate a device list. This information should at least include the device name, model number, and most importantly - the network configuration guidance information. The network configuration guidance information can be in the form of text descriptions, diagrams, or even video tutorials to guide users on how to connect the device to the home network.

[0113] Once the device list is generated, it should be displayed to the user within the device management control or as a separate view. Ensure that each device item is clearly distinguishable, and a specific device can be directly selected from the list to enter a more detailed configuration interface. As the environment changes (such as adding new devices or removing existing devices), the system can update the device list in real-time to ensure the accuracy and currency of the information.

[0114] Refer to Figure 4 , which shows the device information card and the schematic diagram of the device list for a network configuration guidance method of a home device provided by an embodiment of the present invention. When a device is identified and displayed on the software screen, a device management control is displayed in the center of the bottom. Through the device management control, the number of scanned devices can be seen, and after responding to the user's operation, the network configuration guidance information of the device can be viewed by entering the device information card through the device, or by directly clicking on the device management control, the device list of all devices can be displayed. Through the device list, the network configuration guidance information of the corresponding device can also be viewed, or the network configuration guidance information of all devices can be directly overviewed, such as the device network configuration tutorial.

[0115] In some embodiments, the installer is responsible for installing multiple smart devices in a newly built home theater, including a smart TV, audio system, projector, and smart lighting control. The worker needs to manually search for each device instruction and connect the devices one by one. Due to the large number of devices and the complex connection process, it takes a long time. This is prone to errors, resulting in a long waiting time for customers and low work efficiency. Using the AR home improvement assistance software, open the software and select the "Connect Devices" function. Use the camera to scan the room, and the software automatically identifies all the devices to be connected and generates a device list. The page forms a device matching map. Select the device to be connected, and the software displays the detailed connection steps, including video tutorials and text descriptions. Follow the tutorials step by step, and the software displays the connection progress and status in real-time.

[0116] In some other embodiments of the present invention, step 303 further includes the following sub-steps:

[0117] Sub-step S41, in response to the user's voice, determine the target home device corresponding to the user's voice, and display the network configuration guidance information of the target home device in the real scene picture.

[0118] In some other embodiments of the present invention, step 303 further includes the following sub-steps:

[0119] Sub-step S51: In response to a user gesture, determine the target home device pointed to by the user gesture, and display the network configuration guidance information of the target home device in the real scene picture.

[0120] The embodiments of the present invention provide an intuitive interaction method. Users can interact with the AR interface through voice or gestures. This natural interaction method makes it easier for users to understand and operate, improves the overall user experience, enables users to quickly get started and efficiently complete tasks. For daily operation of the mobile phone screen, voice means sending voice commands to the software, which is equivalent to the voice assistant of the software, meeting the user's need for more direct natural interaction. Gesture means gesture interaction based on image recognition. For example, the software camera can identify a product by recognizing the finger pointing of an assembly worker.

[0121] Refer to Figure 5 , which shows an interaction instruction schematic diagram of a network configuration guidance method for a home device provided by an embodiment of the present invention. First, use the camera of an AR device (such as a smart phone, a tablet computer or AR glasses) to capture the real scene around the user. Through the use of real-time positioning and mapping technology or other similar algorithms, the environment is recognized in real time and a map is established. For the home devices to be managed, mark them so that they can be recognized by the AR system. Once the device is recognized, relevant management controls can be superimposed on the picture in the form of virtual icons. These controls can be customized according to actual needs. In the device management controls of this embodiment, the total number of home devices detected in the current scene is displayed at the bottom center.

[0122] To improve the user experience, users can select a specific device through gesture operations for detailed viewing or control, or click on the device management control to obtain more information, or call out the network configuration guidance information of the target device needed through voice.

[0123] Step 304: Determine the actual position of the home device in the real scene picture; determine the navigation information from the current shooting position to the actual position of the home device; display the navigation information in the real scene picture.

[0124] In some embodiments, step 304 specifically includes the following sub-steps:

[0125] The navigation information includes the distance from the current shooting position to the actual position of the home device, and / or the navigation route from the current shooting position to the actual position of the home device.

[0126] In order to determine the actual position of the home device in the real scene picture, provide the navigation information (including distance and / or navigation route) from the current shooting position to the device, and display it in the real scene picture, a method combining augmented reality (AR) technology and indoor positioning technology can be adopted.

[0127] Utilize the sensors built into the AR device (such as GPS, accelerometer, gyroscope, etc.) in combination with the environmental model to determine the user's current position and orientation in real time. In some cases, it may also be necessary to deploy additional beacons or use ultra-wideband (UWB) technology to improve the positioning accuracy.

[0128] Calculate the straight-line distance between the known device position and the user's current position. Apply a path planning algorithm to generate the optimal path from the user's current position to the target device.

[0129] Overlay elements such as virtual indication arrows and path lines on the real-world view to guide the user to the location of the target device. Display the distance information between the user and the target device, which can be static text or a distance prompt that updates dynamically as the user moves.

[0130] In some embodiments, voice navigation assistance can also be provided to the user, especially giving clear guidance at turning points or when approaching the target. Provide a concise and clear operation guide to help the user get started quickly.

[0131] In other embodiments, the icons of the home devices can be in other forms, the display method of the network configuration route can also be in other forms, and there can also be other ways to distinguish between the home devices to be network-configured and the already network-configured home devices.

[0132] Refer to Figure 6 , which shows a schematic diagram of the real-world view navigation information of a method for guiding network configuration of a home device provided by an embodiment of the present invention. After scanning the house through AR software to display the real-world view, the specific positions of the scanned devices in the real-world view can be displayed in the real-world view, and each device has a corresponding device information card, as well as the total number of devices displayed by the central control, the distance between each device and the user's current position, and the optimal navigation route calculated through algorithms, and the navigation route is directly displayed in the real-world view.

[0133] Through real-time recognition and information display technology, the present invention can quickly and accurately provide the position, status, and operation guide of the device, significantly improving the efficiency of device management and installation. Assembly workers can quickly find the target device and complete the connection, reducing the time for searching and debugging, thus greatly improving the overall work efficiency. In addition, the system can automatically generate the optimal path to further optimize the work process and ensure the efficient execution of each link.

[0134] In some embodiments of the present invention, the network connection status of the home device is displayed in the real-world view.

[0135] Dynamic labeling and feedback are provided in the AR interface. The device status is labeled with color coding: green (online), yellow (high latency), and red (offline). Real-time data cards of key device parameters (such as network latency, CPU load) are superimposed. If the device is offline, the cause is automatically detected (such as network interruption, power failure), and targeted repair steps (such as "restart the router" or "check the power connection") are provided in the AR interface.

[0136] When the user performs an operation, instant feedback is provided. For example, a prompt box pops up to inform the user after successfully connecting to the device, and the positioning point turns green after successful connection. Follow the tutorial step by step, and the connection progress and status are displayed in real time below the device card. The device list is at the bottom of the page, and clicking it can expand to view all devices in the current space.

[0137] Refer to Figure 7 , which shows a schematic diagram of the device status of a network configuration guidance method for a home device provided by an embodiment of the present invention. The network connection status of each device can be intuitively seen from the device category, and the number of all online devices, the number of offline devices, and the number of abnormal devices are kindly counted. There is not only a reminder for each device, but also the overall status and status details. Through such an identification method, workers can understand the device status in the space where they are located, and judge whether it is connected and whether there are missing devices through the color identification of the positioning.

[0138] As an example, existing assembly workers need to install multiple intelligent security cameras and sensors in a large villa. The villa has a large area and the devices are widely distributed. Workers need to manually record the location of each device, which is easy to miss or confuse. As a result, the installation location of the device is inaccurate, leading to difficulties in subsequent debugging and maintenance. Using the AR home improvement assistance software, the software can display the location and status of the device in real time. Open the software and select the "device positioning" function. Use the camera to scan the interior of the villa, and the software automatically identifies and marks the locations of all installed devices. In the map view, each device has a clear identifier and status display (such as online, offline, faulty, etc.). You can click on any device identifier to view detailed device information and connection status. The device location is clear at a glance, achieving the purpose of quickly and accurately completing the installation and debugging work.

[0139] The present invention is not only applicable to the management of household appliances in a home environment, but also can be widely applied to various scenarios such as commercial places and industrial production lines. The design of the system has high flexibility and scalability, and can be customized and optimized according to the requirements of different application scenarios. For example, the system can be used for device monitoring and maintenance to improve maintenance efficiency; it can also be used for device status monitoring and fault diagnosis to reduce downtime and improve production efficiency, meeting diverse market demands. Monitoring the running status and online status of devices can meet the user's need to view the overall status when facing a batch of devices.

[0140] An embodiment of the present invention provides a method for guiding network configuration of home appliances, including: obtaining and displaying a real scene picture of a house; determining home appliances in the real scene picture and obtaining network configuration guiding information of the home appliances; using AR (Augmented Reality) technology to combine and display the network configuration guiding information of the home appliances in the real scene picture, where the network configuration guiding information is used to guide network configuration personnel to complete the network configuration of the home appliances. By using AR technology to display the network configuration guiding information of home appliances in the real scene picture to help network configuration personnel complete the network configuration of home appliances, the efficiency of device management and network configuration can be significantly improved.

[0141] It should be noted that for method embodiments, for the sake of simple description, they are all expressed as a series of action combinations. However, those skilled in the art should know that the embodiments of the present invention are not limited by the described action sequence, because according to the embodiments of the present invention, certain steps can be carried out in other sequences or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily essential for the embodiments of the present invention.

[0142] Referring to Figure 8 , a structural block diagram of a device for guiding network configuration of home appliances provided by an embodiment of the present invention is shown, which may specifically include the following modules:

[0143] An acquisition module 801, configured to obtain and display a real scene picture of a house;

[0144] A first determination module 802, configured to determine home appliances in the real scene picture and obtain network configuration guiding information of the home appliances;

[0145] A first display module 803, configured to display the network configuration guiding information of the home appliances in the real scene picture, where the network configuration guiding information is used to guide network configuration personnel to complete the network configuration of the home appliances.

[0146] In some embodiments of the present invention, it further includes:

[0147] A second display module, configured to display a device card of the home appliance at a position corresponding to the home appliance in the real scene picture, where the device card includes device information;

[0148] The first display module includes:

[0149] A first display sub-module, configured to display the network configuration guiding information of the target home appliance in the real scene picture in response to a user operation on the device card of the target home appliance.

[0150] In some embodiments of the present invention, it further includes:

[0151] A third display module, configured to display device management controls in the real scene picture and display the number of home devices in the current real scene picture in the device management controls;

[0152] The first display module includes:

[0153] A second display sub-module, configured to display a device list in the device management controls in response to a user operation on the device management controls; the device list includes network configuration guidance information of home devices in the real scene picture.

[0154] In some embodiments of the present invention, the first display module includes:

[0155] A third display sub-module, configured to determine a target home device corresponding to the user voice in response to the user voice and display the network configuration guidance information of the target home device in the real scene picture.

[0156] In some embodiments of the present invention, the first display module includes:

[0157] A fourth display sub-module, configured to determine a target home device pointed to by the user gesture in response to the user gesture and display the network configuration guidance information of the target home device in the real scene picture.

[0158] In some embodiments of the present invention, it further includes:

[0159] A second determination module, configured to determine the actual position of home devices in the real scene picture;

[0160] A third determination module, configured to determine navigation information from the current shooting position to the actual position of the home device;

[0161] A fourth display module, configured to display the navigation information in the real scene picture.

[0162] In some embodiments of the present invention, the navigation information includes the distance from the current shooting position to the actual position of the home device, and / or the navigation route from the current shooting position to the actual position of the home device.

[0163] In some embodiments of the present invention, the first determination module includes:

[0164] A first determination sub-module, configured to determine the appearance features of home devices in the real scene picture;

[0165] A matching sub-module, configured to match the appearance features of the home devices with the appearance features in a preset feature database;

[0166] A second determination sub-module, configured to determine the home appliances in the real scene picture according to the matching result.

[0167] An embodiment of the present invention provides a network configuration guiding device for home appliances, including: acquiring and displaying a real scene picture of a house; determining home appliances in the real scene picture, and acquiring network configuration guiding information of the home appliances; using AR (Augmented Reality) technology to combine and display the network configuration guiding information of the home appliances in the real scene picture, where the network configuration guiding information is used to guide network configuration personnel to complete the network configuration of the home appliances. By using AR technology to display the network configuration guiding information of the home appliances in the real scene picture to help the network configuration personnel complete the network configuration of the home appliances, the efficiency of device management and network configuration can be significantly improved.

[0168] For the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple. For related parts, refer to the partial description of the method embodiment.

[0169] An embodiment of the present invention further provides an electronic device, including:

[0170] It includes a processor, a memory, and a computer program stored on the memory and capable of running on the processor. When the computer program is executed by the processor, it implements each process of the above-mentioned network configuration guiding method embodiment for home appliances, and can achieve the same technical effect. To avoid repetition, it will not be elaborated here.

[0171] An embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, it implements each process of the above-mentioned network configuration guiding method embodiment for home appliances, and can achieve the same technical effect. To avoid repetition, it will not be elaborated here.

[0172] Each embodiment in this specification is described in a progressive manner. The key point of each embodiment is to illustrate the differences from other embodiments. For the same or similar parts among the embodiments, reference can be made to each other.

[0173] Those skilled in the art should understand that the embodiments of the present invention can be provided as a method, a device, or a computer program product. Therefore, the embodiments of the present invention can take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware aspects. Moreover, the embodiments of the present invention can take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0174] Embodiments of the present invention are described with reference to the flowcharts and / or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the present invention. It should be understood that each flow and / or block in the flowchart and / or block diagram, and the combination of flows and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to the processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing terminal devices to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing terminal devices generate means for implementing the functions specified in one or more flows Figure 1 one or more flows and / or blocks Figure 1 or means for implementing the functions specified in one or more blocks.

[0175] These computer program instructions can also be stored in a computer-readable memory that can direct a computer or other programmable data processing terminal device to work in a specific manner, so that the instructions stored in the computer-readable memory generate a manufactured article including instruction means, and the instruction means implement the functions specified in one or more flows Figure 1 one or more flows and / or blocks Figure 1 or means for implementing the functions specified in one or more blocks.

[0176] These computer program instructions can also be loaded onto a computer or other programmable data processing terminal device, so that a series of operation steps are executed on the computer or other programmable terminal device to generate a computer-implemented process, and thus the instructions executed on the computer or other programmable terminal device provide steps for implementing the functions specified in one or more flows Figure 1 one or more flows and / or blocks Figure 1 or means for implementing the functions specified in one or more blocks.

[0177] Although the preferred embodiments of the embodiments of the present invention have been described, those skilled in the art can make additional changes and modifications to these embodiments once they know the basic creative concept. Therefore, the appended claims are intended to be construed as including the preferred embodiments and all changes and modifications falling within the scope of the embodiments of the present invention.

[0178] Finally, it should also be noted that in this text, relational terms such as first and second are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Moreover, the term "comprising", "including" or any other variant thereof is intended to cover non-exclusive inclusion, so that a process, method, article or terminal device comprising a series of elements not only includes those elements, but also includes other elements not expressly listed, or further includes elements inherent to such process, method, article or terminal device. Without further limitation, an element defined by the statement "comprising an..." does not exclude the presence of additional identical elements in the process, method, article or terminal device comprising said element.

[0179] The above has introduced in detail a method for guiding network configuration of a home device and a device for guiding network configuration of a home device provided by the present invention. Specific examples are used in this text to elaborate on the principle and implementation manner of the present invention. The description of the above embodiments is only used to help understand the method and its core idea of the present invention; at the same time, for those of ordinary skill in the art, according to the idea of the present invention, there will be changes in the specific implementation manner and application scope. In summary, the content of this specification should not be construed as a limitation to the present invention.

Claims

1. A method for guiding network configuration of a home device, characterized in that, Including: Obtain and display the real scene image of the house; Determine the home appliances in the real scene image and obtain the network configuration guidance information of the home appliances; Display the network configuration guidance information of the home appliances in the real scene image, and the network configuration guidance information is used to guide the network configuration personnel to complete the network configuration of the home appliances.

2. The method for guiding network configuration of the home device according to claim 1, characterized in that, Also including: At the position corresponding to the home appliance in the real scene image, display the device card of the home appliance, and the device card includes device information; The displaying the network configuration guidance information of the home appliances in the real scene image includes: In response to a user operation on the device card of the target home appliance, display the network configuration guidance information of the target home appliance in the real scene image.

3. The network configuration guiding method for the home device according to claim 1, characterized in that Also including: Display a device management control in the real scene image, and display the number of home appliances in the current real scene image in the device management control; The displaying the network configuration guidance information of the home appliances in the real scene image includes: In response to a user operation on the device management control, display a device list in the device management control; The device list includes the network configuration guidance information of the home appliances in the real scene image.

4. The method for guiding network configuration of the home device according to claim 1, wherein The displaying the network configuration guidance information of the home appliances in the real scene image includes: In response to a user voice, determine the target home appliance corresponding to the user voice, and display the network configuration guidance information of the target home appliance in the real scene image.

5. The method for guiding network configuration of a home device according to claim 1, wherein, The displaying the network configuration guidance information of the home appliances in the real scene image includes: In response to a user gesture, determine the target home appliance pointed to by the user gesture, and display the network configuration guidance information of the target home appliance in the real scene image.

6. The network configuration guiding method for a home device according to claim 1, characterized in that, Also including: Determine the actual position of the home appliances in the real scene image; Determine the navigation information from the current shooting position to the actual position of the home appliance; Display the navigation information in the real scene image.

7. The method for guiding network configuration of the home device according to claim 6, wherein The navigation information includes the distance from the current shooting position to the actual position of the home appliance, and / or, the navigation route from the current shooting position to the actual position of the home appliance.

8. The network configuration guiding method for the home appliance according to claim 1, characterized in that, The determining the home appliances in the real scene image includes: Determine the appearance features of the home appliances in the real scene image; Match the appearance features of the home appliances with the appearance features in the preset feature database; According to the matching result, determine the home appliances in the real scene image.

9. The network configuration guiding method for the home appliance according to claim 1, wherein Also including: Display the network connection status of the home appliances in the real scene image.

10. A network configuration guiding device for a home appliance, characterized in that, Including: An acquisition module for obtaining and displaying the real scene image of the house; A first determination module for determining the home appliances in the real scene image and obtaining the network configuration guidance information of the home appliances; A first display module for displaying the network configuration guidance information of the home appliances in the real scene image, and the network configuration guidance information is used to guide the network configuration personnel to complete the network configuration of the home appliances.

11. An electronic device, characterized in that, Including: A processor, a memory, and a computer program stored on the memory and capable of running on the processor. When the computer program is executed by the processor, the steps of the network configuration guidance method for home appliances as described in any one of claims 1-9 are implemented.

12. A computer-readable storage medium, characterized in that, A computer program is stored on the computer-readable storage medium. When the computer program is executed by a processor, the steps of the network configuration guiding method for the home appliance device according to any one of claims 1-9 are implemented.

Images