A multi-modal based intelligent device network configuration method and related device

Abstract

The application discloses a multi-modal-based intelligent device network configuration method and related equipment, and the method comprises the following steps: constructing a multi-modal device information summary database; an intelligent gateway router scans intelligent devices in a multi-modal signal coverage range according to a preset time period, acquires transmitted multi-modal signals, matches the multi-modal signals with the pre-constructed multi-modal device information summary database, and sends network configuration prompt information to a terminal if the matching is successful; the terminal acquires and displays the network configuration prompt information sent by the intelligent gateway router, determines parameter settings corresponding to the network configuration prompt information according to a first operation instruction, and sends the parameter settings to the intelligent device, or jumps to a dedicated network configuration entrance corresponding to the intelligent device through a deep link according to a second operation instruction to complete network configuration of the intelligent device. The application embodiment can improve the recognition accuracy and the configuration success rate, and improve the user satisfaction. The application can be widely applied to the field of Internet of Things intelligent device network connection.

Description

Technical Field

[0001] This application relates to the field of IoT smart device network connection technology, and in particular to a multimodal smart device network configuration method and related equipment. Background Technology

[0002] With the rapid development of IoT technology, smart devices, such as smart home products (e.g., smart lights, smart sensors) and smart home appliances (e.g., smart air conditioners, water heaters), are growing at an unprecedented rate and deeply integrating into people's daily work and life. In the practical application of these smart devices, ensuring that the devices can be accurately identified and can complete network configuration quickly and stably is a core prerequisite for ensuring the normal operation of the devices and providing a good user experience.

[0003] However, current mainstream device identification and network configuration methods in the industry have many shortcomings. Regarding device identification, traditional methods mainly rely on users manually searching for and inputting the specific model information of the device, or require users to use relatively complex image recognition technologies (such as scanning the device's exterior) or QR code scanning technologies to obtain device information. In terms of network configuration, users often need to perform a series of tedious and error-prone parameter settings operations in their respective operating system settings interfaces or device-specific applications (APPs) for different brands and types of smart devices. These settings include manually selecting Wi-Fi networks, entering passwords, and configuring network modes.

[0004] Traditional methods place high demands on users' technical proficiency and patience, significantly increasing the barrier to entry and operational difficulty of smart devices. Users need to switch between multiple interfaces and understand various technical terms, which is particularly unfriendly to users without a technical background. Manually entering information is prone to errors, and image recognition and QR code scanning may fail due to environmental factors such as lighting and angle. During network configuration, complex parameter settings are also highly likely to cause configuration failures. These problems directly prevent the device from connecting to the network normally, significantly reducing the actual usability of the device and overall user satisfaction. Summary of the Invention

[0005] The main objective of this application is to propose a multimodal intelligent device network configuration method and related equipment, aiming to improve identification accuracy and configuration success rate, and enhance user satisfaction.

[0006] To achieve the above objectives, one aspect of this application proposes a multimodal intelligent device network configuration method, applied to a terminal, the method comprising the following steps: Acquire and display the network configurability prompt information sent by the smart gateway router; the network configurability prompt information includes preliminary network configuration information corresponding to the modal signals of the smart devices; Obtain a first operation instruction, determine the parameter settings corresponding to the network configurable prompt information according to the first operation instruction, and send the parameter settings to the smart device to complete the network configuration of the smart device; Alternatively, a second operation instruction can be obtained, and according to the second operation instruction, a deep link can be used to jump to the dedicated network configuration entry corresponding to the smart device to complete the network configuration of the smart device.

[0007] In some embodiments, determining the parameter settings corresponding to the network configurable prompt information according to the first operation instruction and sending the parameter settings to the smart device includes: According to the first operation instruction, select the network configuration algorithm and communication parameters that are compatible with the network configuration prompt information from the preset database; The system displays the network distribution information input interface, obtains the network credential parameter settings, establishes a communication link based on the network distribution algorithm and communication parameters, and sends the network credential parameter settings to the smart device through the communication link.

[0008] In some embodiments, the step of jumping to the dedicated network configuration entry corresponding to the smart device via a deep link according to the second operation instruction to complete the network configuration of the smart device includes: If the ecosystem of the smart device is not integrated with the ecosystem of the terminal, according to the second operation instruction, the official network corresponding to the smart device is called through deep linking to connect to the dedicated network configuration entry corresponding to the smart device to complete the network configuration of the smart device.

[0009] In some embodiments, the method includes: If the smart device fails to configure the network, detect the reason for the failure. The reason may include incorrect parameter settings and / or weak modal signal corresponding to the network configuration prompt information. The system displays the reason for the network configuration failure of the smart device and provides alternative network configuration solutions and / or technical support contact channels.

[0010] In some embodiments, the method includes: If the smart device is successfully configured to the network, a successful configuration message and the smart device's icon will be displayed. Obtain operation instructions for the icon of the smart device and display the control interface of the smart device.

[0011] To achieve the above objectives, one aspect of this application proposes a multimodal intelligent device network configuration method, applied to an intelligent gateway router, the method comprising the following steps: Scan the smart devices within the coverage area of ​​the multimodal signal according to a preset time period to obtain the multimodal signals emitted by the smart devices; The multimodal signals are matched with a pre-built multimodal device information aggregation database; the multimodal device information aggregation database includes the modal signals and distribution network information of several smart devices; If the match is successful, a network configuration prompt message is sent to the terminal so that the terminal can complete the network configuration of the smart device according to the prompt message; the network configuration prompt message includes the preliminary network configuration information corresponding to the modal signal of the smart device.

[0012] To achieve the above objectives, another aspect of this application proposes a multimodal intelligent device network configuration device applied to a terminal, the device comprising: The display module is used to acquire and display the network configurability prompt information sent by the smart gateway router; the network configurability prompt information includes preliminary network configuration information corresponding to the modal signals of the smart devices. The first network distribution module is used to acquire a first operation instruction, determine the parameter settings corresponding to the network-configurable prompt information according to the first operation instruction, and send the parameter settings to the smart device to complete the network distribution of the smart device. The second network configuration module is used to obtain a second operation instruction and, based on the second operation instruction, jump to the dedicated network configuration entry corresponding to the smart device through a deep link to complete the network configuration of the smart device.

[0013] To achieve the above objectives, another aspect of this application proposes a multimodal intelligent device network configuration device applied to an intelligent gateway router, the device comprising: The scanning module is used to scan the smart devices within the coverage area of ​​the multimodal signals according to a preset time period, and to acquire the multimodal signals emitted by the smart devices; A matching module is used to match the multimodal signals with a pre-built multimodal device information aggregation database; the multimodal device information aggregation database includes the modal signals and distribution network information of several smart devices; The sending module is used to send a network configuration prompt message to the terminal if the match is successful, so that the terminal can complete the network configuration of the smart device according to the prompt message; the network configuration prompt message includes preliminary network configuration information corresponding to the modal signal of the smart device.

[0014] To achieve the above objectives, one aspect of this application proposes a multimodal intelligent device distribution network system. The system includes intelligent devices, an intelligent gateway router, terminals, and a multimodal device information aggregation database. The terminals are connected to the intelligent gateway router and the intelligent devices, and the terminals and the intelligent gateway router are connected to the multimodal device information aggregation database. In this context: The terminal is used to execute the method described above. The smart gateway router is used to execute the above-described smart gateway router method; The intelligent device is used to send preset mode signals and perform network distribution based on received information; The multimodal device information aggregation database is used to store the modal signals and distribution network information of several intelligent devices.

[0015] To achieve the above objectives, another aspect of this application provides an electronic device, which includes a memory and a processor. The memory stores a computer program, and the processor executes the computer program to implement the methods described above.

[0016] To achieve the above objectives, another aspect of the embodiments of this application proposes a computer-readable storage medium storing a computer program that, when executed by a processor, implements the methods described above.

[0017] To achieve the above objectives, another aspect of the embodiments of this application proposes a computer program product, including a computer program that, when executed by a processor, implements the methods described above.

[0018] The embodiments of this application include at least the following beneficial effects: This application provides a method, system, electronic device, storage medium, and program product for intelligent device network configuration based on multimodality. This solution firstly solves problems such as identification failure, identification errors, or incompatible network configuration processes caused by incomplete, inaccurate, or outdated device information by constructing a comprehensive, accurate, and real-time multimodal device information aggregation database, greatly simplifying the user's operation steps and reducing time costs in discovering and identifying new devices. Secondly, the intelligent gateway router scans intelligent devices within the multimodal signal coverage area, improving the efficiency and accuracy of intelligent identification and reducing omissions or errors that may occur due to manual operation by the user. Finally, dual-path selection balances operational convenience with functional professionalism / completeness, significantly improving user experience and overall network configuration success rate. This solves the problem that a single network configuration method is difficult to adapt to all device characteristics and user preferences, thereby improving identification accuracy and configuration success rate, and increasing user satisfaction. Attached Figure Description

[0019] Figure 1 This is a schematic diagram of the structure of a multimodal intelligent device distribution network system provided in an embodiment of this application; Figure 2 This is a flowchart illustrating the construction and maintenance of a multimodal device information aggregation database, as provided in an embodiment of this application. Figure 3 This is a flowchart of a multimodal intelligent device network configuration method provided in an embodiment of this application; Figure 4 This is a flowchart of a smart device network configuration method based on multimodality and applied to a terminal, provided in an embodiment of this application; Figure 5 This is a flowchart of another intelligent device network configuration method based on multimodality and applied to a terminal, provided in an embodiment of this application; Figure 6 This is a flowchart illustrating the process of handling network configuration failure for a smart device, as provided in an embodiment of this application. Figure 7 This is a flowchart of a smart device network configuration method based on multimodality and applied to a smart gateway router, provided in an embodiment of this application; Figure 8 This is a schematic diagram of the structure of a smart device network distribution device applied to a terminal, provided in an embodiment of this application; Figure 9 This is a schematic diagram of the structure of a smart device network configuration device applied to a smart gateway router, provided in an embodiment of this application; Figure 10 This is a schematic diagram of the hardware structure of the electronic device provided in the embodiments of this application. Detailed Implementation

[0020] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of this application and are not intended to limit it. In the following description, when referring to the accompanying drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with those of this application; they are merely examples of apparatuses and methods consistent with some aspects of the embodiments of this application as detailed in the appended claims.

[0021] It is understood that the terms “first,” “second,” etc., used in this application may be used herein to describe various concepts, but unless otherwise stated, these concepts are not limited by these terms. These terms are only used to distinguish one concept from another. For example, without departing from the scope of the embodiments of this application, first information may also be referred to as second information, and similarly, second information may also be referred to as first information. Depending on the context, the words “if,” “when,” or “in response to a determination” as used herein may be interpreted as “when…” or “when…” or “in response to a determination.”

[0022] Before providing a detailed description of the embodiments of this application, some of the nouns and terms involved in the embodiments of this application will be explained first. The nouns and terms involved in the embodiments of this application are subject to the following interpretations.

[0023] Service Set Identifier (SSID): A signal emitted by a smart device to uniquely identify a wireless local area network (WLAN). Its characteristics are used to assist in identifying the device model and guiding network configuration.

[0024] Bluetooth Broadcast Packet: Broadcast data periodically sent by Bluetooth devices, containing device name, UUID, manufacturer-specific data, etc., used for multimodal device discovery and identification.

[0025] Universally Unique Identifier (UUID): A 128-bit identifier in the Bluetooth protocol that identifies the type of service or device and is used to distinguish between different manufacturers' devices (such as smart bracelets and Bluetooth speakers).

[0026] Manufacturer Specific Data: Manufacturer-defined fields in the Bluetooth broadcast packet (the first 3 bytes are the manufacturer ID, followed by the device model code), used to extract device brand and model characteristics.

[0027] Multi-Modal Device Information Aggregation Database: A database that integrates SSID and Bluetooth broadcast packet multi-dimensional information, storing device SSID, Bluetooth device name, UUID, MAC address, supported protocols, network configuration method, etc., supporting cross-protocol device identification.

[0028] Media Access Control Address (MAC): A unique identifier for a device at the hardware level in a network, used to identify network nodes at the data link layer, and is one of the dimensions of device information recorded in the database of this invention.

[0029] Message Queuing Telemetry Transport (MQTT): A lightweight IoT communication protocol based on a publish / subscribe model, used by gateway routers to efficiently push notifications of configurable network devices to mobile apps.

[0030] Transmission Control Protocol (TCP): A connection-oriented, reliable, byte-stream-based transport layer communication protocol. It can serve as the foundation for application layer protocols such as MQTT, or be used directly for message push between gateway routers and user mobile apps.

[0031] Application / Mobile App (APP): Refers to the smart device management application on the user's mobile phone, which is used to receive device discovery prompts pushed by the gateway router and guide the user to complete subsequent network configuration operations based on this information, including providing general network configuration functions or jumping to the official application.

[0032] Gateway Router: A specific network device with intelligent scanning and data processing capabilities. It scans the SSIDs of smart devices within its communication coverage area according to a preset period, compares them with the SSID information summary database, and pushes the information of successfully matched network-configurable devices to the user's APP.

[0033] Network configuration / pairing refers to the entire process of connecting a smart device to a target wireless network (such as a home Wi-Fi network). This typically involves providing the device with network credentials (such as the target network's SSID, password, etc.) and enabling the device to successfully join the network.

[0034] Deep Linking: A technology that allows an application (such as the smart device management app of this invention) to directly call or jump to a specific page or function (such as the official network configuration portal) of another application (such as the official app of a device brand), thereby achieving a smooth user experience and seamless integration of functions between different applications.

[0035] The multimodal intelligent device network configuration method provided in this application relates to the field of information technology. This method can be applied to terminals, servers, or software running on either terminal or server. In some embodiments, the terminal can be a smartphone, tablet, laptop, desktop computer, smart speaker, smartwatch, or in-vehicle terminal, but is not limited to these. The server can be configured as an independent physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, CDN, and big data and artificial intelligence platforms. The server can also be a node server in a blockchain network. The software can be an application implementing the multimodal intelligent device network configuration method, but is not limited to the above forms.

[0036] See Figure 1The multimodal intelligent device distribution network system includes various intelligent devices (as SSID signal sources and / or Bluetooth broadcast sources), intelligent gateway routers (performing scanning, comparison, and push), a multimodal device information aggregation database (which can be illustrated as cloud or local deployment, serving as an information hub), user smartphone terminals and the intelligent device management APP running on them (serving as user interaction interfaces and distribution network execution entities).

[0037] Smart devices include, but are not limited to, smart home devices (such as smart light bulbs, smart sockets, smart cameras, etc.), smart home appliances (such as smart air conditioners, smart heaters, smart water heaters), smart office equipment (such as smart printers, smart projectors), and all IoT devices that emit identifiable SSID signals or Bluetooth broadcasts. These devices are the service targets of this method.

[0038] Multi-Modal Device Information Aggregation Database: This is a core backend data system that can be deployed on a cloud server or, depending on actual needs, on a local network (for example, advanced gateway routers may have this database built-in or be able to efficiently access it within the local area network). It centrally stores the SSIDs of massive numbers of smart devices and their detailed associated information, such as device brand, specific model, MAC address characteristics (e.g., manufacturer OUI), supported network protocols (e.g., 802.11b / g / n / ac / ax), recommended or required security authentication methods (e.g., WPA-PSK, WPA2-Enterprise), whether it has network configurability attributes, possible deep linking information with official apps, and Bluetooth broadcast packet characteristics (e.g., Bluetooth device name, UUID, manufacturer data), etc.

[0039] Intelligent Gateway Router: Typically a core network device in a user's home or office network environment, such as a router with advanced features. In addition to traditional routing functions, it also acts as a "local intelligent sensing node" in this invention. It needs to possess: a. a high-performance wireless signal scanning module capable of periodically scanning surrounding SSIDs (such as those in the 2.4GHz and 5GHz bands); b. a Bluetooth scanning module capable of periodically capturing Bluetooth broadcast data; c. sufficient data processing capabilities to run SSID matching algorithms and communicate (query and compare) with an SSID information aggregation database; d. the ability to establish a communication link with the user's smartphone app, for example, by proactively pushing discovered device information to the app via MQTT or TCP / IP protocols.

[0040] (4) User's Smartphone App: A specific application installed on the user's smartphone. It is the main interface for the user to interact with the method of this invention. Its core functions include: a. receiving and displaying network-configurable device prompts pushed by the smart gateway router; b. providing a guided general network configuration process based on device information and user selection; c. managing deep links to achieve seamless jumps to the device's official app; d. executing emergency handling logic when device network configuration fails; (5) Communication connection relationship: a. The smart device broadcasts its SSID wirelessly (such as Wi-Fi) or broadcasts its Bluetooth data via Bluetooth; b. The smart gateway router captures these SSIDs wirelessly and captures Bluetooth broadcast data via Bluetooth scanning; c. The smart gateway router accesses the multimodal device information summary database for query and comparison via a network (wired or wireless, usually the Internet connected to the cloud database, or a LAN connected to the local database); d. The smart gateway router pushes the matching results and device information to the user's smartphone APP via a LAN or WAN (such as MQTT Broker intermediary); e. The user's smartphone APP finally interacts with the target smart device for network configuration information via a wireless network (usually Wi-Fi or Bluetooth).

[0041] See Figure 2 The process of building and dynamically maintaining a multi-dimensional, multi-modal device information aggregation database is as follows. The multi-dimensional, multi-modal device information aggregation database is a comprehensive, accurate, and continuously updated knowledge base of smart device information. The implementing entity is typically a professional device manufacturer, IoT technology service provider, industry alliance organization, or dedicated data service team. This is a systematic project requiring multi-party collaboration. Triggering conditions include: the initial database construction phase; the emergence of new smart device models on the market; firmware updates of known devices causing changes to SSID characteristics, Bluetooth broadcast characteristics, network protocols, or security authentication methods; or the arrival of a scheduled data maintenance cycle.

[0042] a. Multi-party collaborative data collection: i. Device manufacturers proactively provide detailed parameters for their smart devices, including SSID naming rules, specific models, MAC address ranges, supported network protocols, recommended security authentication methods, whether they are network-configurable devices, and their Bluetooth broadcast characteristics (such as Bluetooth device name, UUID, manufacturer data format, and encoding rules). ii. IoT technology service providers collect SSID information, Bluetooth broadcast characteristics, and related parameters for various devices through market research, user feedback, and publicly available technical documentation. iii. Industry alliances or organizations can integrate resources from all parties to promote data sharing and standardization, ensuring the comprehensiveness and authority of the data.

[0043] b. Professional Tools and Standardized Processes: i. Utilize professional network analysis tools (such as network sniffer and Bluetooth packet capture tools) to accurately capture device SSID broadcast and Bluetooth broadcast data in a controlled environment. ii. Establish strict and standardized data entry processes and templates, requiring data collection personnel to fill in each piece of device information according to unified specifications to avoid data omissions, format errors, or inconsistencies. iii. Implement data verification mechanisms; for example, each newly entered data undergoes at least two independent cross-checks to maximize data accuracy and completeness.

[0044] c. Dynamic Update and Maintenance Mechanism: i. Regular Synchronization: Establish a fixed data synchronization cycle (e.g., weekly) to obtain the latest device information from various partner data sources (manufacturers, service providers, etc.) and update the database. ii. Rapid Response to New Devices: For newly released and widely popular smart devices on the market, utilize a fast-track mechanism (e.g., online update interface) to strive to input their SSID, Bluetooth broadcast characteristics, and related information into the database within a short period (e.g., within 24 hours) after their official release. iii. Handling Special Cases and Changes: For special cases, such as significant changes to the default SSID format, Bluetooth broadcast characteristics, or security authentication methods due to device security vulnerability fixes, a manual review process is required to promptly and accurately modify the relevant records in the database. This ensures that the database information remains consistent with the actual market situation, thereby adapting to the rapidly iterating IoT device market.

[0045] The result is a structured, multi-dimensional, information-rich, accurate, reliable, and dynamically adaptable multimodal device information summary database. This database not only includes SSID and Bluetooth broadcast characteristics themselves, but more importantly, it establishes strong correlations between these characteristics and specific device attributes. The purpose of this step is to provide a solid and reliable data foundation and decision-making basis for subsequent automatic and accurate device identification and intelligent, personalized network configuration processes. The quality of the database directly determines the effectiveness of the entire method. In a specific embodiment, refer to Table 1, which shows a portion of the data in the multimodal device information summary database.

[0046] Table 1

[0047] By ensuring the comprehensiveness, accuracy, and real-time nature of the database, problems such as identification failures, identification errors, or incompatibility with network configuration processes caused by incomplete, inaccurate, or outdated device information are fundamentally solved. The dynamic maintenance mechanism ensures that the method can continuously adapt to the rapidly changing IoT device market, possessing long-term technological viability and rapid compatibility with emerging devices—something that static or slowly updated device information databases cannot match.

[0048] See Figure 3 The process begins with building and maintaining a multimodal device information aggregation database, then proceeds through a complete end-to-end process, including smart gateway routers scanning SSIDs and Bluetooth broadcasts and comparing them with the database, proactively pushing device information to the user's app, and finally, the user selecting a network configuration path (general network configuration or redirecting to the official app) under the guidance of the app and completing the device network configuration.

[0049] Figure 4 This is an optional flowchart of a multimodal intelligent device network configuration method provided in this application embodiment, applied to a terminal, and the method includes the following steps S101 to S103.

[0050] Step S101: Obtain and display the network configurability prompt information sent by the smart gateway router; the network configurability prompt information includes the preliminary network configuration information corresponding to the modal signals of the smart devices; Step S102: Obtain the first operation instruction, determine the parameter settings corresponding to the network configuration prompt information according to the first operation instruction, and send the parameter settings to the smart device to complete the network configuration of the smart device; Step S103: Obtain the second operation instruction. According to the second operation instruction, jump to the dedicated network configuration entry corresponding to the smart device through a deep link to complete the network configuration of the smart device.

[0051] The above steps focus on the actual network configuration operations performed by the user after receiving the device discovery notification on the terminal, providing flexible options to adapt to the needs of different users and devices. Execution Entity: The user and their smart device management app. Triggering Condition: The user views and clicks on a configurable device notification pushed by the gateway on the mobile app, indicating that the user wishes to configure the network for that device.

[0052] Processing Actions and Details (Two main network configuration modes are provided for users to choose from): Mode 1: Use the built-in general network configuration function of the APP; Mode 2: Perform network configuration by jumping to the official APP of the device brand through a deep link.

[0053] In some embodiments, determining the parameter settings corresponding to the network compatibility prompt information according to the first operation instruction and sending the parameter settings to the smart device includes: Step S201: According to the first operation instruction, select the network configuration algorithm and communication parameters that are compatible with the network configuration prompt information from the preset database; Step S202: Display the network distribution information input interface, obtain the network credential parameter settings, establish a communication link according to the network distribution algorithm and communication parameters, and send the network credential parameter settings to the smart device through the communication link.

[0054] See Figure 5 a. Intelligent Adaptation and Parameter Preset: When the user selects Mode 1, the APP will first automatically select and call the APP's pre-set general network configuration algorithm module and communication parameter set adapted to the characteristics of the device, based on the detailed information of the device (especially its supported network protocol types and recommended security authentication methods) obtained from the multimodal device information aggregation database from the smart gateway router. For example, if the device only supports older WEP encryption or requires a specific SSID broadcast format, the APP will attempt to adapt to these non-standard requirements.

[0055] b. Graphical Wizard-Style Interaction: The app guides users through the necessary network configuration information input using a concise and easy-to-understand graphical user interface (GUI) and step-by-step wizards. This typically involves allowing users to select the SSID of their home / office wireless network from a list of currently connected Wi-Fi networks or nearby Wi-Fi networks, and then enter the network password. Even when the user has a router with "fast configuration" or "seamless configuration" capabilities, and the device to be configured supports these features, the configuration process can be completed automatically within 5 seconds after the user clicks the "agree" button, requiring no further user intervention.

[0056] c. Secure Information Transmission: The app accurately transmits the user-input network credentials (SSID, password, etc.) to the target smart device via a secure, encrypted communication link (e.g., using the TLS-Transport Layer Security protocol to encrypt the communication content). Transmission methods may include various technologies such as Wi-Fi Direct (where the phone temporarily acts as an access point or connects to a device's access point) and Bluetooth-assisted configuration.

[0057] d. Real-time progress monitoring and status feedback: Throughout the network configuration process, the app monitors the progress in real time and provides feedback to the user through interface prompts or push notifications, such as "Attempting to connect to the device," "Network configuration information has been sent, waiting for device response," and "Device is verifying network information." This transparent feedback helps alleviate user anxiety while waiting.

[0058] In some embodiments, according to the second operation instruction, a deep link is used to jump to the dedicated network configuration entry corresponding to the smart device to complete the network configuration of the smart device, including: Step S301: If the ecosystem of the smart device is not connected with the ecosystem of the terminal, according to the second operation instruction, the official network corresponding to the smart device is called through deep linking to connect to the dedicated network configuration entry of the smart device to complete the network configuration of the smart device.

[0059] See Figure 5 a. When the IoT ecosystem of the device and the IoT ecosystem of the APP are not integrated, a deep link is used to call the device brand APP or guide the download: If the user's mobile phone has already installed the official APP corresponding to the device, the smart device management APP of this invention will directly call and wake up the official APP of the device brand through the deep link technology that is pre-recorded in the multimodal device information aggregation database or obtained through other means, and attempt to navigate to its exclusive network configuration entry page or process.

[0060] If the user's phone does not yet have the official app installed, this app will provide download links for the official app in major app stores or directly guide the user to the download page. After downloading and opening the official app, the user can complete the device's network configuration and other possible personalized settings by following the network configuration process and instructions provided by the official app. In this process, the app of this invention acts as an efficient "navigator" and "bridge."

[0061] Results: The target smart device successfully connected to the user-specified wireless network and completed the initial or full configuration based on the path selected by the user.

[0062] The purpose of this step is to ensure that regardless of the network configuration method chosen by the user, the entire configuration process is based on accurate device identification results, thus guaranteeing the efficiency and accuracy of the configuration operation. Two modes are provided to meet the needs of users seeking ease of operation (general configuration) and those who prefer full official functionality or have a preference for a specific brand (official app configuration). This flexibility is a key aspect of enhancing user experience and adapting to the complex IoT ecosystem.

[0063] This invention provides a flexible and intelligent network configuration path selection. The built-in universal network configuration function of the app adapts to accurate device information, simplifying the configuration process for common devices and improving convenience. The path that redirects to the official app fully utilizes the network configuration experience and complete functionality optimized by the device manufacturer for its products, meeting users' needs for specific brand features, advanced settings, or ecosystem integration. This dual-path selection balances operational convenience with functional professionalism / completeness, significantly improving user experience and overall network configuration success rate, and solving the problem that a single network configuration method cannot adapt to all device characteristics and user preferences.

[0064] In some embodiments, the multimodal smart device network configuration method includes: Step S401: If the smart device fails to configure the network, detect the reason for the failure. The reasons may include incorrect parameter settings and / or weak modal signal corresponding to the network configuration prompt information. Step S402 displays the reason for the smart device's network configuration failure and provides alternative network configuration solutions and / or technical support contact channels.

[0065] To improve the overall success rate of power distribution networks and enhance the user experience when encountering problems, the method of this invention can integrate a comprehensive emergency handling mechanism for power distribution network failures. This mechanism is typically implemented on the user's mobile app.

[0066] Execution Entity: User's smartphone app, which may require user intervention in certain situations. Triggering Condition: When any of the above network configuration modes are being executed, the app detects a network configuration timeout, the device reports an error, or the user explicitly indicates that the network configuration has failed.

[0067] See Figure 6 A structured troubleshooting and resolution process is as follows: (1) Preliminary Cause Investigation and Immediate Feedback. Network Credential Verification: The app will first prompt the user to check and confirm that the entered home / office network SSID and password are completely correct (for example, by allowing the user to view the entered content again or requiring re-entry). Home Network Status Detection: The app can try to use the phone's own network diagnostic capabilities or call the system API to detect the signal strength and stability of the current home Wi-Fi network. For example, it can obtain the current Wi-Fi signal strength value (RSSI). If it is lower than a preset threshold (such as -80dBm), it will prompt the user that the network signal may be too weak; it can detect network latency, packet loss rate, and other data. If the packet loss rate is higher than a certain threshold (such as 5%), it will prompt the user that the current network environment may be unstable. These factors may affect the success of network configuration.

[0068] (2) Intelligent Device and Network Compatibility Check. Network Protocol Matching: The APP summarizes the network protocol types supported by the target smart device recorded in the database based on the SSID information (for example, some older devices may only support 802.11b / g / n and not 802.11ac / ax), and compares them with the protocol mode broadcast by the user's current home network router. If a mismatch is found (for example, the device only supports 802.11n, while the user's router is currently set to 802.11ac only), the APP will explicitly prompt the user that they may need to adjust the router's wireless protocol settings to ensure compatibility. Security Authentication Method Matching: Similarly, the APP checks whether the security authentication method required by the device (such as WPA2-PSK) is consistent with the security mode currently set in the home network. If they are inconsistent (for example, the device requires WPA2-PSK authentication, while the network is set to open or a lower security level such as WEP, or vice versa), the APP will guide the user to check and may modify the home network's security settings, or look for options on the device that are compatible with the current network authentication method.

[0069] (3) Targeted Troubleshooting Guidance and Operation Suggestions. For specific problems identified, the app will provide clear and detailed troubleshooting steps and operation suggestions. If the problem is determined to be an incorrect password, the user will be prompted to carefully check and re-enter the correct password. If the problem is determined to be a poor network signal, the user is advised to try moving the smart device closer to the router, adjusting the router antenna / position to reduce signal obstructions, or considering using a Wi-Fi signal amplifier / extender to enhance signal coverage. For issues related to incompatible network protocols or security authentication methods, the app can try providing a quick access link to the settings interface of a general router (if the router supports remote or in-app management and is authorized), or provide a detailed setup guide with illustrations for common router brands to help users complete the necessary adjustments.

[0070] (4) Provide backup network configuration solutions. If the device still cannot successfully configure the network after the above preliminary troubleshooting and guidance adjustments, the APP will proactively provide some backup network configuration solutions for trial. Hotspot network configuration mode: For example, users are recommended to try the "hotspot network configuration" method. That is, guide users to first enable the personal hotspot function of their mobile phones, and then temporarily connect the smart device to this mobile hotspot. Afterwards, the user enters the SSID and password of the target home network in the APP, and the APP then forwards this network information to the smart device through the temporary communication link of the mobile hotspot, so that the device can try to use this information to connect to the home network. Wired network configuration solution (if the device supports it): If the database information shows that the smart device also supports wired network connection (for example, some smart cameras or TV boxes), the APP can guide users to try to connect the device directly to the router with a network cable for wired network configuration. After the wired network configuration is successful and an IP address is obtained, the wireless connection can be switched or configured in the device's settings interface (if applicable).

[0071] (5) Professional Technical Support Contact Channels: If users are still unable to complete network configuration after trying all the emergency handling methods and backup solutions provided by the APP, the APP should provide convenient channels for directly contacting professional technical support. This may include built-in online customer service chat functions, one-click dialing of customer service hotlines, submission of fault report forms, etc. Users can use these channels to provide professional technical support personnel with detailed feedback on the network configuration problems encountered, equipment models, operations already attempted, and error messages given by the APP. Technical personnel can then conduct remote diagnosis and guidance, or arrange on-site service when necessary.

[0072] Results: Maximizes the success rate of network configuration, ensuring that even if users fail on their first attempt, they can resolve the issue through system guidance and assistance, or easily obtain professional help if they cannot resolve it themselves. The impact of this step: Significantly enhances the robustness and user-friendliness of the entire network configuration method. By proactively diagnosing, intelligently guiding, and providing alternative solutions, it effectively reduces user frustration and time spent on blind attempts when encountering network configuration difficulties, thereby improving overall user satisfaction with the product and service. This robust error handling mechanism is an important indicator of the maturity of a technical solution.

[0073] This invention significantly improves the success rate of initial network configuration by integrating a systematic and intelligent fault diagnosis and handling mechanism into the app. More importantly, when network configuration does encounter obstacles, it effectively guides users to troubleshoot and resolve common problems themselves, or try effective backup solutions, rather than trapping users in a cycle of repeated ineffective attempts. This greatly reduces user frustration, lowers over-reliance on external manual technical support, and makes the entire network configuration method more robust, reliable, and user-friendly. This comprehensive backup mechanism is a key element in improving overall user satisfaction.

[0074] In some embodiments, the multimodal smart device network configuration method includes: Step S501: If the smart device is successfully configured to the network, a successful configuration message and the smart device's icon will be displayed. Step S502: Obtain operation instructions for the smart device icon and display the control interface of the smart device.

[0075] See Figure 6 Successful network configuration confirmation and subsequent operations: Once the target smart device successfully receives and verifies the network information and successfully connects to the user's designated home / office wireless network, it will send a success status receipt to the APP. The APP will then push a successful network configuration notification to the user, and the device icon will appear on the "User Devices" interface. The user can click on the device icon to enter the device control page. If the device brand's IoT ecosystem is deeply integrated with the APP's IoT ecosystem, the user can control and configure the device within this APP.

[0076] To achieve the above objectives, one aspect of this application proposes a multimodal intelligent device network configuration method, applied to an intelligent gateway router, the method comprising the following steps: Step S601: Scan the smart devices within the coverage area of ​​the multimodal signal according to a preset time period to acquire the multimodal signals emitted by the smart devices; Step S602: Match the multimodal signals with a pre-built multimodal device information aggregation database; the multimodal device information aggregation database includes the modal signals and distribution network information of several smart devices; Step S603: If the matching is successful, send a network configuration prompt message to the terminal so that the terminal can complete the network configuration of the smart device according to the prompt message; the network configuration prompt message includes the preliminary network configuration information corresponding to the mode signal of the smart device.

[0077] See Figure 7This step enables the automated and proactive discovery and identification of potentially configurable smart devices in the user environment. The executing entity is the gateway router (e.g., a router with specific firmware or software functionality). Triggering conditions: It may be automatically triggered according to a preset time period on the smart gateway router (e.g., performing a scan task every 5 minutes); it may also be triggered by specific events, such as after a router reboot or when there are significant changes in the network environment.

[0078] a. Equipment Selection and Parameter Configuration: Select a smart gateway router equipped with a high-performance wireless signal scanning module, Bluetooth scanning module, and powerful data processing capabilities. These routers typically have more powerful CPU and memory resources. In the gateway router's initial setup or management interface, configure it to enable "Smart Device Discovery" or a similar function, and set parameters such as the scanning cycle (e.g., 5 minutes), scanning frequency band (e.g., simultaneously scanning 2.4GHz and 5GHz bands), and Bluetooth scanning mode.

[0079] b. SSID and Bluetooth Broadcast Scanning and Information Acquisition: In its set working mode, the gateway router periodically performs active or passive SSID scanning on all Wi-Fi devices within its wireless signal coverage area, and broadcasts scans on surrounding Bluetooth devices to capture the SSID and Bluetooth broadcast data (including device name, UUID, manufacturer data, etc.) broadcast by these devices.

[0080] c. Efficient Algorithm Optimization and Database Retrieval Comparison: When a new or unconfirmed SSID or Bluetooth broadcast feature is detected, the gateway router utilizes its built-in high-performance processor to run an optimized matching program (e.g., it may employ a fast matching technique based on hash algorithms, or more complex pattern matching or fuzzy matching algorithms to handle the diversity of SSID and Bluetooth name naming). The captured SSID information and Bluetooth broadcast features are compared one-by-one or in batches with records in a pre-loaded (possibly a hot data cache of some commonly used devices) or real-time query database of multimodal device information. For example, when the gateway scans an SSID named "media_ac_4678" or captures a Bluetooth broadcast with the device name "Hair_wh_1231" and manufacturer data matching the characteristics of brands A and B, a database query may match records showing that this is a certain model of smart air conditioner manufactured by brand A (based on SSID identification) or a certain model of smart water heater manufactured by brand B (based on Bluetooth broadcast identification), including its brand, model, MAC address prefix, supported network protocols, recommended security authentication methods, and the device is marked as "suitable for network configuration".

[0081] d. Message Push and Initial Feedback After Successful Match: Once the scanned SSID or Bluetooth broadcast feature successfully matches a record of a known device in the database, and this record indicates that the device is configurable for networking, the gateway router determines that the device is a potential new device that the user can configure for networking. The gateway router immediately sends a structured prompt message to the smart device management APP installed on the user's mobile phone via a preset IoT communication protocol (such as MQTT, whose publish / subscribe model is well-suited for this type of message push; or directly using a TCP / IP connection). The message content typically includes, but is not limited to: the brand, model, device type icon of the identified device, a brief description of supported network protocols, clear instructions on "using this APP for network configuration management," and may even include a brief introduction to the device's functions or a link to a frequently asked questions (FAQ) to help the user quickly understand and decide whether to configure the network. This approach of providing initial information upon device discovery helps improve the efficiency of user decision-making.

[0082] Results: The user's mobile app receives one or more notifications about newly discovered configurable smart devices, containing sufficient information for the user to make judgments and take action. The purpose of this step is to transform the traditional process of requiring users to actively search for and manually identify devices into one where the system automatically discovers, intelligently identifies, and proactively notifies the user. This greatly simplifies the preparatory work for discovering new devices, improves the accuracy and efficiency of identification, and lays the foundation for convenient subsequent network configuration. The gateway here acts as both a "smart sentinel" and an "information preprocessor."

[0083] This technology enables a nearly seamless, fully automated device discovery process for users. It transforms the passive "human-finds-device" model into a "device information actively finds-human" model, greatly simplifying the steps and reducing the time cost for users to discover and identify new devices. The smart gateway's proactive SSID and Bluetooth broadcast scanning and precise comparison improve the efficiency and accuracy of identification, avoiding omissions or errors that may occur with manual user operations. The proactive message push mechanism ensures that users are promptly informed of newly added configurable devices in the environment, enhancing the convenience and immediacy of the user experience.

[0084] To achieve the above objectives, please refer to Figure 1One aspect of this application proposes a multimodal intelligent device distribution network system. The system includes intelligent devices, intelligent gateway routers, terminals, and a multimodal device information aggregation database. The terminals are connected to the intelligent gateway routers and the intelligent devices, and the terminals and intelligent gateway routers are connected to the multimodal device information aggregation database. The terminals are used to execute the methods described above. The intelligent gateway routers are used to execute the methods described above. The intelligent devices are used to send preset modal signals and perform distribution network based on received information. The multimodal device information aggregation database is used to store the modal signals and distribution network information of several intelligent devices.

[0085] The following sections will provide a detailed introduction and explanation of the solutions in the embodiments of the present invention, using several specific application scenarios as examples.

[0086] Scenario 1: The efficient network configuration process of smart office equipment. Application environment: modern office.

[0087] Process: A new smart printer was purchased for the office. When the printer is powered on and begins broadcasting its default SSID (e.g., "OfficePrinter_890"), the smart gateway router in the office area (with this invention's functionality deployed) captures this SSID during its routine scanning cycle (e.g., within 5 minutes). The smart gateway router, by comparing it with the multimodal device information aggregation database, successfully identifies it as a specific model of smart printer, with details such as: brand "AB", model "LMFP Xnw", MAC address "FF:00:11:22:33:44", supported network protocol 802.11g, WPA-PSK security authentication, and the multimodal device information aggregation database marking it as "configurable for network configuration". Subsequently, the smart gateway router pushes this device information to the smart device management app on the IT administrator's or relevant employee's mobile phone via the MQTT protocol. The app pops up a prompt: "A new printer (LMFP Xnw) has been found. Configure the network immediately?" The user clicks "Yes" and selects to use the app's built-in general network configuration function. The app guided the user to select the office's wireless network SSID and enter the correct Wi-Fi password. The information was then sent to the printer in an encrypted manner.

[0088] Result: The printer successfully connected to the office wireless network. The app displayed "Printer network configuration successful, ready for use." Employees could then send print jobs to the printer from their computers or mobile phones via the network. Benefit: Significantly simplified the network configuration process for office equipment, eliminating the need for manual setup by professional IT personnel on each device, improving the efficiency of new equipment deployment and employee productivity.

[0089] Scenario 2: Network integration between smart wearable devices and the smart home ecosystem. Application environment: Home.

[0090] Process: A user purchases a new air conditioner. Upon powering on, the air conditioner emits its unique Bluetooth broadcast packet (e.g., containing "X_AC_321"). The home's smart gateway router scans this Bluetooth broadcast packet and compares it with a multimodal device information database. The database identifies it as a specific model of smart air conditioner from the same company, such as "Air Conditioner 1C," with a MAC address of "55:66:77:88:99:AA," supporting the 802.11b network protocol (via Bluetooth-assisted network pairing), using WPA-PSK security authentication, and marked as "suitable for network pairing." The smart gateway router pushes this information to the smart device management app on the user's phone. The user receives a notification from the app: "New Air Conditioner 1C detected. We recommend using a certain app for network pairing to obtain a complete experience. Redirect?" The user selects "Yes." Since the user's phone already has the "certain app" installed, the management app, through deep linking technology, directly launches the "certain app" and may transmit device identification information, directly initiating the process of adding a new smart band. Following the official instructions on the "Xiaomi" app, the user successfully completed the network configuration for the air conditioner.

[0091] Result: The air conditioner was successfully network-connected and paired. Subsequent integration and effects: After network connection is complete, users can use Xiaomi's smart home ecosystem to link this newly networked smart air conditioner with other existing smart devices in the home (such as smart lights, smart TVs, smart curtains, etc.). This provides users with a more personalized and convenient smart home automation experience.

[0092] To achieve the above objectives, please refer to Figure 8 Another aspect of this application proposes a multimodal intelligent device network distribution device, applied to a terminal, the device comprising: The display module is used to acquire and display the network configurability prompt information sent by the smart gateway router; the network configurability prompt information includes the preliminary network configuration information corresponding to the modal signals of the smart devices; The first network distribution module is used to obtain the first operation instruction, determine the parameter settings corresponding to the network distribution prompt information according to the first operation instruction, and send the parameter settings to the smart device to complete the network distribution of the smart device. The second distribution network module is used to obtain the second operation instruction and, based on the second operation instruction, jump to the dedicated distribution network entry corresponding to the smart device through a deep link to complete the smart device distribution network.

[0093] It is understood that the content of the above-described method embodiments applied to the terminal is applicable to this device embodiment. The specific functions implemented by this device embodiment are the same as those of the above-described method embodiments, and the beneficial effects achieved are also the same as those achieved by the above-described method embodiments.

[0094] To achieve the above objectives, please refer to Figure 9 Another aspect of this application proposes a multimodal intelligent device network configuration device, applied to an intelligent gateway router, the device comprising: The scanning module is used to scan the smart devices within the coverage area of ​​the multimodal signals according to a preset time period to acquire the multimodal signals emitted by the smart devices; The matching module is used to match multimodal signals with a pre-built multimodal device information aggregation database; the multimodal device information aggregation database includes the modal signals and distribution network information of several smart devices; The sending module is used to send a network configuration prompt message to the terminal if the match is successful, so that the terminal can complete the network configuration of the smart device according to the prompt message; the network configuration prompt message includes the preliminary network configuration information corresponding to the mode signal of the smart device.

[0095] It is understood that the content of the above-described method embodiments applied to smart gateway routers is applicable to this device embodiment. The specific functions implemented in this device embodiment are the same as those in the above-described method embodiments, and the beneficial effects achieved are also the same as those achieved in the above-described method embodiments.

[0096] This application also provides an electronic device, which includes a memory and a processor. The memory stores a computer program, and the processor executes the computer program to implement the above-described method. This electronic device can be any smart terminal, including tablet computers, in-vehicle computers, etc.

[0097] It is understood that the content of the above method embodiments is applicable to this device embodiment. The specific functions implemented by this device embodiment are the same as those of the above method embodiments, and the beneficial effects achieved are also the same as those achieved by the above method embodiments.

[0098] Please see Figure 10 , Figure 10 The hardware structure of an electronic device according to another embodiment is illustrated. The electronic device includes: The processor 1001 can be implemented using a general-purpose CPU (Central Processing Unit), microprocessor, application-specific integrated circuit (ASIC), or one or more integrated circuits, and is used to execute relevant programs to implement the technical solutions provided in the embodiments of this application. The memory 1002 can be implemented as a read-only memory (ROM), static storage device, dynamic storage device, or random access memory (RAM). The memory 1002 can store the operating system and other applications. When the technical solutions provided in the embodiments of this specification are implemented through software or firmware, the relevant program code is stored in the memory 1002 and is called and executed by the processor 1001 using the methods described in the embodiments of this application. Input / output interface 1003 is used to implement information input and output; The communication interface 1004 is used to enable communication and interaction between this device and other devices. Communication can be achieved through wired means (such as USB, network cable, etc.) or wireless means (such as mobile network, WIFI, Bluetooth, etc.). Bus 1005 transmits information between various components of the device (e.g., processor 1001, memory 1002, input / output interface 1003, and communication interface 1004); The processor 1001, memory 1002, input / output interface 1003 and communication interface 1004 are connected to each other within the device via bus 1005.

[0099] Memory, as a non-transitory computer-readable storage medium, can be used to store non-transitory software programs and non-transitory computer-executable programs. Furthermore, memory may include high-speed random access memory, and may also include non-transitory memory, such as at least one disk storage device, flash memory device, or other non-transitory solid-state storage device. In some embodiments, memory may optionally include memory remotely located relative to the processor, and these remote memories can be connected to the processor via a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.

[0100] The multimodal intelligent device network configuration method, system, electronic device, storage medium, and program product provided in this application have the following beneficial effects: This method significantly simplifies the operation process and greatly lowers the user threshold. Through automatic scanning of the smart gateway router (including SSID and Bluetooth broadcasting) and accurate comparison with a multimodal device information database, it achieves automatic discovery and model identification of configurable devices. Users no longer need to manually search for device models, input complex information, or perform error-prone QR code / image scanning. During the network configuration phase, the user's mobile app provides clear guidance and a simplified interface. Whether selecting general network configuration or jumping to the official app (the third step of the corresponding technical solution), it is far simpler and more intuitive than traditional methods. Automated and intelligent device identification and guided network configuration free users from the previously cumbersome and error-prone manual operation process. Users only need to receive device discovery prompts pushed by the system through the mobile app and perform a few simple clicks or information confirmations to quickly complete device identification and network configuration. This greatly improves the user experience, especially for users without a technical background, significantly lowering the technical threshold for them to use and enjoy smart devices.

[0101] Significantly improves network configuration efficiency and accelerates device availability. A pre-built and dynamically maintained multi-dimensional, multi-modal device information aggregation database provides the foundation for rapid and accurate identification. Combined with the periodic and automated scanning (including SSID and Bluetooth broadcasting) and efficient comparison mechanism of the smart gateway router, it can quickly and accurately determine newly added configurable devices and their key parameters in the user's environment within a very short time (e.g., within the gateway's scanning cycle, such as 5 minutes). This rapid and automated identification effectively reduces the significant time users spend searching for devices, confirming models, finding configuration methods, and manually entering parameters during the network configuration process. Overall, it shortens the cycle from device unpacking to successful network connectivity and improves device availability. This efficiency improvement is particularly significant for users with multiple new devices to configure, or in environments requiring rapid device deployment, better meeting users' needs for "plug and play" or "quick-to-use" smart devices.

[0102] This invention boasts broad compatibility and strong future scalability. The core identification basis of this invention's method is the device's SSID and Bluetooth broadcast characteristics. SSID is a common identifier for Wi-Fi devices, and Bluetooth broadcast is a common identifier for Bluetooth devices. Although SSID naming and Bluetooth broadcast data may vary, by constructing a sufficiently comprehensive multimodal device information aggregation database and combining it with a certain matching algorithm, it can cover the vast majority of mainstream brand and model smart devices. The method itself does not rely on specific brand or model proprietary protocols or hardware characteristics, integrating currently widely used Wi-Fi and Bluetooth pairing methods. It requires minimal device-side modifications (Wi-Fi pairing requires no modification, and Bluetooth pairing only requires adding device information to the broadcast packet, with no hardware modification costs), yet achieves significant results. The Internet of Things (IoT) technology is still developing rapidly, with new smart device brands, models, and types constantly emerging. The core of this invention's method—the multimodal device information aggregation database—possesses dynamic update and maintenance mechanisms (such as periodic synchronization, rapid entry of new devices, and handling of information changes), and can be easily expanded to support future new device types and models. This design gives it strong technological adaptability and long-term development potential, preventing it from becoming obsolete quickly with the emergence of new devices and offering excellent scalability. Because it does not rely on the technological barriers of specific manufacturers, this method is compatible with the vast majority of mainstream brands and models of smart devices on the market. Whether it's smart home devices (such as lights and locks), smart appliances (such as air conditioners, heaters, and electric water heaters), smart office equipment (such as printers), or smart wearable devices, as long as they initially broadcast or identify themselves via SSID or Bluetooth broadcast (these two are also the network configuration methods used by the vast majority of devices on the market), this method is likely to be applicable, demonstrating good compatibility.

[0103] The embodiments described in this application are for the purpose of more clearly illustrating the technical solutions of the embodiments of this application, and do not constitute a limitation on the technical solutions provided by the embodiments of this application. As those skilled in the art will know, with the evolution of technology and the emergence of new application scenarios, the technical solutions provided by the embodiments of this application are also applicable to similar technical problems.

[0104] Those skilled in the art will understand that the technical solutions shown in the figures do not constitute a limitation on the embodiments of this application, and may include more or fewer steps than shown, or combine certain steps, or different steps.

[0105] The preferred embodiments of the present application have been described above with reference to the accompanying drawings, but this does not limit the scope of the claims of the present application. Any modifications, equivalent substitutions, and improvements made by those skilled in the art without departing from the scope and substance of the embodiments of the present application shall be within the scope of the claims of the present application.

Claims

1. A method for intelligent device network distribution based on multimodal operation, characterized in that, Applied to a terminal, the method includes the following steps: Acquire and display the network configurability prompt information sent by the smart gateway router; the network configurability prompt information includes preliminary network configuration information corresponding to the modal signals of the smart devices; and perform one of the following steps based on the user's selection: Obtain a first operation instruction, determine the parameter settings corresponding to the network configurable prompt information according to the first operation instruction, and send the parameter settings to the smart device to complete the network configuration of the smart device; Alternatively, obtain a second operation instruction, and according to the second operation instruction, jump to the dedicated network configuration entry corresponding to the smart device through a deep link to complete the network configuration of the smart device; The network configurability notification sent by the smart gateway router is obtained through the following steps: The smart gateway router scans smart devices within the coverage area of ​​the multimodal signal according to a preset time period to acquire the multimodal signals emitted by the smart devices; The multimodal signals are matched with a pre-built multimodal device information aggregation database; the multimodal device information aggregation database includes the modal signals and distribution network information of several smart devices; If the match is successful, a network configuration prompt message is sent to the terminal so that the terminal can complete the network configuration of the smart device according to the prompt message.

2. The method according to claim 1, characterized in that, The step of determining the parameter settings corresponding to the network configurable prompt information according to the first operation instruction and sending the parameter settings to the smart device includes: According to the first operation instruction, select the network configuration algorithm and communication parameters that are compatible with the network configuration prompt information from the preset database; The system displays the network distribution information input interface, obtains the network credential parameter settings, establishes a communication link based on the network distribution algorithm and communication parameters, and sends the network credential parameter settings to the smart device through the communication link.

3. The method according to claim 1, characterized in that, The step of redirecting to the dedicated network configuration entry corresponding to the smart device via a deep link according to the second operation instruction to complete the network configuration of the smart device includes: If the ecosystem of the smart device is not integrated with the ecosystem of the terminal, according to the second operation instruction, the official network corresponding to the smart device is called through deep linking to connect to the dedicated network configuration entry corresponding to the smart device to complete the network configuration of the smart device.

4. The method according to claim 1, characterized in that, The method includes: If the smart device fails to configure the network, detect the reason for the failure. The reason may include incorrect parameter settings and / or weak modal signal corresponding to the network configuration prompt information. The system displays the reason for the network configuration failure of the smart device and provides alternative network configuration solutions and / or technical support contact channels.

5. The method according to claim 1, characterized in that, The method includes: If the smart device is successfully configured to the network, a successful configuration message and the smart device's icon will be displayed. Obtain operation instructions for the icon of the smart device and display the control interface of the smart device.

6. A method for intelligent device network distribution based on multimodal operation, characterized in that, Applied to smart gateway routers, the method includes the following steps: Scan the smart devices within the coverage area of ​​the multimodal signal according to a preset time period to obtain the multimodal signals emitted by the smart devices; The multimodal signals are matched with a pre-built multimodal device information aggregation database; the multimodal device information aggregation database includes the modal signals and distribution network information of several smart devices; If the match is successful, a network configuration prompt message is sent to the terminal so that the terminal can complete the network configuration of the smart device according to the prompt message; the network configuration prompt message includes preliminary network configuration information corresponding to the modal signal of the smart device. The terminal completes network configuration for smart devices through the following steps: Obtain and display the network configurability prompt information sent by the smart gateway router, and perform one of the following steps based on the user's selection; Obtain a first operation instruction, determine the parameter settings corresponding to the network configurable prompt information according to the first operation instruction, and send the parameter settings to the smart device to complete the network configuration of the smart device; Alternatively, a second operation instruction can be obtained, and according to the second operation instruction, a deep link can be used to jump to the dedicated network configuration entry corresponding to the smart device to complete the network configuration of the smart device.

7. A multimodal intelligent device distribution network system, characterized in that, The system includes smart devices, smart gateway routers, terminals, and a multimodal device information aggregation database. The terminals are connected to the smart gateway routers and the smart devices, and the terminals and the smart gateway routers are connected to the multimodal device information aggregation database. The terminal is used to perform the method according to any one of claims 1-5; The smart gateway router is used to perform the method of claim 6; The intelligent device is used to send preset mode signals and perform network distribution based on received information; The multimodal device information aggregation database is used to store the modal signals and distribution network information of several intelligent devices.

8. An electronic device, characterized in that, include: At least one processor; At least one memory for storing at least one program; When the at least one program is executed by the at least one processor, the at least one processor implements the method as described in any one of claims 1-6.

9. A computer-readable storage medium storing a computer program, characterized in that, When the computer program is executed by a processor, it implements the method of any one of claims 1 to 6.

10. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by a processor, it implements the method of any one of claims 1 to 6.

Images