End-cloud collaborative dynamic multi-protocol gateway system and method

Abstract

The invention relates to an end-cloud collaborative dynamic multi-protocol gateway system and method, and the system comprises a cloud module and a local gateway module. The cloud module is used for analyzing the received user intention instruction to generate an equipment control instruction corresponding to the user intention instruction; and the local gateway module is used for transparently transmitting the equipment control instruction issued by the cloud module to the Internet of Things equipment, or transparently transmitting the equipment state information uploaded by the Internet of Things equipment to the cloud module. According to the method and the device, instruction analysis, protocol selection and final instruction assembly are uniformly completed by the cloud, and the local gateway is only used as a transparent transmission execution layer, so that the efficiency of dynamic multi-communication protocol control of the Internet of Things equipment is improved, and the problem of how to improve the communication efficiency of the Internet of Things equipment in a multi-protocol communication scene is solved.

Description

Technical Field

[0001] This application relates to the field of Internet of Things (IoT) technology, and in particular to a dynamic multi-protocol gateway system and method for edge-cloud collaboration. Background Technology

[0002] With the rapid popularization of the Internet of Things (IoT) and smart homes, and the widespread adoption of various communication protocols such as infrared (IR), Bluetooth (BLE / BLE Mesh), and Wi-Fi by different home appliances, sensors, and control terminals, existing smart home systems typically suffer from the following problems: 1. The protocols are severely fragmented, making it difficult to form a unified control link. For example, infrared cannot transmit data back, Bluetooth has a short range, and WiFi is sensitive to power consumption, requiring different control methods for different devices; 2. Traditional gateways need to parse all protocol commands locally, requiring a large pre-built command set, driver library, and brand / model parsing logic, resulting in high memory consumption and difficulty in updating; 3. Multiple protocol states cannot be integrated, such as unidirectional IR state, bidirectional WiFi state, and random updates in Bluetooth Mesh state, resulting in inconsistent device states.

[0003] Currently, no effective solution has been proposed for improving the communication performance of IoT devices in multi-protocol communication scenarios. Summary of the Invention

[0004] This application provides a dynamic multi-protocol gateway system and method for end-to-cloud collaboration, which at least solves the problem of how to improve the communication performance of IoT devices in multi-protocol communication scenarios in related technologies.

[0005] In a first aspect, embodiments of this application provide a dynamic multi-protocol gateway system with end-to-cloud collaboration, the system including a cloud module and a local gateway module; The cloud module is used to parse the received user intent command in order to generate a device control command corresponding to the user intent command. The local gateway module is used to transparently transmit device control commands issued by the cloud module to the IoT device, or to transparently transmit device status information uploaded by the IoT device to the cloud module.

[0006] In some embodiments, the cloud module includes a parsing submodule, a matching submodule, and a generation submodule; The parsing submodule is used to receive user intent commands and parse the device type information and control action information of the Internet of Things device from the user intent commands; The matching submodule is used to match the device capability information of the IoT device from the device capability model library based on the device type information; The generation submodule is used to generate a device control command corresponding to the user intent command based on the control action information and the device capability information.

[0007] In some embodiments, the device type information is device QR code information; The matching submodule is used to match the device capability information of the IoT device from the device capability model library based on the device QR code information, wherein the device capability information includes communication protocol capabilities and device controllable parameters.

[0008] In some embodiments, the generation submodule is configured to generate a control action instruction corresponding to the user intent instruction based on the control action information, the communication protocol capability, and the device controllable parameters.

[0009] In some embodiments, the generation submodule is configured to generate a control action instruction corresponding to the user intent instruction based on the control action information, the communication protocol capability, and the device controllable parameters. If the communication protocol capability of the IoT device is WiFi communication, a WiFi forwarding header is added to the generated control action command; if the communication protocol capability of the IoT device is Bluetooth communication, a Bluetooth forwarding header is added to the generated control action command; if the communication protocol capability of the IoT device is infrared communication, the generated control action command is mapped to an infrared code and an infrared forwarding header is added.

[0010] In some embodiments, the local gateway module includes a WiFi communication submodule, a Bluetooth communication submodule, and an infrared transceiver submodule; The WiFi communication submodule is used to perform WiFi communication between the local gateway module and the cloud module, and to perform WiFi communication between the local gateway module and IoT devices, supporting TCP protocol, HTTP protocol and MQTT protocol; The Bluetooth communication submodule is used to perform Bluetooth communication between the local gateway module and the IoT device, and supports the GATT protocol and the Mesh protocol. The infrared transceiver submodule is used to perform infrared communication between the local gateway module and the IoT device.

[0011] In some embodiments, the system further includes Internet of Things (IoT) devices, including WiFi IoT devices, Bluetooth IoT devices, and infrared IoT devices.

[0012] In some embodiments, if the IoT device is a Bluetooth IoT device, the cloud module automatically selects the optimal relay node from the Bluetooth IoT device to broadcast Mesh data packets based on the Mesh topology of the Bluetooth IoT device; the local gateway module is only responsible for transparently transmitting the instructions issued by the cloud module and does not participate in the calculation.

[0013] In some embodiments, if the IoT device package is an infrared IoT device, the local gateway device transparently transmits the infrared waveform returned by the infrared IoT device to the cloud module; the cloud module infers the device status of the infrared IoT device based on the infrared waveform and sends it back to the local gateway device.

[0014] Secondly, embodiments of this application provide a dynamic multi-protocol gateway method for end-to-cloud collaboration. The method is executed based on the system described in the first aspect above, and the method includes: The received user intent command is parsed to generate a device control command corresponding to the user intent command; The device control commands issued by the cloud module are transparently transmitted to the IoT device, or the device status information uploaded by the IoT device is transparently transmitted to the cloud module.

[0015] Compared to related technologies, this application provides a dynamic multi-protocol gateway system and method for end-to-cloud collaboration. The system includes a cloud module and a local gateway module. The cloud module parses received user intent commands to generate device control commands corresponding to the user intent commands. The local gateway module transparently transmits the device control commands issued by the cloud module to IoT devices, or transparently transmits device status information uploaded by IoT devices to the cloud module. This achieves unified command parsing, protocol selection, and final command assembly by the cloud, with the local gateway acting only as a transparent execution layer. This improves the efficiency of dynamic multi-communication protocol control for IoT devices and solves the problem of how to improve the communication efficiency of IoT devices in multi-protocol communication scenarios. Attached Figure Description

[0016] The accompanying drawings, which are included to provide a further understanding of this application and form part of this application, illustrate exemplary embodiments and are used to explain this application, but do not constitute an undue limitation of this application. In the drawings: Figure 1 This is a schematic diagram of the structure of a dynamic multi-protocol gateway system for end-to-cloud collaboration according to an embodiment of this application; Figure 2 This is a flowchart illustrating the infrared status recognition mechanism according to an embodiment of this application; Figure 3This is a flowchart illustrating a dynamic multi-protocol gateway method for end-to-cloud collaboration according to an embodiment of this application. Figure 4 This is a schematic diagram of the internal structure of an electronic device according to an embodiment of this application. Detailed Implementation

[0017] To make the objectives, technical solutions, and advantages of this application clearer, the application is described and illustrated below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application. All other embodiments obtained by those skilled in the art based on the embodiments provided in this application without inventive effort are within the scope of protection of this application.

[0018] Obviously, the accompanying drawings described below are merely some examples or embodiments of this application. Those skilled in the art can apply this application to other similar scenarios based on these drawings without any inventive effort. Furthermore, it is understood that although the efforts made in this development process may be complex and lengthy, for those skilled in the art related to the content disclosed in this application, any changes to design, manufacturing, or production based on the technical content disclosed in this application are merely conventional technical means and should not be construed as insufficient disclosure of the content of this application.

[0019] In this application, the reference to "embodiment" means that a specific feature, structure, or characteristic described in connection with an embodiment may be included in at least one embodiment of this application. The appearance of this phrase in various places in the specification does not necessarily refer to the same embodiment, nor is it a separate or alternative embodiment that is mutually exclusive with other embodiments. It will be explicitly and implicitly understood by those skilled in the art that the embodiments described in this application may be combined with other embodiments without conflict.

[0020] Unless otherwise defined, the technical or scientific terms used in this application shall have the ordinary meaning understood by one of ordinary skill in the art to which this application pertains. The terms “a,” “an,” “an,” “the,” and similar words used in this application do not indicate quantity limitation and may indicate singular or plural. The terms “comprising,” “including,” “having,” and any variations thereof used in this application are intended to cover non-exclusive inclusion; for example, a process, method, system, product, or device that includes a series of steps or modules (units) is not limited to the listed steps or units, but may also include steps or units not listed, or may include other steps or units inherent to these processes, methods, products, or devices. The terms “connected,” “linked,” “coupled,” and similar words used in this application are not limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect. “Multiple” used in this application refers to two or more. “And / or” describes the relationship between related objects, indicating that three relationships may exist; for example, “A and / or B” can represent: A alone, A and B simultaneously, and B alone. The character " / " generally indicates that the preceding and following objects are in an "or" relationship. The terms "first," "second," and "third" used in this application are merely to distinguish similar objects and do not represent a specific ordering of the objects.

[0021] This application provides a dynamic multi-protocol gateway system for end-to-cloud collaboration. Figure 1 This is a schematic diagram of the structure of a dynamic multi-protocol gateway system for end-to-cloud collaboration according to an embodiment of this application, as shown below. Figure 1 As shown, the system includes a cloud module and a local gateway module; The cloud module is used to parse the received user intent commands to generate device control commands corresponding to the user intent commands; Specifically, the cloud module includes a parsing submodule, a matching submodule, and a generation submodule; The parsing submodule is used to receive user intent commands and parse the device type information and control action information of IoT devices from the user intent commands; It should be noted that this parsing submodule is responsible for parsing instructions—receiving user intent instructions and parsing out the target device and control actions.

[0022] The matching submodule is used to match the device capability information of IoT devices from the device capability model library based on the device type information. Preferably, the matching submodule is used to match the device capability information of the IoT device from the device capability model library based on the device type information (preferably device QR code information), wherein the device capability information includes communication protocol capabilities and device controllable parameters; It should be noted that this matching submodule is responsible for matching protocols and instructions. Based on the device QR code, it matches the device capability information of IoT devices from the device capability model library. The device capability model library stores various device capability models (including protocol capabilities (IR / BLE / WiFi), device type (air conditioner / TV / lighting, etc.), instruction template ID, controllable parameters, and status fields), realizing unified modeling of capability identifiers in device QR codes. Combined with the generation submodule described below, it further realizes the templated generation of device control instructions. If the device type is the same, the control instructions are consistent, simplifying the structured control model.

[0023] The generation submodule is used to generate device control commands corresponding to user intent commands based on control action information and device capability information.

[0024] Preferably, the generation submodule is used to generate control action instructions corresponding to the user's intent instructions based on control action information, communication protocol capabilities, and device controllable parameters. If the IoT device's communication protocol capability is WiFi, then a WiFi forwarding header is added to the generated control action command; if the IoT device's communication protocol capability is Bluetooth, then a Bluetooth forwarding header is added to the generated control action command; if the IoT device's communication protocol capability is infrared, then the generated control action command is mapped to an infrared code and an infrared forwarding header is added.

[0025] It should be noted that the generation submodule is responsible for generating protocol instructions. First, it generates control actions based on control action information (such as "the air conditioner is set to 26°C for cooling") and controllable parameters of the equipment (such as "the temperature adjustment range of the air conditioner is 18°C ​​to 38°C"). Then, it calls the corresponding protocol template in the protocol template library (the protocol template can be in XML, JSON, protobuf, etc.) to generate control action instructions based on the communication protocol capabilities. This realizes the templated generation of equipment control instructions. If the equipment type is the same, the control instructions are consistent, simplifying the structured control model.

[0026] The local gateway module is used to transparently transmit device control commands issued by the cloud module to IoT devices, or to transparently transmit device status information uploaded by IoT devices to the cloud module.

[0027] It should be noted that this local gateway module is a gateway that supports multiple communication protocols. Specifically, it includes: a WiFi communication submodule—supporting TCP / HTTP / MQTT protocols and responsible for sending / receiving WiFi commands; a Bluetooth / BLE Mesh submodule—supporting GATT and Mesh communication and responsible for passing through and relaying BLE device commands; and an infrared transceiver submodule—sending and receiving infrared carrier signals.

[0028] The system provided by this application embodiment realizes that the cloud can uniformly complete instruction parsing, protocol selection and final instruction assembly, and the local gateway only acts as a transparent execution layer, thereby improving the efficiency of dynamic multi-communication protocol control of IoT devices and solving the problem of how to improve the communication efficiency of IoT devices in multi-protocol communication scenarios.

[0029] In some embodiments, the local gateway module includes a WiFi communication submodule, a Bluetooth communication submodule, and an infrared transceiver submodule; The WiFi communication submodule is used to perform WiFi communication between the local gateway module and the cloud module, and to perform WiFi communication between the local gateway module and IoT devices. It supports TCP, HTTP and MQTT protocols. The Bluetooth communication submodule is used to perform Bluetooth communication between the local gateway module and IoT devices, and supports GATT and Mesh protocols. The infrared transceiver submodule is used to perform infrared communication between the local gateway module and IoT devices.

[0030] It should be noted that traditional gateways in the prior art need to parse all protocol instructions locally, and require a large set of instructions, driver libraries and brand and model parsing logic to be pre-built, resulting in large memory consumption and difficulty in updating; while the local gateway module in this embodiment does not need to store infrared code library, GATT table, brand driver library, etc. It is only responsible for the transparent transmission of data (such as instructions, status, infrared waveforms) between IoT devices and the cloud, which greatly reduces the complexity of the gateway.

[0031] In some embodiments, the system also includes Internet of Things (IoT) devices, including WiFi IoT devices, Bluetooth IoT devices, and infrared IoT devices; If the IoT device is a Bluetooth IoT device, the cloud module automatically selects the optimal relay node from the Bluetooth IoT device to broadcast the Mesh data packets based on the Mesh topology of the Bluetooth IoT device; the local gateway module is only responsible for transparently transmitting the instructions issued by the cloud module and does not participate in the calculation. It should be noted that for Bluetooth IoT devices, this embodiment supports Mesh routing: the cloud selects the optimal relay node based on the Mesh topology; the BLE relay node broadcasts Mesh packets, and the gateway is only responsible for transparent transmission and does not participate in the calculation; it also supports dynamic addition and removal of Mesh nodes, and the cloud automatically updates the relay routes.

[0032] If the IoT device package is an infrared IoT device, the local gateway device will transparently transmit the infrared waveform returned by the infrared IoT device to the cloud module; the cloud module will infer the device status of the infrared IoT device based on the infrared waveform and send it back to the local gateway device.

[0033] It should be noted that, Figure 2 This is a flowchart illustrating the infrared state recognition mechanism according to an embodiment of this application, as shown below. Figure 2 As shown, infrared IoT devices themselves cannot transmit status. In this embodiment, status transmission is achieved through a cloud-based infrared waveform recognition engine: the gateway uploads the infrared waveform to the cloud; the cloud uses a brand recognition model and waveform semantic model to infer (such as device operating mode, temperature setting, on / off status, etc.), generates a structured device status object, and sends it to the gateway to achieve near real-time status transmission.

[0034] It should be further noted that the above modules can be functional modules or program modules, and can be implemented through software or hardware. For modules implemented through hardware, the above modules can reside in the same processor; or the above modules can be located in different processors in any combination.

[0035] This application provides a dynamic multi-protocol gateway method for end-to-cloud collaboration. The execution of this method is based on the system provided in the above embodiments. Figure 3 This is a flowchart illustrating the dynamic multi-protocol gateway method for end-to-cloud collaboration according to an embodiment of this application, as shown below. Figure 3 As shown, the method includes: The received user intent command is parsed to generate a device control command corresponding to the user intent command; Transmit device control commands issued by the cloud module to IoT devices transparently, or transmit device status information uploaded by IoT devices to the cloud module transparently.

[0036] The method provided in this application embodiment enables the cloud to uniformly complete instruction parsing, protocol selection, and final instruction assembly, while the local gateway only acts as a transparent execution layer, thereby improving the efficiency of dynamic multi-communication protocol control of IoT devices and solving the problem of how to improve the communication efficiency of IoT devices in multi-protocol communication scenarios.

[0037] It should be noted that the steps shown in the above process or in the flowchart of the accompanying figures can be executed in a computer system such as a set of computer-executable instructions, and although a logical order is shown in the flowchart, in some cases the steps shown or described may be executed in a different order than that shown here.

[0038] This embodiment provides an electronic device including a memory and a processor. The memory stores a computer program, and the processor is configured to run the computer program to perform the steps in any of the above method embodiments.

[0039] Optionally, the electronic device may further include a transmission device and an input / output device, wherein the transmission device is connected to the processor and the input / output device is connected to the processor.

[0040] Optionally, the electronic device may further include a processor, memory, network interface, display screen, and input device connected via a system bus. The processor provides computing and control capabilities. The memory includes non-volatile storage media and internal memory. The non-volatile storage media stores the operating system and computer programs. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage media. The network interface is used to communicate with external terminals via a network connection. When the computer program is executed by the processor, it implements a dynamic multi-protocol gateway method for end-to-cloud collaboration. The display screen may be a liquid crystal display (LCD) or an e-ink display. The input device may be a touch layer covering the display screen, buttons, a trackball, or a touchpad mounted on the device's casing, or an external keyboard, touchpad, or mouse.

[0041] It should be noted that the specific examples in this embodiment can refer to the examples described in the above embodiments and optional implementations, and will not be repeated here.

[0042] Furthermore, in conjunction with the dynamic multi-protocol gateway method for end-to-cloud collaboration in the above embodiments, this application embodiment can provide a storage medium for implementation. The storage medium stores a computer program; when executed by a processor, the computer program implements any one of the dynamic multi-protocol gateway methods for end-to-cloud collaboration in the above embodiments.

[0043] In one embodiment, Figure 4 This is a schematic diagram of the internal structure of an electronic device according to an embodiment of this application, such as... Figure 4 As shown, an electronic device is provided, which can be a server, and its internal structure diagram can be as follows. Figure 4 As shown, the electronic device includes a processor, a network interface, internal memory, and non-volatile memory connected via an internal bus. The non-volatile memory stores an operating system, computer programs, and a database. The processor provides computing and control capabilities, the network interface communicates with external terminals via a network, the internal memory provides an environment for the operating system and computer programs to run, the computer programs are executed by the processor to implement a dynamic multi-protocol gateway method for end-to-cloud collaboration, and the database stores data.

[0044] Those skilled in the art will understand that Figure 4The structure shown is merely a block diagram of a portion of the structure related to the present application and does not constitute a limitation on the electronic device to which the present application is applied. A specific electronic device may include more or fewer components than those shown in the figure, or combine certain components, or have different component arrangements.

[0045] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. This computer program can be stored in a non-volatile computer-readable storage medium. When executed, the computer program can include the processes of the embodiments of the above methods. Any references to memory, storage, databases, or other media used in the embodiments provided in this application can include non-volatile and / or volatile memory. Non-volatile memory may include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory may include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), dual data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), RAMbus direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), etc.

[0046] Those skilled in the art should understand that the technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments have been described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0047] The embodiments described above are merely illustrative of several implementation methods of this application, and while the descriptions are relatively specific and detailed, they should not be construed as limiting the scope of the invention patent. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of this application, and these all fall within the protection scope of this application. Therefore, the protection scope of this patent application should be determined by the appended claims.

Claims

1. A dynamic multi-protocol gateway system for end-to-cloud collaboration, characterized in that, The system includes a cloud module and a local gateway module; The cloud module is used to parse the received user intent command in order to generate a device control command corresponding to the user intent command. The local gateway module is used to transparently transmit device control commands issued by the cloud module to the IoT device, or to transparently transmit device status information uploaded by the IoT device to the cloud module.

2. The system according to claim 1, characterized in that, The cloud module includes a parsing submodule, a matching submodule, and a generation submodule; The parsing submodule is used to receive user intent commands and parse the device type information and control action information of the Internet of Things device from the user intent commands; The matching submodule is used to match the device capability information of the IoT device from the device capability model library based on the device type information; The generation submodule is used to generate a device control command corresponding to the user intent command based on the control action information and the device capability information.

3. The system according to claim 2, characterized in that, The device type information is the device QR code information; The matching submodule is used to match the device capability information of the IoT device from the device capability model library based on the device QR code information, wherein the device capability information includes communication protocol capabilities and device controllable parameters.

4. The system according to claim 3, characterized in that, The generation submodule is used to generate a control action instruction corresponding to the user intent instruction based on the control action information, the communication protocol capability, and the device controllable parameters.

5. The system according to claim 4, characterized in that, The generation submodule is used to generate a control action instruction corresponding to the user intent instruction based on the control action information, the communication protocol capability, and the device controllable parameters. If the communication protocol capability of the IoT device is WiFi communication, a WiFi forwarding header is added to the generated control action command; if the communication protocol capability of the IoT device is Bluetooth communication, a Bluetooth forwarding header is added to the generated control action command; if the communication protocol capability of the IoT device is infrared communication, the generated control action command is mapped to an infrared code and an infrared forwarding header is added.

6. The system according to claim 1, characterized in that, The local gateway module includes a WiFi communication submodule, a Bluetooth communication submodule, and an infrared transceiver submodule; The WiFi communication submodule is used to perform WiFi communication between the local gateway module and the cloud module, and to perform WiFi communication between the local gateway module and IoT devices, supporting TCP protocol, HTTP protocol and MQTT protocol; The Bluetooth communication submodule is used to perform Bluetooth communication between the local gateway module and the IoT device, and supports the GATT protocol and the Mesh protocol. The infrared transceiver submodule is used to perform infrared communication between the local gateway module and the IoT device.

7. The system according to claim 1, characterized in that, The system also includes Internet of Things (IoT) devices, including WiFi IoT devices, Bluetooth IoT devices, and infrared IoT devices.

8. The system according to claim 7, characterized in that, If the IoT device is a Bluetooth IoT device, the cloud module automatically selects the optimal relay node from the Bluetooth IoT device to broadcast Mesh data packets based on the Mesh topology of the Bluetooth IoT device; the local gateway module is only responsible for transparently transmitting the instructions issued by the cloud module and does not participate in the calculation.

9. The system according to claim 7, characterized in that, If the IoT device package is an infrared IoT device, the local gateway device will transparently transmit the infrared waveform returned by the infrared IoT device to the cloud module. The cloud module infers the device status of the infrared IoT device based on the infrared waveform and sends the result back to the local gateway device.

10. A dynamic multi-protocol gateway method for end-to-cloud collaboration, characterized in that, The method is performed based on the system according to any one of claims 1 to 9, and the method includes: The received user intent command is parsed to generate a device control command corresponding to the user intent command; The device control commands issued by the cloud module are transparently transmitted to the IoT device, or the device status information uploaded by the IoT device is transparently transmitted to the cloud module.

Images