CONTROL device for controlling IoT device based on matter, method for operating CONTROL device, and system for controlling IoT device based on matter

Abstract

A method of operation of a control device is disclosed. A method of operation of a control device for controlling an IoT device based on matter according to the present invention comprises the steps of: receiving device information of the IoT device obtained by a mobile terminal performing a first process of commissioning from the mobile terminal; and completing the commissioning by performing a second process of commissioning for the IoT device using the device information.

Description

Technology Field

[0001] The present invention relates to a control device that controls an IoT device based on matter, a method of operation of the control device, and a system that controls an IoT device based on matter, wherein two devices perform the commissioning process in a dual manner so that the control device installed in the home can directly control the IoT device. Background Technology

[0002] Matter is a next-generation home IoT standard that enables interoperability and control between devices via IP-based communication, and the standard technology was first released in October 2022. Existing IoT technologies lacked interoperability between companies due to the absence of standards at the application layer, but Matter is characterized by ensuring compatibility of IoT devices as it is standardized up to the application layer.

[0003] In other words, previously, accommodating new IoT devices required the development of platform integration between Company A's server (which interacts with the terminal controlling the IoT device) and Company B's server (which interacts with the IoT device). However, due to the standardization of inter-device integration through Matter, IoT devices certified by Matter now interact via a standard method, making it possible for individuals to directly purchase Company B's IoT device and register it on Company A's IoT platform. The problem to be solved

[0004] The objective of the present invention is to provide a control device that controls an IoT device based on matter, a method of operation of the control device, and a system that controls an IoT device based on matter, wherein two devices perform the commissioning process in a dual manner so that the control device can directly control the IoT device from a control device installed in the home. means of solving the problem

[0005] A method of operation of a control device for controlling an IoT device based on matter according to the present invention comprises the steps of: receiving device information of the IoT device obtained by the mobile terminal performing a first process of commissioning from the mobile terminal; and completing the commissioning by performing a second process of commissioning for the IoT device using the device information.

[0006] In this case, the first process performed by the mobile terminal includes obtaining device information of the IoT device and pairing with the IoT device, and the second process performed by the control device may include authentication of the IoT device using the device information and setting up a connection with the IoT device.

[0007] Meanwhile, pairing with the above-mentioned IoT device is performed through short-range wireless communication between the mobile terminal and the IoT device, and connection setting with the IoT device can be performed through IP communication between the control device and the IoT device.

[0008] Meanwhile, the above device information can be obtained by the mobile terminal photographing the tag of the IoT device.

[0009] Meanwhile, the above control device may not support video recording and short-range wireless communication.

[0010] Meanwhile, if authentication of the above-mentioned IoT device is successful, the method may further include the step of transmitting network information to the above-mentioned IoT device through the mobile terminal to join the above-mentioned IoT device to the network.

[0011] Meanwhile, the step of completing the above commissioning may include the step of verifying the device certificate of the IoT device and generating a signing key when IP communication with the IoT device is established.

[0012] In this case, the above signature key can be stored in the TEE area of ​​the control device.

[0013] Meanwhile, the method further includes the step of generating a control command using the above signature key and transmitting the control command to the IoT device, wherein the signature key may not be shared with the mobile terminal.

[0014] Meanwhile, the step of completing the above commissioning may include the step of switching the Mac of the control device to the Mac of the mobile terminal to perform connection settings with the IoT device.

[0015] Meanwhile, the above control device may be a set-top box installed in the home.

[0016] Meanwhile, the method of operation of a system for controlling an IoT device based on matter according to the present invention comprises the steps of: a mobile terminal acquiring device information of the IoT device by performing a first commissioning process and transmitting said device information; and a control device receiving said device information and completing said commissioning by performing a second commissioning process for the IoT device using said device information.

[0017] In this case, the first process performed by the mobile terminal includes obtaining device information of the IoT device and pairing with the IoT device, and the second process performed by the control device may include authentication of the IoT device using the device information and setting up a connection with the IoT device.

[0018] Meanwhile, pairing with the above-mentioned IoT device is performed through short-range wireless communication between the mobile terminal and the IoT device, and connection setting with the IoT device can be performed through IP communication between the control device and the IoT device.

[0019] Meanwhile, the step of acquiring device information of the IoT device by the mobile terminal performing the first process of commissioning may include the step of acquiring the device information by the mobile terminal photographing the tag of the IoT device.

[0020] Meanwhile, the above control device may not support video recording and short-range wireless communication.

[0021] Meanwhile, if the control device succeeds in authenticating the IoT device, it may further include the step of transmitting network information to the mobile terminal to join the IoT device to a network, and the step of the mobile terminal transmitting the network information to the IoT device through short-range wireless communication between the mobile terminal and the IoT device.

[0022] Meanwhile, the step of completing the above commissioning may include the step of verifying the device certificate of the IoT device and generating a signing key when IP communication with the IoT device is established.

[0023] Meanwhile, a control device for controlling an IoT device based on matter according to the present invention includes a communication unit that receives device information of the IoT device obtained by the mobile terminal performing a first process of commissioning from the mobile terminal, and a control unit that completes the commissioning by performing a second process of commissioning for the IoT device using the device information.

[0024] Meanwhile, a system for controlling an IoT device based on matter according to the present invention includes a mobile terminal that acquires device information of the IoT device by performing a first process of commissioning and transmits the device information, and a control device that receives the device information and completes the commissioning by performing a second process of commissioning for the IoT device using the device information. Brief explanation of the drawing

[0025] Figure 1 is a diagram illustrating a method of controlling IoT devices before the advent of Matter. Figure 2 is a diagram illustrating a current method of controlling an IoT device based on matter. Figures 3 and 4 are diagrams illustrating potential problems that may occur when an in-home terminal directly controls an IoT device. FIG. 5 is a diagram illustrating a system for controlling an IoT device based on matter according to the present invention. FIG. 6 is a block diagram illustrating the components of a control device according to the present invention. FIG. 7 is a flowchart illustrating the operation method of a system for controlling an IoT device based on matter according to the present invention. FIG. 8 is a flowchart for specifically explaining the operation of a mobile terminal and a control device. FIG. 9 is a flowchart illustrating a method for a control device to directly control an IoT device according to the present invention. Specific details for implementing the invention

[0026] Hereinafter, embodiments disclosed in this specification will be described in detail with reference to the attached drawings. Identical or similar components regardless of drawing symbols will be assigned the same reference number, and redundant descriptions thereof will be omitted. The suffixes "module" and "part" used for components in the following description are assigned or used interchangeably solely for the ease of drafting the specification and do not inherently possess distinct meanings or roles. Furthermore, in describing embodiments disclosed in this specification, if it is determined that a detailed description of related prior art could obscure the essence of the embodiments disclosed in this specification, such detailed description will be omitted. Additionally, the attached drawings are intended only to facilitate understanding of the embodiments disclosed in this specification; the technical concept disclosed in this specification is not limited by the attached drawings, and it should be understood that they include all modifications, equivalents, and substitutions that fall within the spirit and technical scope of the present invention.

[0027] Terms including ordinal numbers, such as first, second, etc., may be used to describe various components, but said components are not limited by said terms. These terms are used solely for the purpose of distinguishing one component from another.

[0028] When it is stated that one component is "connected" or "connected" to another component, it should be understood that while it may be directly connected or connected to that other component, there may also be other components in between. On the other hand, when it is stated that one component is "directly connected" or "directly connected" to another component, it should be understood that there are no other components in between.

[0029] The singular expression includes the plural expression unless the context clearly indicates otherwise. In this application, terms such as “comprising” or “having” are intended to specify the existence of the features, numbers, steps, actions, components, parts, or combinations thereof described in the specification, and should be understood as not precluding the existence or addition of one or more other features, numbers, steps, actions, components, parts, or combinations thereof.

[0030] For convenience of explanation in implementing the present invention, the components may be described in detail; however, these components may be implemented within a single device or module, or a single component may be divided and implemented across multiple devices or modules.

[0031] In matter-based services, controlling IoT devices requires a process of registering them, and this registration process is called commissioning. Furthermore, the entity performing commissioning is called a commissioner.

[0032] In matter-based services, the process of controlling IoT devices is referred to as "Control," and the entity performing this is called the "Controller."

[0033] Figure 1 is a diagram illustrating a method of controlling IoT devices before the advent of Matter.

[0034] Referring to FIG. 1, existing IoT technologies such as Zigbee and Z-wave have a separate IoT router (600), and this IoT router performs the role of both a commissioner and a controller. Even if a mobile terminal (200) (e.g., a smartphone) performs pairing with an IoT device by scanning the QR code of the IoT device (310), the IoT router (600) ultimately connects with the IoT device as both a commissioner and a controller. That is, the IoT router (600) acts as the entity (commissioner) that registers the IoT device (310) and also acts as the entity (controller) that directly controls the IoT device (310), performing the role of transmitting control commands to the IoT device (310).

[0035] Additionally, if the mobile terminal (200) or the in-home terminal (5) (e.g., a set-top box) is connected to the IOT router (600) through various networks, both the mobile terminal (200) and the in-home terminal (5) can indirectly control the IOT device (310) through the IOT router (600). That is, the mobile terminal (200) or the in-home terminal (5) transmitted a command to the IOT router (600) to control the IOT device (310), and the IOT router (600) performed the role of interpreting or converting the received command and transmitting it to the IOT device (310).

[0036] However, in existing Zigbee and Z-wave based IoT services, there is no standard for connecting a mobile terminal (200) or a home terminal (5) to an IoT device (310), so it was essential to develop platform linkage between Company A's server (server (500) linked to the mobile terminal (200) or home terminal (5)) and Company B's server (server linked to the IoT device (310)).

[0037] Figure 2 is a diagram illustrating a current method of controlling an IoT device based on matter.

[0038] In a Matter-based IoT service, there is a standard for connecting a mobile terminal (200) or a home terminal (5) to an IoT device (310), so when the mobile terminal (200), the home terminal (5), and the IoT device (310) are manufactured according to the standard (or when an app according to the standard is installed), it is possible for the mobile terminal (200) or the home terminal (5) to directly control the IoT device (310) through Company A's server (500) (i.e., without the participation of Company B's server).

[0039] In Matter-based IoT services, there is no IoT router, and IP communication with IoT devices (310) is performed. That is, since devices in Matter operate based on IP, services are possible without a separate gateway device (IOT router (600)) as in Zigbee. Since communication with IoT devices is performed via IP-based WiFi or Thread, which is low-power IP communication, user convenience is improved compared to the existing Zigbee.

[0040] Meanwhile, in order to perform commissioning for the IoT device (310), pairing with the IoT device (310) is required. Specifically, it is necessary to photograph the QR code attached to the IoT device (310), obtain device information of the IoT device (310) using the information extracted from the QR code, and perform pairing with the IoT device (310).

[0041] In the case of a home terminal (5) (e.g., a set-top box), it is common for a camera not to be installed due to increased costs and user resistance to mounting a camera on the home terminal (5) (e.g., concerns about privacy infringement due to hacking), and it is common for a short-range wireless communication module (e.g., Bluetooth, BLE, etc.) not to be installed due to increased costs. Therefore, the user takes a picture of the IoT device (310) using a mobile terminal (200) (e.g., a smartphone) and pairs the mobile terminal (200) with the IoT device (310) via short-range wireless communication. In this case, the mobile terminal (200) performs commissioning for the IoT device (310) to register the IoT device (310), and accordingly, the mobile terminal (200) performs the role of a commissioner and a controller. That is, since the mobile terminal (200) that performed the commissioning becomes the controller, the mobile terminal (200) becomes the entity that directly controls the IoT device (310), and the in-home terminal (5) cannot control the IoT device (310).

[0042] For example, a home terminal (5) (e.g., a set-top box) is installed in the living room of the house, and the user may want to control an IoT device (310) (e.g., a light bulb, a switch, a plug, etc.) through remote control input, voice input, etc., to the home terminal (5) (e.g., a set-top box). As another example, if we assume that the father's smartphone acts as the commissioner and controller, other family members (mother, son, daughter, etc.) may want to control an IoT device (310) (e.g., a light bulb, a switch, a plug, etc.) through their own smartphones. Previously, in Zigbee and Z-wave based IoT services, indirect control through an IoT router (600) was possible, but in Matter-based IoT services, the commissioner and controller became a specific mobile terminal (200), so there was a problem in that indirect control in this manner was impossible.

[0043] Figures 3 and 4 are diagrams illustrating potential problems that may occur when an in-home terminal directly controls an IoT device.

[0044] When a mobile terminal (200) performs commissioning with an IoT device (310) according to the material specifications, a device certificate is verified between the mobile terminal (200) and the IoT device (310), and a signing key is generated based on the verified device certificate. In order to directly control the IoT device (310), the entity intending to control the IoT device (310) must possess the signing key. Currently, the entity possessing the signing key is the mobile terminal (200).

[0045] One method to directly control the IoT device (310) through the home terminal (5) is for the mobile terminal (200), which has obtained a signature key by performing commissioning with the IoT device (310) (S410 in FIG. 4), to transmit the signature key to the home terminal (50). However, in the process of transmitting the signature key from the mobile terminal (200) to the home terminal (5), it passes through a router (400) (e.g., a home Wi-Fi terminal) and a server (500) linked to the mobile terminal (200) (hereinafter referred to as the “Home IoT Platform Server (500)”) (S420, S430, S440 in FIG. 4). In this process, a problem may occur in which the signature key is leaked to the outside due to reasons such as hacking or negligence in management by the Home IoT Platform Server (500).

[0046] In addition, even if we assume a situation where the signature key is safely delivered to the in-home terminal (5), the signature key is held by multiple entities (in-home terminal (5) and mobile terminal (200)), which increases the possibility of leakage compared to when a single entity holds the signature key.

[0047] In addition, in current matter-based IoT services, the entity holding the signing key is basically the mobile terminal (200). Attackers generally target the mobile terminal (200) as their primary target, and since the installation and removal of various apps on the mobile terminal (200) are repeated, there is a problem that the mobile terminal (200) is at high risk of hacking. For example, unauthenticated apps or apps from unknown sources may be installed, causing the mobile terminal (200) to be hacked, and the IoT device may be controlled through the hacked mobile device. In reality, issues such as the leakage of CCTV footage in the home and unauthorized control of the IoT device frequently occur in real life due to hacking of the IoT device.

[0048] To solve such problems, the present invention enables the control device installed in the home to directly control the IoT device by having two devices (mobile terminal (200) and control device (100)) perform the commissioning process in a dual manner.

[0049] The above description of matter-based IoT services may also be applied to the following, to the extent that it is not contradictory.

[0050] FIG. 5 is a diagram illustrating a system for controlling an IoT device based on matter according to the present invention.

[0051] A system for controlling an IoT device based on matter may include a control device (100) and a mobile terminal (200).

[0052] The control device (100) can control the IoT device (310) based on matter. That is, both the control device (100) and the IoT device (310) can perform various operations according to the matter specifications.

[0053] A control device (100) is installed in a home and can communicate with one or more IoT devices installed in the home and control one or more IoT devices. An example of a control device (100) may be a set-top box that provides IPTV services, but is not limited thereto.

[0054] The control device (100) is connected to a home router (400) (e.g., a home Wi-Fi terminal) via Ethernet and can perform IP communication with one or more IoT devices through the router (400). The control device (100) may be connected to the router (400) via Ethernet, but is not limited thereto, and the control device (100) may be equipped with a Wi-Fi module and connected to the router (400) via Wi-Fi.

[0055] When a Wi-Fi chip is installed in an IoT device, the IoT device can be connected to a router (400) via Wi-Fi. In this case, the control device (100) can perform IP communication with the IoT device (310) through the router (400).

[0056] Additionally, a thread chip can be installed in an IoT device due to its advantages of being small, low-power, and low-cost compared to Wi-Fi. In this case, the control device (100) can also have a thread chip embedded and perform thread-based IP communication with the IoT device (320). Instead of embedding the thread chip in the control device (100), a separate device (300) (e.g., a USB dongle) consisting of a thread chip and an antenna may be connected to the control device (100).

[0057] The control device (100) may have an app installed to implement the operation of a Commissioner and an app installed to implement the operation of a Controller.

[0058] In addition, a program that always runs in the background of the control device (100) to implement a virtual commission can be installed in the form of firmware, and this can be named Virtual Commission Daemon.

[0059] In addition, when a separate device (300) (e.g., a USB dongle) consisting of a thread chip and an antenna is connected, a thread border router for controlling the separate device (300) may be installed in the form of firmware.

[0060] The mobile terminal (200) may include a smartphone, a tablet PC, etc. The mobile terminal (200) may include a communication unit for communicating with an external device through one or more networks, a control unit for controlling the overall operation of the mobile terminal (200), and a memory for storing data. In addition, the mobile terminal (200) may include general components of a smartphone or tablet PC (touchpad, sound output unit, display, etc.).

[0061] The mobile terminal (200) can communicate with the control device (100) or the IoT device (310, 320) by being directly connected to the router (400) via Wi-Fi. However, it is not limited to this, and the mobile terminal (200) can communicate with the control device (100) or the IoT device (310, 320) through an external network (5G, LTE, etc.) and the router (400).

[0062] Additionally, the communication unit of the mobile terminal (200) may include a short-range wireless communication module. The short-range wireless communication module supports short-range wireless communication such as Bluetooth (BL) and Bluetooth Low Energy (BLE), and the mobile terminal (200) can be paired with an IoT device (310) through the short-range wireless communication module.

[0063] The mobile terminal (200) may include a shooting unit composed of one or more cameras. The mobile terminal (200) may use one or more cameras to photograph a QR code of an IoT device (310) and extract device information of the IoT device (310) from the photographed QR code.

[0064] An app that supports IoT may be installed on the mobile terminal (200). This app can analyze a captured QR code to extract device information and generate a virtual token using the device information of the IoT device (310) and the terminal information of the mobile terminal (200) (e.g., the mobile terminal's Mac, device name, etc.).

[0065] An app that extracts device information by analyzing a captured QR code may be referred to as a Device Analysis System. Additionally, an app that generates a virtual token may be referred to as a Virtual Token Generation System. The control unit of the mobile terminal (200) may include a Device Analysis Module that performs the role of a Device Analysis System and a Token Generation Module that performs the role of a Virtual Token Generation System.

[0066] A system for controlling IoT devices based on matter may include one or more IoT devices (310, 320). The IoT devices are installed in a home and may include, for example, sensors, plugs capable of being turned on / off by external control, light bulbs, switches, home appliances (air conditioners, TVs, refrigerators, microwave ovens, induction cooktops, etc.), CCTVs, etc.

[0067] Just like the control device (100), the IoT device (310, 320) can also follow the material specifications. Therefore, even though the manufacturer of the control device (100) and the manufacturer of the IoT device are different, the IoT device can directly interpret and execute the control command transmitted by the control device (100).

[0068] The IoT device (310, 320) can be connected to a router (400) (e.g., a Wi-Fi terminal in the home) and can communicate with the control device (100) through the router (400). Additionally, as previously described, the IoT device includes at least one of a Wi-Fi chip or a thread chip and can perform at least one of Wi-Fi-based IP communication or thread-based IP communication with the control device (100).

[0069] Additionally, the IoT device (310, 320) may include a short-range wireless communication module (e.g., Bluetooth, BLE, etc.). In this case, the IoT device (310, 320) can perform short-range wireless communication with the mobile terminal (200).

[0070] A system for controlling IoT devices based on matter may further include a home IoT platform server (500). The home IoT platform server (500) can serve as a medium through which a mobile terminal (200) and a control device (100) can communicate with each other (more specifically, an app supporting IoT of the mobile terminal (200) and a Virtual Commission Daemon of the control device (100)). For example, the home IoT platform server (500) holds subscriber information (information regarding subscribers' mobile terminals and in-home terminals), and when the mobile terminal (200) transmits a control command, it can transmit the control command to the control device (100).

[0071] FIG. 6 is a block diagram illustrating the components of a control device according to the present invention.

[0072] The control device (100) according to the present invention may include a communication unit (110), a control unit (120), and a memory (130).

[0073] The communication unit (110) provides an interface for connecting the control device (100) to a wired / wireless network including the internet network and can perform communication with an external device. Additionally, the communication unit (110) is wired to a router (400) via Ethernet and can perform IP communication with external devices such as a mobile terminal (200), an IoT device (310, 320), and a home IoT platform server (500) through the router (400). However, it is not limited to this, and the communication unit (110) may also perform communication with an external device through other methods.

[0074] In addition, when a USB dongle (300) is connected to a control device (100), the communication unit (110) may include an interface for connecting the USB dongle.

[0075] Meanwhile, the control device (100) may not support short-range wireless communication such as Bluetooth or BLE. That is, the control device (100) cannot pair with an IoT device via short-range wireless communication and can only communicate with the IoT device via IP communication.

[0076] The control unit (110) includes one or more processors and can control the overall operation of the control device (100).

[0077] One or more programs, applications, firmware, etc., operating in the control device (100) can perform their functions in conjunction with the control unit (110). Therefore, the operation of the application or firmware described below can also be viewed as the operation of the control unit (110).

[0078] The control unit (120) may include a commissioner module (121) that executes the operation of a commissioner, a controller module (122) that executes the operation of a controller, and a virtual commission module (123) that executes the operation of a Virtual Commission Daemon.

[0079] The memory (130) can store programs, applications, firmware, other commands, etc., necessary for the operation of the control device (100).

[0080] The control device (100) further includes an input unit (not shown), and the input unit (not shown) can receive input from a user. For example, the input unit (not shown) may include a communication module that receives a remote control signal, an input button, etc., and can receive user input. As another example, the input unit (not shown) may include a microphone and can receive voice input from a user.

[0081] Meanwhile, the control device (100) may be a content output device.

[0082] A content output device may refer to a device that receives and decodes a transmission stream and outputs content. A content output device may be a set-top box that outputs (transmits) content to a display device (e.g., a TV), but is not limited thereto, and may also be a display device (e.g., a TV) that directly outputs content (display and sound output). If the content output device is a set-top box, the content output device may further include an interface such as an HDMI port and output content to a display device through the interface.

[0083] When the control unit (100) is implemented as a content output device, the communication unit (110) can transmit or receive data to or from a broadcast server through a connected network or another network linked to the connected network. Additionally, the communication unit (not shown) can receive a transmission stream from the broadcast server. Additionally, the communication unit (110) can be connected to a display device via an HDMI cable to transmit content to the display device.

[0084] When the control device (100) is implemented as a content output device, the memory (130) may include a security area. Specifically, the SoC chip of the control device (100) (content output device) may have a memory area (Trusted Execution Environment, TEE) that is inaccessible from the outside, and such a TEE area is generally set up to prevent illegal leakage of content due to hacking. In the present invention, the device certificate or signature key can be safely protected by processing or storing it in the security area.

[0085] Meanwhile, the control device (100) may not support video recording. That is, the control device (100) is not equipped with a camera, and as a result, the control device (100) may not be able to capture the QR code of the IOT device (310).

[0086] FIG. 7 is a flowchart illustrating the operation method of a system for controlling an IoT device based on matter according to the present invention.

[0087] As previously explained, commissioning is a process of registering an IoT device, and commissioning includes obtaining device information of the IoT device, pairing with the IoT device via short-range wireless communication, authentication of the IoT device, and establishment of a connection with the IoT device. Furthermore, in the present invention, the commissioning process can be dualized and performed by two devices (a mobile terminal (200) and a control device (100)). Specifically, the first process of commissioning (obtaining device information of the IoT device and pairing with the IoT device) can be performed by the mobile terminal (200), and the second process of commissioning (authentication of the IoT device using device information and establishment of a connection with the IoT device) can be performed by the control device (100).

[0088] A system for controlling an IoT device based on matter may include the steps of: a mobile terminal (200) acquiring device information of an IoT device (310) and transmitting device information by performing a first commissioning process (S710, S720); and a control device (100) receiving device information and completing commissioning by performing a second commissioning process for the IoT device using device information (S730).

[0089] FIG. 8 is a flowchart for specifically explaining the operation of a mobile terminal and a control device.

[0090] The IoT device (310) can be switched to an advertising mode (S805). For example, the IoT device (310) can be switched to an advertising mode by a switching method defined by the manufacturer (e.g., a method in which a user presses the power button of the IoT device for 3 seconds or more). In this case, the IoT device (310) can activate a short-range wireless communication module (e.g., a BLE module).

[0091] Next, the mobile terminal (200) can perform the acquisition of device information during the first process of commissioning (S710).

[0092] When an IoT device (310) is certified as an official Matter Commissionee by the Connectivity Standards Alliance (CSA), a tag for commission (e.g., a QR code) can be attached to the IoT device. Then, the user can take a picture of the tag of the IoT device (310) using their mobile terminal (200).

[0093] Here, the tag may be a QR code, but is not limited thereto, and can be implemented in various forms capable of inserting device information. Additionally, the tag may be attached to the IoT device (310), but is not limited thereto, and the IoT device (310) itself may be implemented in a way that displays the tag (e.g., by displaying the tag on a screen). Furthermore, the tag may be displayed on other objects other than the IoT device (310) (e.g., the packaging box of the IoT device (100), an instruction manual, other electronic devices, etc.). The following description assumes that the tag is a QR code.

[0094] The mobile terminal (200) can capture a QR code of an IoT device (S810). In this case, the device analysis module (221) of the mobile terminal (200) can obtain device information of the IoT device (310) from the QR code in the captured image (S815). The device information extracted from the QR code may include the serial number of the IoT device, the communication mode supported by the IoT device (e.g., WiFi, Thread, etc.), the vendor ID, product ID, product name, device ID, group ID, etc. Once the device information of the IoT device is obtained, the device analysis module (221) of the mobile terminal (200) can transmit the device information to the token generation module (222) of the mobile terminal (200) (S820).

[0095] In this case, the token generation module (222) of the mobile terminal (200) can transmit device information to the control device (100) (S720).

[0096] In one embodiment, the token generation module (222) of the mobile terminal (200) generates a virtual token including device information of the IOT device (310) and terminal information of the mobile terminal (200) (e.g., the MAC, device name, etc. of the mobile terminal) (S825), and can transmit the generated virtual token to the control device (100) (S840). In this case, the virtual token can be transmitted to the control device (100) through the home IOT platform server (500) and the router (400).

[0097] Meanwhile, the mobile terminal (200) can perform pairing with the IoT device (310) during the first process of commissioning (S710). Specifically, the device analysis module (221) of the mobile terminal can search for nearby IoT devices by performing short-range wireless communication (e.g., BLE communication). When an IoT device (310) is found, the device analysis module (221) and the IoT device (310) can share their identification information (e.g., MAC, serial number, etc.) with each other (S830). If the identification information of the found IoT device (310) matches the device information extracted from the QR code earlier, the device analysis module (221) can pair the mobile terminal (200) with the IoT device (310) (S835). Pairing between the mobile terminal (200) and the IoT device (310) can be performed via short-range wireless communication (e.g., BLE communication) between the mobile terminal (200) and the IoT device (310).

[0098] In this way, the first process of the entire commissioning process (acquisition of device information of the IoT device and pairing with the IoT device) was performed by the mobile terminal (200), and the device information was transmitted to the control device (100) for the second process of commissioning. Below, a method (S730) for completing commissioning by the control device (100) performing the second process of commissioning for the IoT device using the device information is described.

[0099] The virtual commission module (123) of the control device (100) can receive device information of an IoT device obtained by the mobile terminal (200) performing a first commissioning process from the mobile terminal (200). Specifically, the virtual commission module (123) can receive a virtual token from the mobile terminal (200) and extract device information of an IoT device from the received virtual token.

[0100] In this case, the virtual commission module (123) switches to commission mode (S845) and can transmit device information of the IOT device to the commissioner module (121) (S850).

[0101] Next, the control device (100) can perform authentication of the IoT device (310) during the second process of commissioning. Specifically, the commissioner module (121) of the control device (100) can perform authentication of the IoT device (310) using the device information of the IoT device. More specifically, the commissioner module (121) can use the device information to verify whether the IoT device (310) is a product that has received official certification from the Connectivity Standards Alliance (CSA) (S855). This process can be performed according to the Matter standard.

[0102] When authentication of the IoT device (310) is successful (when it is confirmed that the IoT device (310) is a product that has received official certification), the control unit (120) of the control device (100) can transmit network information to the IoT device (310) via a mobile terminal (200) to join the IoT device to the network (S860). Here, the network is a network for connecting the control device (100) and the IoT device (310) via IP communication, and the control device (100) and the IoT device (310) can form a network through a router (400). Accordingly, the commissioner module (121) of the control device (100) can transmit network information (identification information for the router to which the control device (100) is connected). In this case, the virtual commission module (123) can receive network information from the commissioner module (121) and then transmit the network information so that the network information is transmitted to the IoT device (310).

[0103] Meanwhile, the current IoT device (310) has not established a connection with the router (400), and only short-range wireless communication with the mobile terminal (200) has been established. Therefore, in order to transmit network information to the IoT device (310), the virtual commission module (123) of the control device (100) can transmit network information to the mobile terminal (200). In this case, the network information can be transmitted to the mobile terminal (200) through the router (400) and the home IoT platform server (500).

[0104] The device analysis module (221) of the mobile terminal (200) receives network information and can transmit the received network information to the IoT device (310) (S865). In this case, the mobile terminal (200) can transmit the network information through short-range wireless communication (e.g., BLE communication) between the mobile terminal (200) and the IoT device (310).

[0105] The IoT device (310) receives network information and can connect itself to a router (400) (i.e., the router (400) to which the current control device (100) is connected) using the received network information. Accordingly, the IoT device (310) is assigned an IP address (specifically, an IPv6 address) from the router (400), and accordingly, the IoT device (310) participates in the network and performs IP communication with the control device (100).

[0106] When a network is configured in which the IoT device (310) and the control device (100) participate, the control device (100) can perform connection setup with the IoT device (310) during the second process of commissioning. In this case, the control device (100) can perform connection setup with the IoT device (310) through IP communication between the control device (100) and the IoT device.

[0107] The connection setup between the control device (100) and the IoT device can be performed according to the material specifications. Specifically, the control device (100) attempts commissioning using the device information of the IoT device (310) (S870), exchanges a network join success message with the IoT device (310) (S880), verifies the device certificate of the IoT device, and generates a signature key (S885). Accordingly, a secure channel is created between the IoT device (310) and the control device (100), and commissioning for the IoT device (310) can be completed (S890).

[0108] Meanwhile, in the preceding S830 step, the mobile terminal (200) shared its identification information (e.g., MAC) with the IoT device (310) for pairing. The IoT device (310) believes that it is connected to the device (mobile terminal (200)) that was initially connected to it, but in reality, the control device (100) is attempting commissioning. Therefore, if the control device (100) attempts commissioning while presenting its own MAC, commissioning cannot be successful.

[0109] As previously explained, the virtual commission module (123) of the control device receives a virtual token from the mobile terminal (200) and, accordingly, holds the terminal information (MAC of the mobile terminal) of the mobile terminal (200) included in the virtual token. The commissioner module (121) attempts to commission using the MAC of the control device (100) (S870), but the control device (100) is always configured to communicate with the IoT device (310) through the virtual commission module (123) (i.e., the Virtual Commission Daemon of the firmware), and accordingly, the commission attempt of the commissioner module (121) can be transmitted to the virtual commission module (123). In this case, the virtual commission module (123) can perform connection setup with the IoT device (310) by converting the MAC of the control device (100) to the MAC of the mobile terminal (200) (S875). Accordingly, the control device (100) can present identification information including the MAC of the mobile terminal to the IoT device (310) and perform the exchange of network join success messages (S880), verification of the device certificate, and generation of a signing key (S885). In addition, the control device (100) can store the device certificate and the signing key in memory (130).

[0110] The virtual commission module (123) (Virtual Commission Daemon) can operate as a daemon that always runs in the background in the firmware of the control device (100). Accordingly, when the commissioner module (121) or the controller module (122) communicates with the IoT device (310), the virtual commission module (123) (Virtual Commission Daemon) can always act as an intermediary and switch the MAC of the control device (100) to the MAC of the mobile terminal (200).

[0111] Meanwhile, the signature key is required for the process of controlling the IOT device (310) later, and the control unit (120) can store the signature key generated in S885 in memory (130). In this case, the control unit (120) can store the signature key in the TEE (Trusted Execution Environment) area of ​​memory (130). As previously explained, the TEE area is an area that ensures the protection of code and data loaded within that area, and by storing the signature key in the TEE area, protection against hacking from the outside can be achieved. Additionally, when the control device (100) boots up, it identifies whether the app is signed, and apps with unclear origins or those that are unsafe are arbitrarily uninstalled, thereby safely protecting the signature key from hacking attempts from the outside. The device certificate can also be stored in the TEE area.

[0112] FIG. 9 is a flowchart illustrating a method for a control device to directly control an IoT device according to the present invention.

[0113] According to the Matter standard, IP communication is used for the control and monitoring of the IoT device (310). Therefore, just as the control device (100) and the IoT device (310) performed IP communication during the commissioning process described above, IP communication is also performed during the process in which the control device (100) controls or monitors the IoT device (310) after the commissioning is completed. Therefore, the control device (100) does not need to support short-range wireless communication such as Bluetooth or BLE.

[0114] When user input is received through the input section of the control device (100) (for example, when a user in the home operates a remote control to input OFF the light), the controller module (122) of the control device (100) can generate a control command and transmit it to the IOT device (310) (S910). At this time, the control device (100) can generate the control command using a signature key stored in the TEE area. The generated control command can be transmitted to a virtual commission module (123) (Virtual Commission Daemon) running in the background.

[0115] In this case, the virtual commission module (123) can switch the MAC of the control device (100) to the MAC of the mobile terminal (200) (S920) and transmit a control command to the IoT device (310) (S930). In this case, the control command can be transmitted to the IoT device (310) through the router (400), and the mobile terminal (200) does not intervene in the transmission of the control command. The IoT device (310) that receives the control command verifies the signature key, and if the signature key is verified, can perform an operation according to the control command.

[0116] As previously explained, the signature key is generated and stored in the control device (100) and may not be shared with the mobile terminal (200). Therefore, the mobile terminal (200) only performed the acquisition of device information and pairing via short-range wireless communication during the first process of commissioning, and does not possess the signature key. Consequently, the mobile terminal (200) cannot directly control the IoT device (310).

[0117] However, the mobile terminal (200) or another mobile terminal can indirectly control the IoT device (310) through the control device (100) (for example, family members input to turn off the lights through an app on their mobile phones). Specifically, the mobile terminal (200) or another mobile terminal can transmit a command to the control device (100) to control the IoT device (310), and this command can be transmitted to the control device (100) via an internet network or a home network. Since the command can be transmitted via an internet network, it is possible for the mobile terminal (200) or another mobile terminal to control the IoT device (310) from the outside.

[0118] The control device (100) receives a command from a mobile terminal (200) or another mobile terminal, generates a control command using the received command and a signature key it possesses (S910), and then performs the operations of S920 and S930. In this way, other devices other than the control device (100) can indirectly control the IoT device (310) through the control device (100).

[0119] A control device (100), such as a set-top box, can be installed in the home to easily receive user input and can also operate in conjunction with a mobile phone of a family member located inside or outside the home. Therefore, it can be said that the ideal form of a matter service is for the control device (100) installed in the home to be the entity directly controlling the IoT device.

[0120] In addition, according to the present invention, the entire process of commissioning is bifurcated so that the first process of commissioning, performed via short-range wireless communication, is performed by a mobile terminal, and the second process of commissioning, performed via IP communication, is performed by a control device, thereby allowing the control device to perform the role of both commissioner and controller. Accordingly, the control device (100) installed in the home instead of the mobile terminal becomes the entity that directly controls the IoT device, thereby improving user convenience. Furthermore, since the control device (100) directly controls the IoT device, there is an advantage that the mobile terminal (200) (e.g., the father's mobile phone that performed the first process of commissioning) or other mobile terminals (e.g., the mother's, son's, or daughter's mobile phones) can indirectly control the IoT device through the control device (100). For example, according to the present invention, a user watching TV in the living room can turn off the light by transmitting user input to the control device (100) via a remote control or voice, or one of the family members who left the house without turning off the light can turn off the light by transmitting a command to the control device (100) via their mobile phone.

[0121] According to the present invention, the first process of commissioning is performed by a mobile terminal, and the second process of commissioning, which is performed via IP communication, is performed by a control device. The control device converts its own MAC address to the MAC address of the mobile terminal and performs IP communication with the IoT device. The first process requires short-range wireless communication (e.g., BLE) and a camera. The mobile terminal is already equipped with a chip for Bluetooth or BLE communication to support Bluetooth earphones, and a camera is also already equipped. That is, the present invention has the advantage that by performing the first process through a mobile terminal capable of supporting short-range wireless communication, the Matter service can be implemented even on existing in-home terminals (e.g., set-top boxes) that do not support cameras or short-range wireless communication.

[0122] In Matter, since the IoT device and the entity controlling the IoT device must be in the same network fabric, in existing Matter services, when registering or controlling an IoT device with a mobile terminal, the mobile terminal had to be connected to the same router as the IoT device (i.e., the same Wi-Fi network). However, according to the present invention, since the entity controlling the IoT device is a control device within the home, as long as the control device is connected to a router, there is an advantage that the IoT device can be registered or controlled even when the mobile terminal is connected through an external network (5G, LTE, etc.).

[0123] According to the present invention, since the certificate and signing key are managed only within the control device (100), there is an advantage in preventing the external leakage of the certificate and signing key. Specifically, the certificate and signing key are held only by a single entity (control device), and there is no process of transferring the certificate and signing key from one entity to another. Since the certificate and signing key are stored in the TEE area of ​​the control device (100), there is an effect of improved security. Furthermore, even if the mobile terminal is hacked externally, the control and management authority of the actual IoT device remains with the control device. Therefore, even if there is an attempt to access the IoT device through the mobile terminal, the control device can block the hacker's access through a dual security device (e.g., mobile phone authentication, Passcord authentication, etc.).

[0124] The foregoing invention may be implemented as computer-readable code on a medium on which a program is recorded. A computer-readable medium includes all types of recording devices in which data that can be read by a computer system is stored. Examples of computer-readable media include HDD (Hard Disk Drive), SSD (Solid State Disk), SSD (Silicon Disk Drive), ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, etc. Additionally, the computer may include a control unit. Accordingly, the above detailed description should not be interpreted restrictively in all respects and should be considered exemplary. The scope of the invention should be determined by a reasonable interpretation of the appended claims, and all modifications within the equivalent scope of the invention are included within the scope of the invention.

Claims

Claim 1 A method of operation of a control device for controlling an IoT device based on matter, comprising: a step of receiving device information of the IoT device obtained by the mobile terminal performing a first process of commissioning from the mobile terminal; and a step of completing the commissioning by performing a second process of commissioning for the IoT device using the device information. Claim 2 A method of operation of a control device according to claim 1, wherein the first process performed by the mobile terminal includes obtaining device information of the IoT device and pairing with the IoT device, and the second process performed by the control device includes authentication of the IoT device using the device information and setting up a connection with the IoT device. Claim 3 A method of operation of a control device according to claim 1, wherein pairing with the IoT device is performed through short-range wireless communication between the mobile terminal and the IoT device, and connection setting with the IoT device is performed through IP communication between the control device and the IoT device. Claim 4 In claim 2, the device information is a method of operation of a control device obtained by the mobile terminal photographing the tag of the IOT device. Claim 5 In claim 3, the above control device is a method of operation of a control device that does not support image capture and short-range wireless communication. Claim 6 A method of operation of a control device according to claim 1, further comprising the step of transmitting network information to the IoT device through the mobile terminal to join the IoT device to a network when authentication of the IoT device is successful. Claim 7 A method of operation of a control device according to claim 1, wherein the step of completing the commissioning includes the step of verifying the device certificate of the IoT device and generating a signing key when IP communication with the IoT device is established. Claim 8 In claim 7, the above signature key is a method of operation of the control device stored in the TEE area of ​​the control device. Claim 9 In claim 7, the method of operation of a control device further comprises the step of generating a control command using the signature key and transmitting the control command to the IOT device, wherein the signature key is not shared with the mobile terminal. Claim 10 A method of operation of a control device according to claim 1, wherein the step of completing the commissioning comprises the step of switching the MAC of the control device to the MAC of the mobile terminal to perform a connection setting with the IOT device. Claim 11 In claim 1, the method of operation of the control device, which is a set-top box installed in a home. Claim 12 A method of operation of a system for controlling an IoT device based on matter, comprising: a step in which a mobile terminal obtains device information of the IoT device by performing a first commissioning process and transmits said device information; and a step in which a control device receives said device information and completes said commissioning by performing a second commissioning process for the IoT device using said device information. Claim 13 A method of operation of a system, wherein, in claim 12, the first process performed by the mobile terminal includes obtaining device information of the IoT device and pairing with the IoT device, and the second process performed by the control device includes authentication of the IoT device using the device information and setting up a connection with the IoT device. Claim 14 A method of operation of a system in which, in claim 12, pairing with the IoT device is performed through short-range wireless communication between the mobile terminal and the IoT device, and connection setting with the IoT device is performed through IP communication between the control device and the IoT device. Claim 15 In claim 13, the step of the mobile terminal acquiring device information of the IoT device by performing a first commissioning process comprises the step of the mobile terminal acquiring the device information by photographing the tag of the IoT device; a method of operation of a system. Claim 16 In claim 14, the above-mentioned control device is a method of operation for a system that does not support image capture and short-range wireless communication. Claim 17 A method of operation of a system according to claim 12, further comprising: a step of transmitting network information to the mobile terminal to join the IoT device to a network when the control device succeeds in authenticating the IoT device; and a step of the mobile terminal transmitting the network information to the IoT device through short-range wireless communication between the mobile terminal and the IoT device. Claim 18 In claim 12, the step of completing the commissioning comprises the step of verifying the device certificate of the IoT device and generating a signing key when IP communication with the IoT device is established; a method of operation of a system. Claim 19 A control device for controlling an IoT device based on matter, comprising: a communication unit that receives device information of the IoT device obtained by the mobile terminal performing a first process of commissioning from the mobile terminal; and a control unit that completes the commissioning by performing a second process of commissioning for the IoT device using the device information. Claim 20 A system for controlling an IoT device based on matter, comprising: a mobile terminal that acquires device information of the IoT device by performing a first commissioning process and transmits said device information; and a control device that receives said device information and completes said commissioning by performing a second commissioning process for the IoT device using said device information.

Images