Electronic device and method for grouping internet of things devices
The described electronic device and method facilitate the grouping and error detection of IoT devices by using short-range communication to integrate sensor information, addressing the need for enhanced user control and management in IoT systems.
Patent Information
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- SAMSUNG ELECTRONICS CO LTD
- Filing Date
- 2025-11-04
- Publication Date
- 2026-06-25
AI Technical Summary
There is a need for improved methods and devices to manage and control Internet of Things (IoT) devices effectively, including the ability to group them and detect error situations using external sensors, to enhance user convenience and functionality.
An electronic device and method that utilizes a communication circuit, memory, and processor to discover and group IoT devices with external sensors through short-range communication, receive sensor information, and determine their operating status, while an IoT device performs similar operations to transmit sensor data to the electronic device.
Enables efficient grouping and error detection of IoT devices, enhancing user control and management capabilities, thereby improving the functionality and reliability of IoT systems.
Smart Images

Figure KR2025017933_25062026_PF_FP_ABST
Abstract
Description
Electronic device and method for grouping Internet of Things devices
[0001] The present disclosure relates to an electronic device and method for grouping Internet of Things devices.
[0002] Various services and additional functions provided through user terminals, such as electronic devices like smartphones, are gradually increasing. To enhance the utility value of these electronic devices and satisfy the needs of diverse users, telecommunications service providers and electronic device manufacturers are competitively developing electronic devices that offer a wide range of functions. Consequently, the various functions provided through these electronic devices are also becoming increasingly sophisticated.
[0003] With the advancement of wireless communication technology, devices utilizing artificial intelligence (AI) are being widely adopted. For example, home appliances connected to a network via the Internet of Things (IoT) technology can utilize artificial intelligence. IoT technology can provide intelligent internet technology services that create new value for human life by collecting and analyzing data generated from devices. Through the convergence and integration of existing internet technologies with various industries, IoT technology can be applied to fields such as smart homes, smart buildings, smart cities, smart cars, and smart appliances.
[0004] Homes are equipped with various home appliances for the convenience of users. Various services utilizing IoT technology are being proposed to make the operation and control of these appliances more convenient. Home network technology can provide diverse services to users within the household through the home network. For example, users can control various controlled devices (e.g., home appliances equipped with IoT technology) that constitute the home network using personal electronic devices (e.g., smartphones). Users may desire to receive a wider range of services to control these controlled devices. Accordingly, there is a demand for the development of various technologies that manage controlled devices by reflecting user intentions.
[0005] The foregoing information is merely related art to aid in understanding the present disclosure. No claim or determination is made as to whether the foregoing can be applied as prior art related to the present disclosure.
[0006] The aspects of the present disclosure are intended to solve at least the problems and / or disadvantages mentioned above and to provide at least the advantages described below. Accordingly, one aspect of the present disclosure is to provide an electronic device and method for grouping Internet of Things (IoT) devices.
[0007] Another aspect of the present disclosure may provide an electronic device and method for detecting an error situation through external sensors located around a home appliance.
[0008] Additional aspects will be partially explained in the following description, partially become apparent in the detailed description, or can be learned by practicing the presented embodiments.
[0009] An electronic device according to one aspect of the present disclosure is provided. The electronic device comprises a communication circuit, a memory including one or more storage media for storing instructions, and at least one processor coupled to communicate with the communication circuit and the memory, wherein when the instructions are executed individually or collectively by the at least one processor, the electronic device receives a first user input requesting sensor grouping of an Internet over Things (IoT) device, displays a guidance message requesting movement to the IoT device based on the first user input, and after displaying the guidance message, discovers the IoT device using a short-range communication method through the communication circuit, and after discovering the IoT device, discovers one or more external sensor devices using the short-range communication method through the communication circuit, receives sensor device information and signal strength information from the one or more external sensor devices through the communication circuit, groups at least one of the one or more external sensor devices with the IoT device based on the sensor device information and the signal strength information, and based on sensor data received from the at least one grouped external sensor device through the communication circuit, the It determines the operating status of IoT devices.
[0010] An Internet of Things (IoT) device according to another aspect of the present disclosure is provided. The IoT device comprises a communication circuit, a memory including one or more storage media for storing instructions, and at least one processor coupled to communicate with the communication circuit and the memory, wherein when the instructions are executed individually or collectively by the at least one processor, the IoT device receives a command requesting a search for surrounding sensors from an electronic device via the communication circuit, and based on receiving the command, discovers one or more external sensor devices using a short-range communication method via the communication circuit, receives sensor device information and signal strength information from the one or more external sensor devices via the communication circuit, groups at least one of the one or more external sensor devices with the IoT device based on the sensor device information and the signal strength information, receives sensor data from the at least one external sensor device via the communication circuit, and transmits the sensor data to the electronic device via the communication circuit.
[0011] A method by means of an electronic device according to another aspect of the present disclosure is provided. The method comprises: receiving a first user input requesting sensor grouping of an Internet of Things (IoT) device; displaying a guidance message requesting movement to the IoT device based on the first user input; discovering the IoT device using a short-range communication method after displaying the guidance message; discovering one or more external sensor devices through a communication circuit using the short-range communication method after discovering the IoT device; receiving sensor device information and signal strength information from the one or more external sensor devices; grouping at least one of the one or more external sensor devices with the IoT device based on the sensor device information and the signal strength information; and determining the operating status of the IoT device based on sensor data received from the at least one grouped external sensor device.
[0012] A method performed by an Internet of Things (IoT) device according to another aspect of the present disclosure is provided. The method comprises: receiving a command from an electronic device requesting a search for surrounding sensors; discovering one or more external sensor devices using a short-range communication method based on receiving the command; receiving sensor device information and signal strength information from the one or more external sensor devices through a communication circuit; grouping at least one of the one or more external sensor devices with the IoT device based on the sensor device information and the signal strength information; and transmitting sensor data received from the at least one external sensor device to the electronic device.
[0013] According to another aspect of the present disclosure, one or more non-transient computer-readable storage media are provided for storing one or more computer programs, and when the one or more programs are executed individually or collectively by at least one processor, the electronic device is made to perform operations. The operations may include receiving a first user input requesting sensor grouping of an Internet of Things (IoT) device, displaying a guidance message requesting movement to the IoT device based on the first user input, after displaying the guidance message, discovering the IoT device using a short-range communication method, discovering one or more external sensor devices using the short-range communication method after discovering the IoT device, receiving sensor device information and signal strength information from the one or more external sensor devices through a communication circuit, grouping at least one of the one or more external sensor devices with the IoT device based on the sensor device information and the signal strength information, and determining the operating status of the IoT device based on sensor data received from the at least one grouped external sensor device.
[0014] According to another aspect of the present disclosure, one or more non-transient computer-readable storage media are provided for storing one or more programs, and when the one or more programs are executed individually or collectively by at least one processor, the Internet of Things (IoT) device performs operations. The operations may include receiving a command from an electronic device requesting a search for surrounding sensors, and based on receiving said command, discovering one or more external sensor devices using a short-range communication method through a communication circuit, receiving sensor device information and signal strength information from said one or more external sensor devices through said communication circuit, grouping at least one of said one or more external sensor devices with the IoT device based on said sensor device information and said signal strength information, receiving sensor data from said at least one external sensor device through said communication circuit, and transmitting said sensor data to said electronic device through said communication circuit.
[0015] The technical problems to be solved in this disclosure are not limited to those mentioned above, and other unmentioned technical problems will be clearly understood by those skilled in the art to which this disclosure belongs from the description below.
[0016] The above and other aspects, features, and advantages of specific embodiments of the present disclosure will become more apparent from the following description together with the accompanying drawings;
[0017] FIG. 1 illustrates an IoT (internet of things) system according to one embodiment of the present disclosure.
[0018] FIG. 2 is a block diagram of an electronic device in a network environment according to one embodiment of the present disclosure.
[0019] FIG. 3 is a drawing for explaining a system structure including devices to be controlled according to one embodiment of the present disclosure.
[0020] FIG. 4a is a block diagram illustrating the configuration of an IoT device according to one embodiment of the present disclosure.
[0021] FIG. 4b is a block diagram illustrating the configuration of a server performing IoT control according to one embodiment of the present disclosure.
[0022] FIGS. 5A and 5B are drawings for illustrating the execution screen of an IoT client application according to various embodiments of the present disclosure.
[0023] FIGS. 6a and 6b are drawings illustrating a system configuration for error management of an IoT device according to various embodiments of the present disclosure.
[0024] FIG. 7 shows a table showing sensors required according to the type of home appliance according to one embodiment of the present disclosure.
[0025] FIG. 8 is a flowchart illustrating a procedure for performing a search for surrounding sensors by an IoT device according to one embodiment of the present disclosure.
[0026] FIG. 9 is a flowchart illustrating a procedure for performing a search for surrounding sensors by an electronic device according to one embodiment of the present disclosure.
[0027] FIG. 10 is a sequence diagram illustrating surrounding sensor search and sensor grouping according to one embodiment of the present disclosure.
[0028] FIG. 11 is a sequence diagram showing sensor grouping based on a sensor list according to one embodiment of the present disclosure.
[0029] FIG. 12 is a sequence diagram illustrating surrounding sensor search and sensor grouping according to one embodiment of the present disclosure.
[0030] FIG. 13 is a sequence diagram illustrating a search for surrounding sensors using a mobile device according to one embodiment of the present disclosure.
[0031] FIGS. 14a and FIGS. 14b are drawings for illustrating the selection of sensors according to various embodiments of the present disclosure.
[0032] FIG. 15 is a sequence diagram illustrating a procedure for selecting sensors to be grouped according to one embodiment of the present disclosure.
[0033] FIG. 16 is a diagram illustrating a procedure for extracting a threshold range based on sensor data according to one embodiment of the present disclosure.
[0034] FIG. 17 is a flowchart illustrating a procedure for detecting an error situation according to one embodiment of the present disclosure.
[0035] FIG. 18 is a flowchart illustrating a procedure for analyzing an error situation according to one embodiment of the present disclosure.
[0036] FIG. 19 is a flowchart illustrating the detection of an error situation based on sensor data collected from grouped sensors according to one embodiment of the present disclosure.
[0037] FIGS. 20a, FIGS. 20b, and FIGS. 20c illustrate a user interface representing grouped sensors according to one embodiment of the present disclosure.
[0038] The same reference numbers are used to represent the same elements throughout the drawing.
[0039] The following description, with reference to the attached drawings, is provided to aid in a comprehensive understanding of the various embodiments of the present disclosure as defined by the claims and their equivalents. While various specific details are included to aid in this understanding, they are merely illustrative. Accordingly, those skilled in the art will understand that various changes and modifications are possible to the various embodiments described herein, and such changes and modifications do not depart from the scope and spirit of the present disclosure. Furthermore, for the sake of clarity and brevity, descriptions of known functions or configurations may be omitted.
[0040] The terms and words used in the following description and claims are not limited to their dictionary meanings and are used by the inventor to ensure a clear and consistent understanding of the present disclosure. Accordingly, those skilled in the art will clearly understand that the various embodiments of the present disclosure described below are for illustrative purposes only and are not intended to limit the present disclosure as defined by the appended claims and their equivalents.
[0041] Unless clearly otherwise specified in the context, the singular forms “a,” “an,” and “the” should be understood to include the plural forms. Thus, for example, the expression “component surface” means including one or more such surfaces.
[0042] Expressions such as “comprising” or “comprising” used in the present disclosure should not be interpreted as necessarily including all elements or steps described in the specification, but should be interpreted to exclude some of them or to include additional elements or steps.
[0043] Terms including ordinal numbers, such as first or second as used in this disclosure, may be used to describe various components, but said components should not be limited by said terms. Such terms may be used solely for the purpose of distinguishing one component from another. For example, without departing from the scope of the rights of this disclosure, the first component may be named the second component, and similarly, the second component may be named the first component.
[0044] When it is stated that one component is "connected" or "connected" to another component, it may be directly connected or connected to that other component, or there may be other components in between. On the other hand, when it is stated that one component is "directly connected" or "directly connected" to another component, it should be understood that there are no other components in between.
[0045] Hereinafter, embodiments according to the present disclosure will be described with reference to the attached drawings. Identical or similar components regardless of drawing symbols are given the same reference numeral, and redundant descriptions thereof will be omitted. In describing the embodiments of the present disclosure, detailed descriptions of related prior art are omitted if it is determined that such detailed descriptions may obscure the essence of the present disclosure. It should be noted that the attached drawings are intended only to facilitate understanding of the embodiments of the present disclosure and should not be interpreted as limiting the present disclosure. The present disclosure should be interpreted as extending to all modifications, equivalents, and substitutions in addition to the attached drawings.
[0046] In this disclosure, embodiments will be described using an electronic device as an example, but the electronic device may be referred to as a terminal, mobile station, mobile equipment (ME), user equipment (UE), user terminal (UT), subscriber station (SS), wireless device, handheld device, or access terminal (AT). In the embodiments of this disclosure, the electronic device may be a device equipped with communication functions, such as a mobile phone, personal digital assistant (PDA), smartphone, wireless modem, or laptop.
[0047] It should be understood that the blocks of each flowchart and combinations of flowcharts may be executed by one or more computer programs containing computer execution instructions. The entirety of the one or more computer programs may be stored in a single memory device, or a portion thereof may be partitioned and stored in multiple different memory devices.
[0048] Any of the functions or operations described herein may be processed by a single processor or a combination of multiple processors. This single processor or a combination of multiple processors is a circuit that performs processing and may include, for example, an application processor (AP, e.g., a central processing unit (CPU)), a communication processor (CP, e.g., a modem), a graphical processing unit (GPU)), a neural processing unit (NPU) (e.g., an artificial intelligence (AI) chip), a wireless-fidelity (Wi-Fi) chip, a Bluetooth™ chip, a global positioning system (GPS) chip, a near field communication (NFC) chip, a connectivity chip, a sensor controller, a touch controller, a fingerprint sensor controller, a display driver integrated circuit (IC), an audio codec (CODEC) chip, a universal serial bus (USB) controller, a camera controller, an image processing IC, a microprocessor unit (MPU), a system on chip (SoC), an IC, and the like.
[0049] FIG. 1 illustrates an Internet of Things (IoT) system according to one embodiment of the present disclosure. Meanwhile, at least some of the components of FIG. 1 may be omitted, and the system may be implemented to include additional components not illustrated.
[0050] Referring to FIG. 1, an IoT system (100) according to one embodiment of the present disclosure includes a plurality of electronic devices connectable to a data network (116 or 146). For example, the IoT system (100) may include at least one of a first IoT server (110), a first node (120), a voice assistance server (130), a second IoT server (140), a second node (150), or devices (121, 122, 123, 124, 125, 136, 137, 151, 152, 153).
[0051] According to one embodiment of the present disclosure, the first IoT server (110) may include at least one of a communication interface (111), a processor (112), or a storage unit (113). The second IoT server (140) may include at least one of a communication interface (141), a processor (142), or a storage unit (143). An “IoT server” in this document may remotely control and / or monitor one or more devices (e.g., devices (121, 122, 123, 124, 125, 151, 152, 153)) based on, for example, a data network (e.g., data network (116) or data network (146)), through a relay device (e.g., first node (120) or second node (150)), or directly without a relay device. The term "device" as used herein refers to sensors, home appliances, office electronic devices, or devices for performing processes deployed (or located) within a local environment, such as a home, office, factory, building, external branch, or other types of sites, without any limitations on their type. A device that receives a control command and performs an action corresponding to that command may be referred to as a "target device." An IoT server may also be referred to as a central server in that it selects a target device from among multiple devices and provides control commands.
[0052] According to one embodiment of the present disclosure, the first IoT server (110) can communicate with devices (121, 122, 123) through a data network (116). The data network (116) may mean a network for remote communication, such as, for example, the Internet, or a computer network (e.g., LAN or WAN), or may include a cellular network.
[0053] According to one embodiment of the present disclosure, a first IoT server (110) may be connected to a data network (116) through a communication interface (111). The communication interface (111) may include a communication device (or communication module) for supporting communication of the data network (116), and may be integrated into a single component (e.g., a single chip) or implemented as a plurality of separate components (e.g., multiple chips). The first IoT server (110) may communicate with devices (121, 122, 123) through a first node (120). The first node (120) may receive data from the first IoT server (110) through the data network (116) and transmit the received data to at least some of the devices (121, 122, 123). Alternatively, the first node (120) may receive data from at least some of the devices (121, 122, 123) and transmit the received data to the first IoT server (110) via the data network (116). The first node (120) may function as a bridge between the data network (116) and the devices (121, 122, 123). Meanwhile, although FIG. 1 is illustrated as having only one first node (120), this is merely illustrative and there is no limit to the number.
[0054] In this document, "node" may be an edge computing system or a hub device. According to one embodiment of the present disclosure, the first node (120) supports wired and / or wireless communication of the data network (116) and may also support wired and / or wireless communication with devices (121, 122, 123). For example, the first node (120) may be connected to the devices (121, 122, 123) via a short-range communication network such as Bluetooth, Wi-Fi, Wi-Fi Direct, Z-wave, Zig-bee, INSETEON, X10, or IrDA (infrared data association), but there are no restrictions on the type of communication. The first node (120) may be placed (or located) within an environment such as, for example, a home, office, factory, building, external branch, or other types of sites. Accordingly, the devices (121, 122, 123) may be monitored and / or controlled by a service provided by the first IoT server (110), and the devices (121, 122, 123) may not be required to have the capability of full network communication (e.g., Internet communication) for direct connection to the first IoT server (110). The devices (121, 122, 123) are illustrated as being implemented as electronic devices in a home environment, such as light switches, proximity sensors, temperature sensors, etc., but are not limited thereto.
[0055] According to one embodiment of the present disclosure, the first IoT server (110) may support direct communication with devices (124, 125). Here, "direct communication" means communication without passing through a relay device, such as a first node (120), for example, and may mean communication through a cellular communication network and / or a data network, for example.
[0056] According to one embodiment of the present disclosure, the first IoT server (110) may transmit a control command to at least some of the devices (121, 122, 123, 124, 125). Here, "control command" may mean data that causes a controllable device to perform a specific operation, and the specific operation is an operation performed by the device, which may include outputting information, sensing information, reporting information, and managing information (e.g., deletion, or creation), and there is no limitation on the type thereof. For example, the processor (112) may obtain information (or a request) for generating a control command from an external source (e.g., a voice assistant server (130), a second IoT server (140), an external system (160), or at least some of the devices (121, 122, 123, 124, 125), and generate a control command based on the obtained information. Alternatively, the processor (112) may generate a control command based on the fact that the monitoring results of at least some of the devices (121, 122, 123, 124, 125) satisfy a specified condition. The processor (112) may control the communication interface (111) to transmit the control command to the target device.
[0057] According to one embodiment of the present disclosure, the processor (112), or processor (132), or processor (142) may be implemented as a combination of one or more general-purpose processors such as a CPU (central processing unit), DSP (digital signal processor), AP (application processor), or CP (communication processor), graphics-dedicated processors such as a GPU (graphical processing unit) or VPU (vision processing unit), or artificial intelligence-dedicated processors such as an NPU (neural processing unit). Those skilled in the art will understand that the processor (112) is not limited to any means of computation capable of executing instructions stored in memory (113), for example, and outputting the result of the execution.
[0058] According to one embodiment of the present disclosure, the processor (112) may configure a web-based interface based on an application programmable interface (API) (114) or expose a resource managed by the first IoT server (110) to the outside. The web-based interface may support communication between, for example, the first IoT server (110) and an external web service. The processor (112) may allow, for example, an external system (160) to control and / or access the devices (121, 122, 123). The external system (160) may, for example, be an independent system that is not associated with or part of the system (100). The external system (160) may, for example, be an external server or a website. However, security is required for access to devices (121, 122, 123) from an external system (160) or to resources of the first IoT server (110). According to one embodiment of the present disclosure, the processor (112) may expose an API endpoint (e.g., a universal resource locator URL) based on an API (114) to the outside for automation applications. As described above, the first IoT server (110) may transmit control commands to a target device among the devices (121, 122, 123). Meanwhile, the description of the communication interface (141), processor (142), API (144) of the storage unit (143), and database (145) of the second IoT server (140) may be substantially the same as the description of the communication interface (111), processor (112), API (114) of the storage unit (113), and database (115) of the first IoT server (110). Additionally, the description of the second node (150) may be substantially the same as the description of the first node (120).The second IoT server (140) can transmit control commands to a target device among the devices (151, 152, 153). In one embodiment of the present disclosure, the first IoT server (110) and the second IoT server (140) may be operated by the same service provider, but in other embodiments, they may be operated by different service providers.
[0059] According to one embodiment of the present disclosure, a voice assistant server (130) can transmit and receive data with a first IoT server (110) through a data network (116). A voice assistant server (130) according to one embodiment may include at least one of a communication interface (131), a processor (132), or a storage unit (133). The communication interface (131) can communicate with a smartphone (136) or an AI speaker (137) through a data network (not shown) and / or a cellular network (not shown). The smartphone (136) or the AI speaker (137) may include a microphone and can acquire a user voice, convert it into a voice signal, and transmit the voice signal to the voice assistant server (130). The processor (132) can receive a voice signal from the smartphone (136) or the AI speaker (137) through the communication interface (131). The processor (132) can process the received voice signal based on the stored model (134). The processor (132) can generate (or verify) a control command using the processing result based on the information stored in the database (135).According to one embodiment of the present disclosure, the storage unit (113, 133, 143) may include at least one type of non-transitory storage medium among a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., SD (secure digital) or XD (extreme digital) memory, etc.), RAM (random access memory), SRAM (static random access memory), ROM (read-only memory), EEPROM (electrically erasable programmable read-only memory), PROM (programmable read-only memory), magnetic memory, a magnetic disk, or an optical disk, and there is no limitation on the type.
[0060] In various embodiments of the present disclosure, at least one device (e.g., device (124)) communicating with the first IoT server (110) may be a smartphone in a network environment (e.g., the electronic device (201) of FIG. 2).
[0061] FIG. 2 is a block diagram of an electronic device in a network environment according to one embodiment of the present disclosure.
[0062] Referring to FIG. 2, in a network environment (200), an electronic device (201) may communicate with an electronic device (202) through a first network (298) (e.g., a short-range wireless communication network) or with at least one of an electronic device (204) or a server (208) through a second network (299) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (201) may communicate with the electronic device (204) through a server (208). According to one embodiment, the electronic device (201) may include a processor (220), memory (230), input module (250), sound output module (255), display module (260), audio module (270), sensor module (276), interface (277), connection terminal (278), haptic module (279), camera module (280), power management module (288), battery (289), communication module (290), subscriber identification module (296), or antenna module (297). In some embodiments, at least one of these components (e.g., connection terminal (278)) may be omitted from the electronic device (201), or one or more other components may be added. In some embodiments, some of these components (e.g., sensor module (276), camera module (280), or antenna module (297)) may be integrated into a single component (e.g., display module (260)).
[0063] The processor (220) can control at least one other component (e.g., a hardware or software component) of the electronic device (201) connected to the processor (220) by executing software (e.g., a program (240)), for example, and can perform various data processing or operations. According to one embodiment, as at least part of the data processing or operations, the processor (220) can store commands or data received from other components (e.g., a sensor module (276) or a communication module (290)) in volatile memory (232), process the commands or data stored in volatile memory (232), and store the resulting data in non-volatile memory (234). According to one embodiment, the processor (220) may include a main processor (221) (e.g., a central processing unit or an application processor) or an auxiliary processor (223) that can operate independently or together with it (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, if the electronic device (201) includes a main processor (221) and an auxiliary processor (223), the auxiliary processor (223) may be configured to use less power than the main processor (221) or to be specialized for a designated function. The auxiliary processor (223) may be implemented separately from the main processor (221) or as part thereof.
[0064] The auxiliary processor (223) may control at least some of the functions or states associated with at least one component of the electronic device (201) (e.g., display module (260), sensor module (276), or communication module (290)) on behalf of the main processor (221) while the main processor (221) is in an inactive (e.g., sleep) state, or together with the main processor (221) while the main processor (221) is in an active (e.g., application execution) state. According to one embodiment, the auxiliary processor (223) (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module (280) or communication module (290)). According to one embodiment, the auxiliary processor (223) (e.g., neural network processing unit) may include a hardware structure specialized for processing an artificial intelligence model. The artificial intelligence model may be generated through machine learning. Such learning may be performed, for example, on the electronic device (201) itself where the artificial intelligence model is executed, or through a separate server (e.g., server (208)). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model may include a plurality of artificial neural network layers.An artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to the hardware structure, the artificial intelligence model may include a software structure, either additionally or substantially.
[0065] The memory (230) can store various data used by at least one component of the electronic device (201) (e.g., processor (220) or sensor module (276)). The data may include, for example, software (e.g., program (240)) and input or output data for related commands. The memory (230) may include volatile memory (232) or non-volatile memory (234).
[0066] The program (240) may be stored as software in memory (230) and may include, for example, an operating system (242), middleware (244), or an application (246).
[0067] The input module (250) can receive commands or data to be used for a component of the electronic device (201) (e.g., processor (220)) from outside the electronic device (201) (e.g., user). The input module (250) may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).
[0068] The sound output module (255) can output a sound signal to the outside of the electronic device (201). The sound output module (255) may include, for example, a speaker or a receiver. The speaker may be used for general purposes, such as multimedia playback or recording playback. The receiver may be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part thereof.
[0069] The display module (260) can visually provide information to an external (e.g., user) of the electronic device (201). The display module (260) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling said device. According to one embodiment, the display module (260) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of the force generated by said touch.
[0070] The audio module (270) can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module (270) can acquire sound through the input module (250) or output sound through the sound output module (255) or an external electronic device (e.g., electronic device (202)) (e.g., speaker or headphones) connected directly or wirelessly to the electronic device (201).
[0071] The sensor module (276) can detect the operating state of the electronic device (201) (e.g., power or temperature) or the external environmental state (e.g., user state) and generate an electrical signal or data value corresponding to the detected state. According to one embodiment, the sensor module (276) may include, for example, a gesture sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biosensor, a temperature sensor, a humidity sensor, or an illuminance sensor.
[0072] The interface (277) may support one or more specified protocols that can be used for the electronic device (201) to be connected directly or wirelessly to an external electronic device (e.g., electronic device (202)). According to one embodiment, the interface (277) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.
[0073] The connection terminal (278) may include a connector through which the electronic device (201) can be physically connected to an external electronic device (e.g., electronic device (202)). According to one embodiment, the connection terminal (278) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).
[0074] The haptic module (279) can convert an electrical signal into a mechanical stimulus (e.g., vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic senses. According to one embodiment, the haptic module (279) may include, for example, a motor, a piezoelectric element, or an electric stimulation device.
[0075] The camera module (280) can capture still images and video. According to one embodiment, the camera module (280) may include one or more lenses, image sensors, image signal processors, or flashes.
[0076] The power management module (288) can manage the power supplied to the electronic device (201). According to one embodiment, the power management module (288) can be implemented, for example, as at least part of a power management integrated circuit (PMIC).
[0077] The battery (289) can supply power to at least one component of the electronic device (201). According to one embodiment, the battery (289) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.
[0078] The communication module (290) can support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between an electronic device (201) and an external electronic device (e.g., electronic device (202), electronic device (204), or server (208)), and the performance of communication through the established communication channel. The communication module (290) may include one or more communication processors that operate independently of the processor (220) (e.g., application processor) and support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (290) may include a wireless communication module (292) (e.g., cellular communication module, short-range wireless communication module, or GNSS (global navigation satellite system) communication module) or a wired communication module (294) (e.g., LAN (local area network) communication module, or power line communication module). The corresponding communication module among these communication modules can communicate with an external electronic device (204) via a first network (298) (e.g., a short-range communication network such as Bluetooth, WiFi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (299) (e.g., a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., LAN or WAN)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (292) can identify or authenticate the electronic device (201) within a communication network such as the first network (298) or the second network (299) using subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module (296).
[0079] The wireless communication module (292) can support 5G networks and next-generation communication technologies following 4G networks, for example, new radio access technology. NR access technology can support high-speed transmission of high-capacity data (enhanced mobile broadband (eMBB)), minimization of terminal power and connection of multiple terminals (massive machine type communications (mMTC)), or high reliability and low latency (ultra-reliable and low-latency communications (URLLC)). The wireless communication module (292) can support a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate, for example. The wireless communication module (292) can support various technologies for securing performance in the high-frequency band, such as beamforming, massive MIMO (multiple-input and multiple-output), full-dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large-scale antenna. The wireless communication module (292) can support various requirements specified in the electronic device (201), external electronic device (e.g., electronic device (204)), or network system (e.g., second network (299)). According to one embodiment, the wireless communication module (292) can support a Peak data rate (e.g., 20 Gbps or more) for eMBB realization, loss coverage (e.g., 164 dB or less) for mMTC realization, or U-plane latency (e.g., downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less) for URLLC realization.
[0080] An antenna module (297) can transmit a signal or power to or from an external source (e.g., an external electronic device). According to one embodiment, the antenna module (297) may include an antenna comprising a radiator made of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (297) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as a first network (298) or a second network (299), may be selected from the plurality of antennas, for example, by a communication module (290). A signal or power may be transmitted or received between the communication module (290) and an external electronic device through the selected at least one antenna. According to some embodiments, in addition to the radiator, other components (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module (297).
[0081] According to various embodiments, the antenna module (297) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent to a first surface (e.g., bottom surface) of the printed circuit board and capable of supporting a specified high frequency band (e.g., mmWave band), and a plurality of antennas (e.g., array antennas) disposed on or adjacent to a second surface (e.g., top surface or side surface) of the printed circuit board and capable of transmitting or receiving a signal of the specified high frequency band.
[0082] At least some of the above components can be connected to each other via a communication method between peripheral devices (e.g., bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)) and exchange signals (e.g., commands or data) with each other.
[0083] According to one embodiment, commands or data may be transmitted or received between the electronic device (201) and an external electronic device (204) through a server (208) connected to a second network (299). Each of the external electronic devices (202, or 204) may be the same or a different type of device as the electronic device (201). According to one embodiment, all or part of the operations performed on the electronic device (201) may be performed on one or more of the external electronic devices (202, 204, or 208). For example, if the electronic device (201) needs to perform a function or service automatically or in response to a request from a user or another device, the electronic device (201) may request one or more external electronic devices to perform at least part of the function or service instead of performing the function or service itself or additionally. One or more external electronic devices that receive the above request may execute at least part of the requested function or service, or additional function or service related to the request, and transmit the result of the execution to the electronic device (201). The electronic device (201) may provide the result as is or additionally processed as at least part of the response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device (201) may provide ultra-low latency services using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device (204) may include an Internet of Things (IoT) device. The server (208) may be an intelligent server using machine learning and / or neural networks. According to one embodiment, the external electronic device (204) or the server (208) may be included within the second network (299).The electronic device (201) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.
[0084] FIG. 3 is a drawing for explaining a system structure including devices to be controlled according to one embodiment of the present disclosure.
[0085] Referring to FIG. 3, the IoT system (300) (e.g., IoT network) may include a server (350) operating as an IoT cloud and / or account server, an electronic device (310) (e.g., electronic device (201)), and one or more controlled devices (e.g., IoT devices (320a, 320b, 320c, 320d, and 320e)) within a local network (345).
[0086] In one embodiment of the present disclosure, the electronic device (310) may be configured to communicate with the server (350) via long-range wireless communication (e.g., the second network (299)). In one embodiment, the electronic device (310) may be configured to operate as a hub for IoT devices (320a, 320b, 320c, 320d, and 320e). In one embodiment of the present disclosure, at least one of the IoT devices (320a, 320b, 320c, 320d, and 320e) may be configured to communicate with the electronic device (310) using short-range wireless communication (e.g., Wi-Fi, Bluetooth legacy, Bluetooth low energy (BLE), ultra-wideband (UWB), Zigbee, and / or near-field communication (NFC)). In one embodiment of the present disclosure, at least one of the IoT devices (320a, 320b, 320c, 320d, and 320e) may be configured to support IoT technology, access the Internet through an access point (AP) (340), and communicate with a server (350) through the Internet.
[0087] In one embodiment of the present disclosure, any one of the IoT devices (320a, 320b, 320c, 320d, and 320e) (e.g., IoT device (320a)) (e.g., TV, home automation panel, PC (personal computer), smartphone, or tablet) may be configured to have a hub function configured to manage the connection and status of the IoT devices (320a, 320b, 320c, 320d, and 320e). The IoT device (320a) may communicate with the server (350) via the AP (340) and may be registered with the server (350) after being onboarded similarly to the IoT devices (320a, 320b, 320c, 320d, and 320e).
[0088] In one embodiment of the present disclosure, the electronic device (310) can communicate (e.g., control or manage) with IoT devices (320a, 320b, 320c, 320d, and 320e) through a server (350), through long-range wireless communication (e.g., a second network (299)), or through short-range wireless communication (e.g., a first network (298)).
[0089] In one embodiment of the present disclosure, IoT devices (320a, 320b, 320c, 320d, and 320e) may include, for example, at least one of a television, an air conditioner, an air purifier, a refrigerator, a washing machine, a light bulb, a security camera, a sensor, or a window treatment. In one embodiment of the present disclosure, IoT devices (320a, 320b, 320c, 320d, and 320e) may be configured to be controlled (e.g., to report status and / or perform specified actions) by a remote command (e.g., a control command from an electronic device (310) or a server (350). In one embodiment of the present disclosure, IoT devices (320a, 320b, 320c, 320d, and 320e) may communicate with an electronic device (310) via an AP (340) within a local network (345), communicate with an electronic device (310) via a server (350), and / or communicate directly with an electronic device (310) via a D2D (device-to-device) connection (e.g., without going through a server (350), AP (340), or other device).
[0090] In one embodiment of the present disclosure, IoT devices (320a, 320b, 320c, 320d, and 320e) may be configured to communicate with an electronic device (310) via long-range wireless communication (e.g., a second network (299)) or via short-range wireless communication (e.g., a first network (298)). In one embodiment of the present disclosure, IoT devices (320a, 320b, 320c, 320d, and 320e) may be configured to communicate with a server (350) via long-range wireless communication (e.g., a second network (299)) or via short-range wireless communication (e.g., a first network (298)).
[0091] In one embodiment of the present disclosure, at least one of the IoT devices (320b, 320c, 320d, and 320e) may be a hub-connected device that establishes a device-to-device (D2D) connection (e.g., Bluetooth connection, BLE connection, UWB connection, ZigBee connection, ZWave connection, or Wi-Fi connection) with an IoT device (e.g., IoT device (320a)) acting as a hub and receives control commands or reports status from a server (350) via the IoT device (320a). In one embodiment of the present disclosure, at least one of the IoT devices (320b, 320c, 320d, and 320e) may be a cloud-connected device configured to receive control commands or report status from a server (350) via an AP (340). In one embodiment of the present disclosure, at least one of the IoT devices (320b, 320c, 320d, and 320e) may be a cloud-to-cloud type device registered in a third-party cloud and controlled via an application programmable interface (API) between clouds.
[0092] In one embodiment of the present disclosure, the electronic device (310) may be a personal electronic device, such as a smartphone or tablet, or an electronic device having a display and a user interface, such as a television or a control console. In one embodiment of the present disclosure, the electronic device (310) may be configured to directly perform at least some of the functions described below of the electronic device (310) or to perform them through connection (e.g., pairing) with at least one external electronic device (e.g., a wearable device such as a smart watch).
[0093] In one embodiment of the present disclosure, an electronic device (310) may discover at least one of IoT devices (320a, 320b, 320c, 320d, 320e) and may execute a procedure (e.g., a registration procedure) to register the discovered IoT device with a server (350). The IoT devices (320a, 320b, 320c, 320d, 320e) are registered with the server (350) to be associated with a user account and may log in (e.g., sign in) with said user account. Based on said user account, the electronic device (310) may monitor or / or control the IoT devices (320a, 320b, 320c, 320d, 320e). In one embodiment of the present disclosure, the electronic device (310) can check the status of IoT devices (320a, 320b, 320c, 320d, 320e) that a user can use for an IoT service, or control the IoT devices (320a, 320b, 320c, 320d, 320e) (e.g., transmit a control command instructing to perform a specific action).
[0094] FIG. 4a is a block diagram illustrating the configuration of an IoT device according to one embodiment of the present disclosure.
[0095] Referring to FIG. 4a, the IoT device (320) may be an IoT device (e.g., any one of the IoT devices (320a, 320b, 320c, 320d, and 320e)) that performs an IoT service (e.g., an event-based IoT service) in an IoT network (e.g., network (300)). For example, the IoT network may be a smart home network, and the IoT service may be an automation service.
[0096] In one embodiment of the present disclosure, the IoT device (320) may include at least one processor (412) including a processing circuit, a communication circuit (414), a memory (416) for storing instructions, and / or a native function unit (418) for performing a native function of a home appliance. In one embodiment of the present disclosure, the IoT device (320) may be a device including a display or a TV. In one embodiment of the present disclosure, if the IoT device (320) is a smart TV, the native function unit (418) may include a TV receiving circuit and a display. In one embodiment of the present disclosure, if the IoT device (320) is a smart washing machine, the native function unit (418) may include a motor and a control circuit. In one embodiment of the present disclosure, if the IoT device (320) is a smart refrigerator, the native function unit (418) may include a cooling circuit and a control circuit.
[0097] In one embodiment of the present disclosure, the communication circuit (414) can transmit and receive wireless signals with an external electronic device (e.g., electronic device (310), AP (340), server (350) and / or other IoT device). The IoT device (320) can support at least one of a specified short-range wireless communication technology (e.g., Zigbee, Z-Wave, UWB (ultra wide-band), or Wi-Fi) through the communication circuit (414). The communication circuit (414) may include one or more communication circuits based on a specified short-range wireless communication technology (e.g., Zigbee, Z-Wave, UWB, and / or Wi-Fi).
[0098] In one embodiment of the present disclosure, the processor (412) may be implemented as one or more single-core processors or one or more multi-core processors. In one embodiment of the present disclosure, the memory (416) may store instructions and data for the operation of the IoT device (320). In one embodiment of the present disclosure, the memory (416) may store relevant information and / or data according to the embodiments of the present disclosure.
[0099] In one embodiment of the present disclosure, a processor (412) may control or manage the state (e.g., accessibility setting state) and actions (e.g., accessibility functions) of an IoT device (320) associated with an IoT service. In one embodiment, the processor (412) may receive control commands related to the control of the IoT device (320) from an electronic device (310) and / or a server (350) and may operate according to said control commands. In one embodiment of the present disclosure, said control commands may be received via an AP (340).
[0100] FIG. 4b is a block diagram illustrating the configuration of a server performing IoT control according to one embodiment of the present disclosure.
[0101] Referring to FIG. 4b, a server (350) can control and manage components (e.g., IoT devices (320a, 320b, 320c, 320d, 320e), and an electronic device (310)) that perform IoT services (e.g., event-based IoT services) in an IoT network (e.g., network (300)). In one embodiment of the present disclosure, the server (350) may be configured to communicate with the IoT devices (320a, 320b, 320c, 320d, 320e) and the electronic device (310) via an external network (e.g., the Internet). In one embodiment of the present disclosure, the server (350) may include at least one processor (422) including a processing circuit, a communication circuit (424), and / or a memory (426) for storing instructions.
[0102] In one embodiment of the present disclosure, the communication circuit (424) may transmit and receive control messages and data with an external electronic device (e.g., electronic device (310) and / or IoT devices (320a, 320b, 320c, 320d, 320e)). In one embodiment of the present disclosure, the processor (422) may be implemented as one or more single-core processors or one or more multi-core processors. In one embodiment of the present disclosure, the memory (426) may store instructions and data for the operation of the server (350). In one embodiment of the present disclosure, the memory (426) may store relevant information and / or data according to the embodiments of the present disclosure.
[0103] In one embodiment of the present disclosure, a processor (422) may control or manage the state (e.g., sensor data and / or error situations) and actions (e.g., failover measures for error situations) of devices associated with an IoT service (e.g., electronic device (310) and IoT device (320)). In one embodiment of the present disclosure, the processor (422) may receive information related to the control of the electronic device (310) and IoT device (320) from the electronic device (310) and / or IoT device (320), and may manage and / or control the electronic device (310) and / or IoT device (320) based on the received information. The control command may be transmitted to the IoT device (320) via the AP (340).
[0104] FIGS. 5A and 5B are drawings for illustrating the execution screen of an IoT client application according to various embodiments of the present disclosure.
[0105] Referring to FIG. 5a, an electronic device (310) may execute an IoT client application for an IoT service and, based on the execution of said client application, display a dashboard screen (510) through a display module (e.g., a display module (260)). The dashboard screen (510) may include objects (e.g., objects (512, 514)) representing the states of one or more onboarded IoT devices (e.g., IoT devices (320a, 320b, 320c, 320d, 320e)). In one embodiment of the present disclosure, said objects may be arranged in a tile grid.
[0106] In one embodiment of the present disclosure, each object may include at least one of an image, location (e.g., room information), name, or connection status (e.g., online or offline) corresponding to the IoT device. In one embodiment of the present disclosure, an object (512) corresponding to a TV may include information such as {TV image, location=Room 1, device type / name=SSTV, and connection status=Offline}. In one embodiment of the present disclosure, an object (514) corresponding to a washing machine may include information such as {washing machine image, location=Laundry room, device type / name=Washing machine, and connection status=Online}.
[0107] In one embodiment of the present disclosure, when any one of the IoT devices (320a, 320b, 320c, 320d, 320e) (e.g., Room 1 TV) is connected to the server (350) and operating normally, the object (512) corresponding to the Room 1 TV may indicate an online state (e.g., a normal state). In one embodiment of the present disclosure, when any one of the IoT devices (320a, 320b, 320c, 320d, 320e) (e.g., a washing machine) is not connected to the server (350) or is not operating normally, the object (514) corresponding to the washing machine may indicate an offline state (e.g., an error situation). In one embodiment of the present disclosure, IoT devices (320a, 320b, 320c, 320d, 320e) can log in (e.g., sign in) to the server (350) using a user account while online.
[0108] Referring to FIG. 5b, the electronic device (310) can execute a client application for IoT control services and, based on the execution of said client application, display a map view screen (520) through a display module (e.g., a display module (260)). The map view screen (520) may include a simplified map image (522) corresponding to a local network (e.g., a local network (345) of FIG. 3), and a detailed map image (524) including an expanded image of at least some area of said simplified map image (522).
[0109] In one embodiment of the present disclosure, a simplified map image (522) may represent a building structure (e.g., a floor plan) composed of a plurality of rooms corresponding to a local network for IoT services (e.g., the local network (345) of FIG. 3). In one embodiment of the present disclosure, a detailed map image (524) may represent a partial floor plan corresponding to a portion of the simplified map image (522) and may include device symbols (e.g., device symbols (526)) displayed on the partial floor plan. In one embodiment of the present disclosure, each device symbol may be placed at a virtual location on the detailed map image (524) corresponding to a location where a corresponding actual IoT device is installed (e.g., a kitchen). In one embodiment, the device symbol (526) may be mapped to a washing machine located in the kitchen.
[0110] FIGS. 6a and 6b are drawings illustrating a system configuration for error management of an IoT device according to various embodiments of the present disclosure.
[0111] Referring to FIG. 6a, an IoT device (320) or an electronic device (310) may collect device data indicating the state (e.g., operating state) of the IoT device (320) and transmit a report message (612) containing said device data to a server (350). In one embodiment of the present disclosure, the report message (612) may include sensor data, control data, configuration data, and / or error situation information related to the IoT device (320). In one embodiment of the present disclosure, the IoT device (320) may collect said sensor data from at least one built-in sensor (e.g., at least one of a temperature sensor, a vibration sensor, a microphone, a battery monitor, an air quality sensor, or a water sensor). In one embodiment of the present disclosure, the server (350) may transmit management information (614) based on said report message (612) to a remote management server (360).
[0112] Referring to FIG. 6b, the IoT device (320) may collect device data (622) indicating the state (e.g., operating state) of the IoT device (320) and transmit said device data (622) to a hub (e.g., the IoT device (320a) of FIG. 3) within a local network (e.g., the local network (345) of FIG. 3). In one embodiment of the present disclosure, a report message (624) may include sensor data, control data, configuration data, and / or error situation information related to the IoT device (320). In one embodiment of the present disclosure, the IoT device (320) may collect said sensor data from at least one built-in sensor (e.g., at least one of a temperature sensor, a vibration sensor, a microphone, a battery sensor, an air quality sensor, or a leak sensor).
[0113] In one embodiment of the present disclosure, an IoT device (320a) operating as a hub may transmit a report message (624) to a server (350) containing device data (622) collected from one or more IoT devices (e.g., IoT device (320)). In one embodiment of the present disclosure, the report message (624) may include sensor data, control data, configuration data, and / or error situation information related to the IoT device (320). In one embodiment of the present disclosure, the server (350) may transmit management information (626) based on the report message (624) to a remote management server (360).
[0114] In one embodiment of the present disclosure, the remote management server (360) may notify the after-sales service center (602) or the IoT management center (604) (e.g., electronic device (310), server (350), or user account) based on the results of analyzing the management information (614 or 626), or generate statistical data and provide it to the manufacturer (606). The results of analyzing the management information (614 or 626) may include information regarding error situations of the IoT device (320) or early warning information regarding future error situations. The after-sales service center (602) may, in response to the analysis results, check the device status through user consultation or provide troubleshooting through remote control. The IoT management center (604) may, in response to the analysis results, provide the user with reports on the device status and action guides. The manufacturer (606) may, based on the analysis results, detect or resolve error situations of devices released to the market at an early stage.
[0115] In one embodiment of the present disclosure, a home appliance (e.g., an IoT device (320)) may support IoT functions but may not be equipped with sensor detection functions or may only include low-functioning, older sensors. The IoT device (320) may be designed to be equipped with at least one sensor required for detecting the state of the IoT device (320) and may include a function to collect sensor data related to the IoT device (320) using said at least one sensor. When a user uses the IoT device (320) for a long period after purchasing it, there may be an inconvenience in that the sensor functions using new technology cannot be used.
[0116] Embodiments of the present disclosure can expand the sensor capabilities of a home appliance by defining the types of sensors required according to the characteristics of the home appliance and grouping sensors surrounding the home appliance with the home appliance. In one embodiment of the present disclosure, a spherical washing machine may be designed to support Wi-Fi communication technology and to support only power on / off functions via Wi-Fi communication. A user can operate the washing start and stop functions of the washing machine through an IoT client application and determine the operating status of the washing machine in progress or stopped. The user may want to know additional information, such as how much washing time has elapsed and how much detergent remains. Embodiments of the present disclosure can group IoT-enabled sensors located around the washing machine (e.g., vibration sensors and / or leak sensors) with the spherical washing machine and enable the detection of the operating status of the washing machine through said sensors. Embodiments of the present disclosure can enhance the IoT capabilities of the spherical home appliance through the grouped sensors, thereby improving the customer experience and continuously improving the IoT experience.
[0117] FIG. 7 shows a table showing sensors required according to the type of home appliance according to one embodiment of the present disclosure.
[0118] Referring to FIG. 7, the table (700) may indicate the sensors required for each of the refrigerator, air conditioner, washing machine, dryer, dishwasher, cooktop, oven, stick vacuum cleaner, robot vacuum cleaner, air purifier, and water purifier. The refrigerator, dishwasher, and water purifier may require a temperature sensor, a vibration sensor (e.g., an axis accelerometer), a microphone, and / or a leak sensor. The air conditioner may require a temperature sensor, a vibration sensor, a microphone, an air quality sensor (e.g., a VOC (volatile organic compounds) sensor), and / or a leak sensor. The washing machine and dryer may require a temperature sensor, a vibration sensor, a microphone, and / or an air quality sensor. The cooktop may require a temperature sensor, an air quality sensor, and / or a leak sensor. The oven may require a temperature sensor and / or an air quality sensor. The stick vacuum cleaner and robot vacuum cleaner require a vibration sensor, a battery, and / or an air quality sensor, and the robot vacuum cleaner may additionally require a leak sensor. Air purifiers may require vibration sensors, microphones, and / or air quality sensors.
[0119] In one embodiment of the present disclosure, if a home appliance is unable to equip all the necessary sensors, it may not be able to fully utilize IoT functions. For example, older home appliances may be used without equipping the required sensors. Home appliances that are not equipped with various sensors may only support simple functions through IoT services, such as power on / off, and may not be able to support additional status checking functions, such as more detailed operating status and operating time.
[0120] In one embodiment of the present disclosure, if a home appliance is not equipped with various sensors, it may not be able to predict error situations, and thus the user may not be able to detect the appliance's malfunction early. For example, a washing machine equipped with a vibration sensor can resolve the cause of the malfunction through a self-help guide that detects excessive shaking and recommends leveling, whereas a washing machine not equipped with a vibration sensor may not be able to detect such error situations (e.g., excessive shaking). For example, the user may want to use a sensing function utilizing sensors based on new technologies that were not available at the time of the appliance's sale (e.g., vision sensors or LiDAR sensors).
[0121] Embodiments of the present disclosure group at least one sensor located around the IoT device (320) but not included in the IoT device (e.g., IoT device (320)) with the IoT device (320), and through the grouped at least one sensor, the IoT functions of the IoT device (320) can be extended, and / or an early warning of an error situation of the IoT device (320) can be provided. For example, in the case of a washing machine having IoT functions without a vibration sensor and a leak sensor, an external sensor attached to the washing machine (e.g., a vibration sensor) can determine the time when the washing started and ended, and an external sensor attached to the detergent container (e.g., a leak sensor) can determine whether the detergent has been emptied.
[0122] In one embodiment of the present disclosure, the IoT device (320) may be grouped with at least one external sensor device so as to be coupled with at least one external sensor device. In one embodiment of the present disclosure, the at least one external sensor device grouped with the IoT device (320) may be designated as a companion device. The companion device may be selected based on proximity to the IoT device (320). In one embodiment of the present disclosure, the companion device corresponding to the IoT device (320) may be physically identified based on signal strength based on a short-range wireless communication method (e.g., Wi-Fi, BLE, UWB, or Zigbee) or physically identified via a USB or cable connection. In one embodiment of the present disclosure, the companion device corresponding to the IoT device (320) may be identified based on user input received through a user device (e.g., an electronic device (310)) associated with the IoT device (320).
[0123] FIG. 8 is a flowchart illustrating a procedure for performing a search for surrounding sensors by an IoT device according to one embodiment of the present disclosure.
[0124] According to embodiments of the present disclosure, at least one of the operations described below may be omitted, modified, or executed in a different order. In one embodiment of the present disclosure, at least one of the operations described below may be executed by a processor of the IoT device (320) (e.g., processor (412) of FIG. 4a). In one embodiment of the present disclosure, a memory of the IoT device (320) (e.g., memory (416) of FIG. 4a) may store instructions that cause the IoT device (320) to operate according to at least one of the operations described below.
[0125] Referring to FIG. 8, in operation 802, an IoT device (320) (e.g., a processor (412)) may receive a command from an electronic device (310) requesting a search for surrounding sensors for sensor grouping via a communication circuit (e.g., a communication circuit (414) in FIG. 4a). In one embodiment of the present disclosure, the electronic device (310) may execute an IoT client application and transmit the command to the IoT device (320) based on receiving user input requesting a search for surrounding sensors for the IoT device (320) via the IoT client application. In one embodiment of the present disclosure, the command may be received via a D2D connection according to Wi-Fi, Bluetooth, Zigbee, or other short-range communication methods.
[0126] In another embodiment of the present disclosure, the IoT device (320) (e.g., processor (412)) may receive the command from a server (e.g., server (350) of FIG. 3). In another embodiment of the present disclosure, instead of receiving the command from the electronic device (310), the IoT device (320) (e.g., processor (412)) may receive user input requesting to perform a search for surrounding sensors for sensor grouping through an input means (e.g., button, touchscreen, or microphone) of the IoT device (320).
[0127] In operation 804, an IoT device (320) (e.g., processor (412)) may discover one or more external sensor devices (e.g., sensors of FIG. 10 (330a, 330b, 330c)) through a designated short-range communication method (e.g., Wi-Fi, Bluetooth legacy, BLE, Zigbee, or UWB). In one embodiment of the present disclosure, the IoT device (320) (e.g., processor (412)) may receive signals broadcast from the one or more external sensor devices (e.g., beacon signals, probe signals, advertising (ADV) packets, or corresponding response signals) by performing a scan based on Wi-Fi, BLE, or Zigbee methods (e.g., page scan or BLE scan), and may identify the one or more external sensor devices based on the reception of the signals.
[0128] In one embodiment of the present disclosure, an IoT device (320) (e.g., a processor (412)) may establish D2D connections (e.g., Wi-Fi / BLE / Zigbee links) with each of the one or more external sensor devices based on receiving the broadcasted signals.
[0129] In operation 806, the IoT device (320) (e.g., processor (412)) may receive sensor device information and / or signal strength information from one or more external sensor devices. In one embodiment of the present disclosure, the IoT device (320) (e.g., processor (412)) may transmit a request message to one or more external sensor devices via D2D connections and receive a response message containing sensor device information and / or signal strength information from one or more external sensor devices based on transmitting the request message.
[0130] In one embodiment of the present disclosure, the sensor device information may include at least one of the device name, device type, or device ID of each external sensor device. In one embodiment of the present disclosure, the device type may indicate the sensor type of each external sensor device (e.g., temperature sensor, vibration sensor, microphone, battery monitor, air quality sensor, or leak sensor).
[0131] In one embodiment of the present disclosure, the signal strength information may include a received signal strength (e.g., RSSI (received signal strength indicator)) measured by each external sensor device for a signal received from the IoT device (320). In one embodiment of the present disclosure, instead of receiving signal strength information from each external sensor device, the IoT device (320) (e.g., processor (412)) may measure the received signal strength for a signal received by the IoT device (320) from each external sensor device and generate the signal strength information including the measured received signal strength.
[0132] In operation 808, the IoT device (320) (e.g., processor (412)) may group at least one external sensor device selected from among the one or more external sensor devices with the IoT device (320) based on the sensor device information and the signal strength information. In one embodiment of the present disclosure, the IoT device (320) (e.g., processor (412)) may select at least one external sensor device among the one or more external sensor devices that has a received signal strength greater than a specified threshold.
[0133] In one embodiment of the present disclosure, an IoT device (320) (e.g., a processor (412)) may select at least one external sensor device corresponding to a sensor type required for the IoT device (320) based on the device type of the IoT device (320) and the sensor type indicated by the sensor device information. In one embodiment of the present disclosure, an IoT device (320) (e.g., a processor (412)) may select at least one external sensor device corresponding to at least one sensor type that is not mounted on the IoT device (320).
[0134] In operation 810, the IoT device (320) (e.g., processor (412)) may determine an error situation of the IoT device (320) based on sensor data received from at least one grouped external sensor device, or report the sensor data (or analysis results based on the sensor data) to an external electronic device (e.g., electronic device (310) or server (350)), thereby allowing the external electronic device to determine an error situation of the IoT device (320) based on the sensor data. In one embodiment of the present disclosure, the IoT device (320) (e.g., processor (412)) may provide action guide information related to the error situation (e.g., display, or sound output) based on the detection of the error situation by the sensor data. In one embodiment of the present disclosure, the IoT device (320) (e.g., processor (412)) may transmit a notification regarding the error situation to a post-service center (602), an IoT management center (604), and / or a manufacturer.
[0135] FIG. 9 is a flowchart illustrating a procedure for performing a search for surrounding sensors by an electronic device according to one embodiment of the present disclosure.
[0136] According to embodiments of the present disclosure, at least one of the operations described below may be omitted, modified, or executed in a different order. In one embodiment of the present disclosure, at least one of the operations described below may be executed by a processor of an electronic device (310) (e.g., processor (220) of FIG. 2). In one embodiment of the present disclosure, a memory of an electronic device (310) (e.g., memory (230) of FIG. 2) may store instructions that cause the electronic device (310) to operate according to at least one of the operations described below.
[0137] Referring to FIG. 9, in operation 902, an electronic device (310) (e.g., a processor (220)) may receive user input requesting sensor grouping associated with an IoT device (320). In one embodiment of the present disclosure, the electronic device (310) (e.g., a processor (220)) may run an IoT client application and receive the user input selecting an IoT device (320) that requires an external sensor through the IoT client application. In one embodiment of the present disclosure, the user input may include a touch on an input object (e.g., an object (514) or a device symbol (526)) corresponding to the IoT device (320) on the execution screen of the IoT client application (e.g., a dashboard screen (510) in FIG. 5a or a map view screen (520) in FIG. 5b). In one embodiment of the present disclosure, the user input may include a touch on an input object indicating that sensor grouping is required.
[0138] In operation 904, the electronic device (310) (e.g., processor (220)) may display a user interface (e.g., a guidance message, "Please move to the vicinity of the washing machine") requesting movement to the vicinity of the IoT device (320) based on receiving the user input. In one embodiment of the present disclosure, when the electronic device (310) (e.g., processor (220)) determines that the electronic device (310) is located near the IoT device (320) based on receiving a signal broadcast from the IoT device (320) (e.g., a beacon signal, a probe signal, an advertising packet, or a corresponding response signal) or identifying that a D2D connection with the IoT device (320) has been established, operations 904 and 906 may be omitted and proceed to operation 910.
[0139] In operation 906, an electronic device (310) (e.g., a processor (220)) may discover the IoT device (320) based on receiving a signal broadcast from the IoT device (320) using a short-range communication method (e.g., Wi-Fi, BLE, or Zigbee) to confirm that it is located near the IoT device (320). In one embodiment of the present disclosure, the electronic device (310) (e.g., a processor (220)) may establish a D2D connection (e.g., a Wi-Fi / BLE / Zigbee connection) with the IoT device (320). The electronic device (310) (e.g., a processor (220)) may receive device information (e.g., a device ID) of the IoT device (320) from the IoT device (320) through the D2D connection.
[0140] In operation 908, the electronic device (310) (e.g., processor (220)) may receive user input requesting a search for surrounding sensors for the IoT device (320). In one embodiment of the present disclosure, after discovering the IoT device (320) or establishing a D2D connection with the IoT device (320), the electronic device (310) (e.g., processor (220)) may display a user interface (e.g., a guidance message “Would you like to search for external sensors?”) to inquire whether to perform a search for surrounding sensors, and may receive the user input requesting a search for surrounding sensors through the user interface. In one embodiment of the present disclosure, operation 908 may be omitted, and the electronic device (310) (e.g., processor (220)) may proceed to operation 910 without user input after discovering the IoT device (320).
[0141] In operation 910, an electronic device (310) (e.g., a processor (220)) can detect one or more external sensor devices (e.g., sensors (330a, 330b, 330c) of FIG. 10) through a designated short-range communication method (e.g., Wi-Fi, BLE, or Zigbee). In one embodiment of the present disclosure, the electronic device (310) (e.g., a processor (220)) can receive signals broadcast from the one or more external sensor devices (e.g., advertising (ADV) packets) by performing a scan based on the Wi-Fi, BLE, or Zigbee method (e.g., a page scan or a BLE scan), and can identify the one or more external sensor devices based on receiving the signals.
[0142] In one embodiment of the present disclosure, an electronic device (310) (e.g., a processor (220)) may establish D2D connections (e.g., Bluetooth links) with each of the one or more external sensor devices based on receiving the broadcasted signals.
[0143] In operation 912, the electronic device (310) (e.g., processor (220)) may receive sensor device information and / or signal strength information from one or more external sensor devices. In one embodiment of the present disclosure, the electronic device (310) (e.g., processor (220)) may transmit a request message to one or more external sensor devices via D2D connections and receive a response message containing sensor device information and / or signal strength information from one or more external sensor devices based on transmitting the request message.
[0144] In one embodiment of the present disclosure, the sensor device information may include at least one of the device name, device type, or device ID of each external sensor device. In one embodiment of the present disclosure, the device type may indicate the sensor type of each external sensor device (e.g., temperature sensor, vibration sensor, microphone, battery monitor, air quality sensor, or leak sensor).
[0145] In one embodiment of the present disclosure, the signal strength information may include a received signal strength (e.g., RSSI) measured by each external sensor device for a signal received from the electronic device (310). In one embodiment of the present disclosure, instead of receiving signal strength information from each external sensor device, the electronic device (310) (e.g., processor (220)) may measure a received signal strength for a signal received by the electronic device (310) from each external sensor device and generate the signal strength information including the measured received signal strength.
[0146] In operation 914, the electronic device (310) (e.g., processor (220)) may group at least one external sensor device selected from among the one or more external sensor devices with the IoT device (320) based on the sensor device information and the signal strength information. In one embodiment of the present disclosure, the electronic device (310) (e.g., processor (220)) may select at least one external sensor device among the one or more external sensor devices that has a received signal strength greater than a specified threshold.
[0147] In one embodiment of the present disclosure, an electronic device (310) (e.g., a processor (220)) may select at least one external sensor device corresponding to a sensor type required for the IoT device (320) based on the device type of the IoT device (320) and the sensor type indicated by the sensor device information. In one embodiment of the present disclosure, an electronic device (310) (e.g., a processor (220)) may select at least one external sensor device corresponding to at least one sensor type that is not mounted on the IoT device (320). In one embodiment of the present disclosure, if there are multiple external sensor devices having the same sensor type, the electronic device (310) (e.g., a processor (220)) may select and group one external sensor device having the largest signal strength.
[0148] In one embodiment of the present disclosure, an electronic device (310) (e.g., a processor (220)) may display a user interface (e.g., the user interface (2010) of FIG. 20a, the user interface (2020) of FIG. 20b, and the user interface (2030) of FIG. 20c) representing at least one external sensor device grouped with the IoT device (320).
[0149] In operation 916, the electronic device (310) (e.g., processor (220)) may determine an error situation of the IoT device (320) based on sensor data received from at least one grouped external sensor device, or report the sensor data (or analysis results based on the sensor data) to an external electronic device (e.g., IoT device (320) or server (350)). In one embodiment of the present disclosure, the electronic device (310) (e.g., processor (220)) may provide action guide information related to the error situation (e.g., display, or sound output) based on the detection of the error situation by the sensor data. In one embodiment of the present disclosure, the electronic device (310) (e.g., processor (220)) may transmit a notification of the error situation to a post-service center (602), an IoT management center (604), and / or a manufacturer (606).
[0150] FIG. 10 is a sequence diagram illustrating surrounding sensor search and sensor grouping according to one embodiment of the present disclosure.
[0151] According to embodiments of the present disclosure, at least one of the operations described below may be omitted, modified, or performed in a different order.
[0152] Referring to FIG. 10, in operation 1002, the IoT device (320) may receive a command or user input requesting a search for surrounding sensors for sensor grouping. In one embodiment of the present disclosure, the command may be received from a server (e.g., server (350) of FIG. 3) via the Internet or from an electronic device (e.g., electronic device (310) of FIG. 3) via a D2D connection. In operation 1004, the IoT device (320) may perform a scan (e.g., page scan or BLE scan) for searching for surrounding sensors based on receiving the command or user input.
[0153] In operations 1006, 1008, and 1010, the IoT device (320) can discover Sensor 1 (330a), Sensor 2 (330b), and Sensor 3 (330c) based on receiving signals broadcast from Sensor 1 (330a), Sensor 2 (330b), and Sensor 3 (330c), respectively (e.g., beacon signals, probe signals, advertising packets, or corresponding response signals). In one embodiment of the present disclosure, Sensor 1 (330a) may be a vibration sensor 1 with device ID ABCD, Sensor 2 (330b) may be a vibration sensor 2 with device ID EFGH, and Sensor 3 (330c) may be a temperature sensor with device ID TEMP. In one embodiment of the present disclosure, the IoT device (320) can establish D2D connections with sensor 1 (330a), sensor 2 (330b), and sensor 3 (330c), respectively, based on receiving the broadcasted signals.
[0154] In operation 1012, the IoT device (320) may transmit a request message to sensor 1 (330a) to request sensor device information and signal strength information. In operation 1014, the IoT device (320) may receive a response message from sensor 1 (330a) that includes sensor device information and signal strength information. In one embodiment of the present disclosure, the sensor device information may include device name = 'vibration sensor 1', device type = 'Axis', and device ID = 'ABCD'. In one embodiment of the present disclosure, the signal strength information may include a quantized signal strength value, for example, '5'.
[0155] In operation 1016, the IoT device (320) may send a request message to sensor 2 (330a) to request sensor device information and signal strength information. In operation 1018, the IoT device (320) may receive a response message from sensor 2 (330b) that includes sensor device information and signal strength information. In one embodiment of the present disclosure, the sensor device information may include device name = 'vibration sensor 2', device type = 'Axis', and device ID = 'EFGH'. In one embodiment of the present disclosure, the signal strength information may include a quantized signal strength value, for example, '15'.
[0156] In operation 1020, the IoT device (320) may transmit a request message to sensor 3 (330c) to request sensor device information and signal strength information. In operation 1022, the IoT device (320) may receive a response message from sensor 3 (330c) that includes sensor device information and signal strength information. In one embodiment of the present disclosure, the sensor device information may include device name = 'temperature sensor', device type = 'Temperature', and device ID = 'TEMP'. In one embodiment of the present disclosure, the signal strength information may include a quantized signal strength value, for example, '12'.
[0157] In operation 1024, the IoT device (320) selects at least one sensor (e.g., sensor 2 (330b) and sensor 3 (330c)) to be grouped with the IoT device (320) based on sensor device information and signal strength information of each of sensor 1 (330a), sensor 2 (330b), and sensor 3 (330c), and can group sensor 2 (330b) and sensor 3 (330c) with the IoT device (320). In one embodiment of the present disclosure, the IoT device (320) can select at least one sensor having a signal strength greater than a specified threshold (e.g., '10'). In one embodiment of the present disclosure, the IoT device (320) can select at least one sensor having sensor types (e.g., vibration sensor and / or temperature sensor) corresponding to the device type of the IoT device (320) (e.g., 'washing machine'). In one embodiment of the present disclosure, the IoT device (320) may exclude a sensor type (e.g., a leak sensor) of an embedded sensor that the IoT device (320) already includes from sensor grouping.
[0158] In one embodiment of the present disclosure, at least one sensor selected through grouping (e.g., sensor 2 (330b) and sensor 3 (330c)) may be companion devices corresponding to the IoT device (320). The IoT device (320) may store grouping information including the device ID of the IoT device (320) (e.g., 'DA1') and companion device information (e.g., [EFGH, TEMP]). In one embodiment, the IoT device (320) may report the grouping information to an external electronic device (e.g., electronic device (310) and / or server (350)).
[0159] In operation 1026, the IoT device (320) can determine whether an error situation has occurred in the IoT device (320) based on sensor data collected through the companion devices (e.g., sensor 2 (330b) and sensor 3 (330c)). In one embodiment of the present disclosure, the IoT device (320) receives sensor data from sensor 2 (330b) and sensor 3 (330c) periodically or on a request basis, and analyzes the sensor data to determine whether an error situation has occurred in the IoT device (320) or whether an early warning has occurred. In one embodiment of the present disclosure, the IoT device (320) can report the sensor data or the corresponding analysis results to an external electronic device (e.g., electronic device (310) and / or server (350)). In one embodiment of the present disclosure, the IoT device (320) can provide a report and action guide based on the sensor data or the corresponding analysis results to a user (e.g., display or sound output).
[0160] FIG. 11 is a sequence diagram showing sensor grouping based on a sensor list according to one embodiment of the present disclosure.
[0161] According to embodiments of the present disclosure, at least one of the operations described below may be omitted, modified, or performed in a different order.
[0162] Referring to FIG. 11, in operation 1102, the IoT device (320) may receive a command or user input requesting sensor grouping. In one embodiment of the present disclosure, the command may be received from a server (e.g., server (350) of FIG. 3) via the Internet or from an electronic device (e.g., electronic device (310) of FIG. 3) via a D2D connection.
[0163] In operation 1104, the IoT device (320) may send a request message to the server (350) to request location information of the IoT device (320). In one embodiment of the present disclosure, the server (350) may identify location information indicating the location where the IoT device (320) is installed (e.g., room ID = 'kitchen') based on the request message. In operation 1106, the server (350) may send a response message containing the location information to the IoT device (320).
[0164] In operation 1108, the IoT device (320) may transmit a request message to a server (350) containing location information (e.g., room ID = 'kitchen') to request information about sensors located around the IoT device (320). In one embodiment of the present disclosure, the server (350) may generate a sensor list including at least one sensor located around the IoT device (320) based on the request message. In one embodiment of the present disclosure, the sensor list may include the device name, device type, device ID, and / or MAC (medium access control) address of each of the at least one sensor.
[0165] In one embodiment of the present disclosure, the server (350) may identify at least one room near the kitchen (e.g., a utility room and room 3) and include at least one sensor located within the kitchen and / or at least one sensor located within the identified at least one room in the sensor list. In one embodiment of the present disclosure, the server (350) may include at least one sensor having a required sensor type according to the device type (e.g., 'washing machine') of the IoT device (320) in the sensor list. In one embodiment of the present disclosure, the server (350) may not include a sensor type of an embedded sensor (e.g., a leak sensor) that the IoT device (320) already includes in the sensor list.
[0166] In operation 1110, the server (350) may transmit a response message containing the sensor list to the IoT device (320). In one embodiment of the present disclosure, the IoT device (320) may transmit a single integrated request message instead of the request messages of operations 1104 and 1108 and receive the sensor list from the server (350).
[0167] In operation 1112, the IoT device (320) can group at least one sensor included in the sensor list (e.g., sensor 2 (330b) and sensor 3 (330c)) with the IoT device (320). The IoT device (320) can store grouping information including the device ID of the IoT device (320) (e.g., 'DA1') and companion device information representing the at least one sensor.
[0168] In operation 1114, the IoT device (320) may report the grouping information to an external electronic device (e.g., electronic device (310) and / or server (350)). In one embodiment of the present disclosure, the IoT device (320) may establish a D2D connection (e.g., Wi-Fi connection or Bluetooth connection) with at least one sensor based on the information included in the sensor list.
[0169] In operation 1116, the IoT device (320) can determine whether an error situation has occurred in the IoT device (320) based on the grouping information and sensor data collected through the at least one sensor. In one embodiment of the present disclosure, the IoT device (320) receives sensor data from the at least one sensor on a periodic or request basis and analyzes the sensor data to determine whether an error situation has occurred in the IoT device (320) or whether an early warning has occurred. In one embodiment of the present disclosure, the IoT device (320) can report the sensor data or the corresponding analysis results to an external electronic device (e.g., electronic device (310) and / or server (350)). In one embodiment of the present disclosure, the IoT device (320) can provide a report and action guide based on the sensor data or the corresponding analysis results to a user (e.g., display or sound output).
[0170] FIG. 12 is a sequence diagram illustrating surrounding sensor search and sensor grouping according to one embodiment of the present disclosure.
[0171] According to embodiments of the present disclosure, at least one of the operations described below may be omitted, modified, or performed in a different order.
[0172] Referring to FIG. 12, in operation 1202, the electronic device (310) may display a user interface (UI) including a guidance message (e.g., “Please move to the vicinity of the washing machine”) requesting movement to the vicinity of the IoT device (320) for sensor grouping. In one embodiment of the present disclosure, the electronic device (310) may display the user interface based on user input requesting sensor grouping through an IoT client application. In one embodiment of the present disclosure, the user input may include a touch on an input object (e.g., object (514) or device symbol (526)) corresponding to the IoT device (320) on a dashboard screen (e.g., dashboard screen (510) of FIG. 5a) or a map view screen (e.g., map view screen (520) of FIG. 5b). In one embodiment of the present disclosure, the user input may include a touch on an input object indicating that sensor grouping is required.
[0173] In operation 1204, an electronic device (310) (e.g., a processor (220)) may discover the IoT device (320) based on receiving a signal broadcast from the IoT device (320) (e.g., a beacon signal, a probe signal, an advertising packet, or a corresponding response signal) to confirm that it is located near the IoT device (320). In one embodiment of the present disclosure, the electronic device (310) (e.g., a processor (220)) may establish a D2D connection (e.g., a Wi-Fi connection or a Bluetooth connection) with the IoT device (320).
[0174] In operation 1206, the electronic device (310) can send a request message to request device information to the IoT device (320) through the D2D connection.
[0175] In operation 1208, the electronic device (310) may receive a response message containing device information of the IoT device (320) in response to the request message. In one embodiment of the present disclosure, the device information may include device name = 'Washer SS', device type = 'Washer', and device ID = 'DA1'.
[0176] In operation 1210, the electronic device (310) can receive user input requesting a search for surrounding sensors for the IoT device (320).
[0177] In operation 1212, the electronic device (310) (e.g., processor (220)) can, after establishing a D2D connection with the IoT device (320), display a user interface (e.g., a prompt "Would you like to search for external sensors?") to inquire whether to perform a search for surrounding sensors, and receive the user input requesting a search for surrounding sensors through the user interface.
[0178] In operations 1214, 1216, and 1218, the electronic device (310) may discover Sensor 1 (330a), Sensor 2 (330b), and Sensor 3 (330c) based on receiving signals broadcast from Sensor 1 (330a), Sensor 2 (330b), and Sensor 3 (330c), respectively (e.g., beacon signals, probe signals, advertising packets, or corresponding response signals). In one embodiment of the present disclosure, Sensor 1 (330a) may be a vibration sensor 1 with device ID ABCD, Sensor 2 (330b) may be a vibration sensor 2 with device ID EFGH, and Sensor 3 (330c) may be a temperature sensor with device ID TEMP. In one embodiment of the present disclosure, the electronic device (310) can establish D2D connections with sensor 1 (330a), sensor 2 (330b), and sensor 3 (330c), respectively, based on receiving the broadcasted signals.
[0179] In operation 1220, the electronic device (310) may transmit a request message to sensor 1 (330a) to request sensor device information and signal strength information. In operation 1222, the electronic device (310) may receive a response message from sensor 1 (330a) that includes sensor device information and signal strength information. In one embodiment of the present disclosure, the sensor device information may include device name = 'vibration sensor 1', device type = 'Axis', and device ID = 'ABCD'. In one embodiment of the present disclosure, the signal strength information may include a quantized signal strength value, for example, '5'.
[0180] In operation 1224, the electronic device (310) can send a request message to sensor 2 (330a) to request sensor device information and signal strength information.
[0181] In operation 1226, the electronic device (310) may receive a response message from sensor 2 (330b) that includes sensor device information and signal strength information. In one embodiment of the present disclosure, the sensor device information may include device name = 'vibration sensor 2', device type = 'Axis', and device ID = 'EFGH'. In one embodiment of the present disclosure, the signal strength information may include a quantized signal strength value, for example, '15'.
[0182] In operation 1228, the electronic device (310) can send a request message to sensor 3 (330c) to request sensor device information and signal strength information.
[0183] In operation 1230, the electronic device (310) may receive a response message from sensor 3 (330c) that includes sensor device information and signal strength information. In one embodiment of the present disclosure, the sensor device information may include device name = 'temperature sensor', device type = 'Temperature', and device ID = 'TEMP'. In one embodiment of the present disclosure, the signal strength information may include a quantized signal strength value, for example, '12'.
[0184] In operation 1232, the electronic device (310) selects at least one sensor (e.g., sensor 2 (330b) and sensor 3 (330c)) to be grouped with the IoT device (320) based on the sensor device information and signal strength information of each of sensor 1 (330a), sensor 2 (330b), and sensor 3 (330c), and can group sensor 2 (330b) and sensor 3 (330c) with the IoT device (320). In one embodiment of the present disclosure, the electronic device (310) can select at least one sensor having a signal strength greater than a specified threshold (e.g., '10'). In one embodiment of the present disclosure, the electronic device (310) can select at least one sensor having sensor types (e.g., vibration sensor and / or temperature sensor) corresponding to the device type (e.g., 'washing machine') of the IoT device (320). In one embodiment of the present disclosure, the electronic device (310) may exclude a sensor type (e.g., a leak sensor) of an embedded sensor already included in the IoT device (320) from sensor grouping.
[0185] In one embodiment of the present disclosure, at least one sensor selected through grouping (e.g., sensor 2 (330b) and sensor 3 (330c)) may be companion devices corresponding to the IoT device (320). The electronic device (310) may store grouping information including the device ID of the IoT device (320) (e.g., 'DA1') and companion device information (e.g., [EFGH, TEMP]). In one embodiment of the present disclosure, the electronic device (310) may report the grouping information to a server (350).
[0186] In operation 1234, the electronic device (310) can determine whether an error situation has occurred in the IoT device (320) based on sensor data collected through the companion devices (e.g., sensor 2 (330b) and sensor 3 (330c)). In one embodiment of the present disclosure, the electronic device (310) receives sensor data from sensor 2 (330b) and sensor 3 (330c) on a periodic or request basis and analyzes the sensor data to determine whether an error situation has occurred in the IoT device (320) or whether an early warning has occurred. In one embodiment of the present disclosure, the electronic device (310) can report the sensor data or the corresponding analysis results to the server (350). In one embodiment of the present disclosure, the electronic device (310) can provide a report and action guide based on the sensor data or the corresponding analysis results to the user (e.g., display or sound output).
[0187] FIG. 13 is a sequence diagram illustrating a search for surrounding sensors using a mobile device according to one embodiment of the present disclosure.
[0188] According to embodiments of the present disclosure, at least one of the operations described below may be omitted, modified, or performed in a different order.
[0189] Referring to FIG. 13, in operation 1302, the electronic device (310) may receive user input selecting an IoT device (320) to perform sensor grouping. In one embodiment of the present disclosure, the electronic device (310) may receive the user input through an IoT client application. In one embodiment, the user input may include a touch on an input object (e.g., object (514) or device symbol (526)) corresponding to the IoT device (320) on a dashboard screen (e.g., dashboard screen (510) of FIG. 5a) or a map view screen (e.g., map view screen (520) of FIG. 5b). In one embodiment of the present disclosure, the user input may include a touch on an input object indicating that sensor grouping is required.
[0190] In one embodiment of the present disclosure, an electronic device (310) (e.g., a processor (220)) can establish a D2D connection (e.g., a Wi-Fi connection or a Bluetooth connection) with an IoT device (320) based on receiving a signal broadcast from the IoT device (320) (e.g., a beacon signal, a probe signal, an advertising packet, or a corresponding response signal).
[0191] In operation 1304, the electronic device (310) can send a request message to request device information to the IoT device (320) through the D2D connection.
[0192] In operation 1306, the electronic device (310) may receive a response message containing device information of the IoT device (320) in response to the request message. In one embodiment of the present disclosure, the device information may include device name = 'Washer SS', device type = 'Washer', and device ID = 'DA1'.
[0193] In operation 1308, the electronic device (310) may receive user input requesting a search for surrounding sensors for the IoT device (320). In one embodiment of the present disclosure, the electronic device (310) (e.g., processor (220)) may, after establishing a D2D connection with the IoT device (320), display a user interface (e.g., a guidance message “Would you like to search for external sensors with a robot vacuum?”) to inquire whether to perform a search for surrounding sensors through the mobile IoT device (320f), and receive the user input requesting a search for surrounding sensors through the user interface.
[0194] In operation 1310, the electronic device (310) may transmit a surrounding sensor search command to a mobile IoT device (320f) instructing it to perform a surrounding sensor search for the IoT device (320). In one embodiment of the present disclosure, the surrounding sensor search command may include information indicating the location of the IoT device (320) (e.g., room ID = 'kitchen') and / or the device ID of the IoT device (320) (e.g., 'DA1').
[0195] In operation 1312, the mobile IoT device (320f) can move to the vicinity of the IoT device (320) (e.g., kitchen) in response to the surrounding sensor search command. In one embodiment of the present disclosure, the mobile IoT device (320f) can identify the room where the IoT device (320) is located based on a pre-stored map.
[0196] In operation 1314, the mobile IoT device (320f) can perform a scan for searching surrounding sensors (e.g., page scan or BLE scan) via a specified short-range communication method (e.g., Wi-Fi, BLE, or Zigbee) based on arrival at the vicinity of the IoT device (320) (e.g., kitchen).
[0197] In operation 1316, a mobile IoT device (320f) can discover Sensor 1 (330a), Sensor 2 (330b), and Sensor 3 (330c) based on receiving signals broadcast from Sensor 1 (330a), Sensor 2 (330b), and Sensor 3 (330c), respectively (e.g., beacon signals, probe signals, advertising packets, or corresponding response signals). In one embodiment of the present disclosure, Sensor 1 (330a) may be a vibration sensor 1 with device ID ABCD, Sensor 2 (330b) may be a vibration sensor 2 with device ID EFGH, and Sensor 3 (330c) may be a temperature sensor with device ID TEMP. In one embodiment of the present disclosure, a mobile IoT device (320f) can establish D2D connections with sensor 1 (330a), sensor 2 (330b), and sensor 3 (330c), respectively, based on receiving the broadcasted signals.
[0198] In operation 1318, the mobile IoT device (320f) can send request messages to sensor 1 (330a), sensor 2 (330b), and sensor 3 (330c), respectively, to request sensor device information and signal strength information.
[0199] In operation 1320, the mobile IoT device (320f) can receive response messages containing sensor device information (dev_info) and signal strength information (sig_str) from sensor 1 (330a), sensor 2 (330b), and sensor 3 (330c), respectively.
[0200] In operation 1322, the mobile IoT device (320f) can transmit a sensor information response message to the electronic device (310) that includes sensor device information and signal strength information of sensor 1 (330a), sensor 2 (330b), and sensor 3 (330c).
[0201] In operation 1324, the electronic device (310) selects at least one sensor (e.g., sensor 2 (330b) and sensor 3 (330c)) to be grouped with the IoT device (320) based on the sensor device information and signal strength information of each of sensor 1 (330a), sensor 2 (330b), and sensor 3 (330c), and can group sensor 2 (330b) and sensor 3 (330c) with the IoT device (320). In one embodiment of the present disclosure, the electronic device (310) can select at least one sensor having a signal strength greater than a specified threshold (e.g., '10'). In one embodiment of the present disclosure, the electronic device (310) can select at least one sensor having sensor types (e.g., vibration sensor and / or temperature sensor) corresponding to the device type (e.g., 'washing machine') of the IoT device (320). In one embodiment of the present disclosure, the electronic device (310) may exclude a sensor type (e.g., a leak sensor) of an embedded sensor already included in the IoT device (320) from sensor grouping.
[0202] In one embodiment of the present disclosure, at least one sensor selected through grouping (e.g., sensor 2 (330b) and sensor 3 (330c)) may be companion devices corresponding to the IoT device (320). The electronic device (310) may store grouping information including the device ID of the IoT device (320) (e.g., 'DA1') and companion device information (e.g., [EFGH, TEMP]). In one embodiment of the present disclosure, the electronic device (310) may report the grouping information to a server (350).
[0203] In operation 1326, the electronic device (310) can determine whether an error situation has occurred in the IoT device (320) based on sensor data collected through the companion devices (e.g., sensor 2 (330b) and sensor 3 (330c)). In one embodiment of the present disclosure, the electronic device (310) receives sensor data from sensor 2 (330b) and sensor 3 (330c) on a periodic or request basis and analyzes the sensor data to determine whether an error situation has occurred in the IoT device (320) or whether an early warning has occurred. In one embodiment of the present disclosure, the electronic device (310) can report the sensor data or the corresponding analysis results to the server (350). In one embodiment of the present disclosure, the electronic device (310) can provide a report and action guide based on the sensor data or the corresponding analysis results to the user (e.g., display or sound output).
[0204] FIGS. 14a and FIGS. 14b are drawings for illustrating the selection of sensors according to various embodiments of the present disclosure.
[0205] Referring to FIG. 14a, the electronic device (310) may execute an IoT client application for an IoT service and, based on the execution of said client application, display a dashboard screen (1410) through a display module (e.g., a display module (260)). The dashboard screen (1410) may include objects (e.g., objects (1412, 1414)) corresponding to one or more onboarded IoT devices (e.g., an oven, an air conditioner, a dryer, a vibration sensor, and a washing machine). In one embodiment of the present disclosure, said objects may be arranged in a tile grid.
[0206] In one embodiment of the present disclosure, the dashboard screen (1410) may include one of a plurality of pages corresponding to each of a plurality of rooms corresponding to a local network for IoT services (e.g., the local network (345) of FIG. 3), e.g., a page corresponding to the kitchen. The electronic device (310) may allow the user to recognize that a vibration sensor corresponding to object (1412) is located around a washing machine corresponding to object (1414) through the dashboard screen (1410) which includes objects (1412, 1414).
[0207] In one embodiment of the present disclosure, the electronic device (310) may determine to group a vibration sensor corresponding to object (1412) with a washing machine corresponding to object (1414) based on receiving user input (e.g., consecutive touches on object (1412) and object (1414)) requesting to group object (1412) and object (1414) for sensor grouping.
[0208] Referring to FIG. 14b, the electronic device (310) can execute a client application for IoT control services and, based on the execution of said client application, display a map view screen (1420) through a display module (e.g., a display module (260)). The map view screen (1420) may include a simplified map image (1422) corresponding to a local network (e.g., a local network (345) of FIG. 3), and a detailed map image (1424) including an expanded image of at least some area of said simplified map image (1422).
[0209] In one embodiment of the present disclosure, a simplified map image (1422) may represent a building structure (e.g., a floor plan) composed of a plurality of rooms corresponding to a local network for IoT services (e.g., the local network (345) of FIG. 3). In one embodiment of the present disclosure, a detailed map image (1424) may represent a partial floor plan corresponding to a portion of the simplified map image (1422) and may include device symbols (e.g., device symbols (1426a, 1426b)) displayed on the partial floor plan. In one embodiment of the present disclosure, each device symbol may be placed at a virtual location on the detailed map image (1424) corresponding to a location (e.g., a kitchen) where a corresponding actual IoT device (e.g., a washing machine and a vibration sensor) is installed. In one embodiment of the present disclosure, a device symbol (1426a) may correspond to a washing machine located in the kitchen, and a device symbol (1426b) may correspond to a vibration sensor for a washing machine located in the kitchen.
[0210] In one embodiment of the present disclosure, the electronic device (310) can make the user aware that a vibration sensor corresponding to device symbol (1426b) is located around a washing machine corresponding to device symbol (1426a) through a map view screen (1420) including device symbols (1426a, 1426b). In one embodiment of the present disclosure, the electronic device (310) can decide to group the vibration sensor corresponding to device symbol (1426b) with the washing machine corresponding to device symbol (1426a) based on receiving user input (e.g., consecutive touches on device symbol (1426a) and device symbol (1426b)) requesting to group device symbol (1426a) and device symbol (1426b) for sensor grouping.
[0211] FIG. 15 is a sequence diagram illustrating a procedure for selecting sensors to be grouped according to one embodiment of the present disclosure.
[0212] According to embodiments of the present disclosure, at least one of the operations described below may be omitted, modified, or performed in a different order.
[0213] Referring to FIG. 15, in operation 1502, the electronic device (310) can execute an IoT client application. In one embodiment of the present disclosure, the electronic device (310) can display an execution screen of the IoT client application (e.g., the dashboard screen (1410) of FIG. 14a or the map view screen (1420) of FIG. 14b) based on the execution of the IoT client application.
[0214] In operation 1504, the electronic device (310) may receive user input through the execution screen to select an IoT device (e.g., IoT device (320)) to be grouped with external sensor devices. In one embodiment of the present disclosure, the user input may include a touch on an object corresponding to the IoT device (320) (e.g., object (1414) in FIG. 14a or device symbol (1426a) in FIG. 14b). In one embodiment of the present disclosure, the electronic device (310) may establish a D2D connection with the IoT device (320) based on the user input.
[0215] In operation 1506, the electronic device (310) can send a request message to request device information to the IoT device (320) through the D2D connection.
[0216] In operation 1508, the electronic device (310) may receive a response message containing device information of the IoT device (320) in response to the request message. In one embodiment of the present disclosure, the device information may include device name = 'Washer SS', device type = 'Washer', and device ID = 'DA1'. In one embodiment of the present disclosure, if the electronic device (310) already knows the device information of the IoT device (320), operations 1506 and 1508 may be omitted.
[0217] In operation 1510, the electronic device (310) may transmit a request message to the server (350) to request information of external sensor devices associated with the IoT device (320). In one embodiment of the present disclosure, the request message may include device information of the IoT device (320) (e.g., device ID), and / or location information of the IoT device (320) (e.g., room ID).
[0218] In operation 1512, the electronic device (310) may receive a response message containing sensor device information of one or more external sensor devices (e.g., sensor 1 (330a), sensor 2 (330b), and sensor 3 (330c) of FIG. 10) in response to the request message.
[0219] In one embodiment of the present disclosure, the sensor device information may include at least one of the device name, device type, or device ID of each external sensor device. In one embodiment of the present disclosure, the device type may indicate the sensor type of each external sensor device (e.g., temperature sensor, vibration sensor, microphone, battery monitor, air quality sensor, or leak sensor).
[0220] In one embodiment of the present disclosure, if the electronic device (310) already knows of at least one external sensor device located in the vicinity (e.g., the same room) of the IoT device (320), operations 1510 and 1512 may be omitted.
[0221] In operation 1514, the electronic device (310) may display a sensor list screen representing one or more external sensor devices identified as being located around the IoT device (320). In one embodiment of the present disclosure, the sensor list screen may include one or more objects (e.g., the object (1412) of FIG. 14a or the device symbol (1426b) of FIG. 14b) corresponding to each of the one or more external sensor devices.
[0222] In operation 1516, the electronic device (310) may receive user input selecting at least one of the one or more external sensor devices through the sensor list screen. The user input may include a touch on at least one object corresponding to the at least one external sensor device (e.g., the object (1412) in FIG. 14a or the device symbol (1426b) in FIG. 14b).
[0223] In operation 1518, the electronic device (310) can group the selected at least one external sensor device with the IoT device (320). In one embodiment of the present disclosure, the electronic device (310) collects signal strength information for the at least one external sensor device selected by user input and can exclude the external sensor device having a signal strength not greater than a specified threshold from the sensor grouping. In one embodiment of the present disclosure, the electronic device (310) can exclude from the sensor grouping any of the at least one external sensor device selected by user input that does not have sensor types (e.g., vibration sensor and / or temperature sensor) corresponding to the device type (e.g., 'washing machine') of the IoT device (320). In one embodiment of the present disclosure, the electronic device (310) can exclude from the sensor grouping any of the at least one external sensor device selected by user input that has a sensor type of an embedded sensor already included in the IoT device (320).
[0224] In one embodiment of the present disclosure, at least one grouped sensor (e.g., Sensor 2 (330b) and Sensor 3 (330c) of FIG. 10) may be companion devices corresponding to the IoT device (320). The electronic device (310) may store grouping information including the device ID of the IoT device (320) (e.g., 'DA1') and companion device information (e.g., [EFGH, TEMP]).
[0225] In operation 1520, the electronic device (310) can report the grouping information to the server (350).
[0226] In operation 1522, the electronic device (310) can determine whether an error situation has occurred in the IoT device (320) based on sensor data collected through the companion devices (e.g., sensor 2 (330b) and sensor 3 (330c)). In one embodiment of the present disclosure, the electronic device (310) receives sensor data from sensor 2 (330b) and sensor 3 (330c) on a periodic or request basis and analyzes the sensor data to determine whether an error situation has occurred in the IoT device (320) or whether an early warning has occurred. In one embodiment of the present disclosure, the electronic device (310) can report the sensor data or the corresponding analysis results to the server (350). In one embodiment of the present disclosure, the electronic device (310) can provide a report and action guide based on the sensor data or the corresponding analysis results to the user (e.g., display or sound output).
[0227] In one embodiment of the present disclosure, an IoT device (e.g., IoT device (320)) grouped with one or more external sensor devices may be managed based on a single identifier (ID) (e.g., device ID or group ID of the IoT device (320)). In one embodiment of the present disclosure, an electronic device (310) may use the group ID during the execution of an IoT client application to collectively manage functions such as the status, operation, and automation of the IoT device (320) and the one or more external sensor devices.
[0228] FIG. 16 is a diagram illustrating a procedure for extracting a threshold range based on sensor data according to one embodiment of the present disclosure.
[0229] Referring to FIG. 16, sensor data (1600) may be collected by at least one external sensor device grouped with an IoT device (e.g., IoT device (320)). The sensor data (1600) may be input into any one of a tiny machine learning module (1602) included in the IoT device (320), a mobile machine learning module (1604) included in the electronic device (310), a hub machine learning module (1606) included in the hub (e.g., IoT device (320a) of FIG. 3), and / or a server machine learning module (1608) included in the server (350).
[0230] In one embodiment of the present disclosure, an IoT device (320) can analyze the sensor data (1600) using a tiny machine learning module (1602). In one embodiment of the present disclosure, an electronic device (310) can analyze the sensor data (1600) using a mobile machine learning module (1604). In one embodiment of the present disclosure, an IoT device (320a) can analyze the sensor data (1600) using a hub machine learning module (1606). In one embodiment of the present disclosure, a server (350) can analyze the sensor data (1600) using a server machine learning module (1608).
[0231] In one embodiment of the present disclosure, an electronic device (310) or a server (350) may generate an early warning function (1610) capable of detecting an early warning based on information learned by at least one of a tiny machine learning module (1602), a mobile machine learning module (1604), a hub machine learning module (1606), or a server machine learning module (1608). The early warning function (1610) may calculate a threshold range for generating an early warning for the sensor data (1600). In one embodiment of the present disclosure, the electronic device (310) or the server (350) may extract a predicted threshold range (1612) to be used for generating an early warning based on the early warning function (1610).
[0232] In one embodiment of the present disclosure, the server (350) databases various data such as device data collected from other sensor devices of the same or similar model as well as external sensor devices associated with the IoT device (320), external information such as weather, data accumulated by developers, and user actions, and can improve the accuracy of judgment regarding early warning by utilizing said database. In one embodiment of the present disclosure, in addition to machine learning, artificial intelligence (AI)-based anomaly detection technology may be used to generate early warning.
[0233] In one embodiment of the present disclosure, the IoT device (320) may input sensor data received from an external sensor device into a tiny machine learning module (1602) so that the tiny machine learning module (1602) learns based on the sensor data. In one embodiment of the present disclosure, the IoT device (320) may generate an early warning function for error information (e.g., an early warning function (1610)) based on the information learned by the tiny machine learning module (1602). In one embodiment of the present disclosure, the IoT device (320) may extract a prediction threshold range for the early warning function (1610) and detect an error situation based on the prediction threshold range.
[0234] In one embodiment of the present disclosure, the IoT device (320), electronic device (310), IoT device (320a), or server (350) may continuously update the prediction threshold range (1612) by repeatedly performing the operation of generating an early warning function (1610) and extracting a prediction threshold range (1612). In one embodiment of the present disclosure, the IoT device (320), electronic device (310), IoT device (320a), or server (350) may generate an early warning related to the IoT device (320) or determine that an error situation has occurred based on the fact that the value of sensor data collected by a grouped external sensor device falls outside the prediction threshold range (1612).
[0235] FIG. 17 is a flowchart illustrating a procedure for detecting an error situation according to one embodiment of the present disclosure.
[0236] According to embodiments of the present disclosure, at least one of the operations described below may be omitted, modified, or executed in a different order. In one embodiment of the present disclosure, at least one of the operations described below may be executed by a processor of an electronic device (310) (e.g., processor (220) of FIG. 2). In one embodiment of the present disclosure, a memory of an electronic device (310) (e.g., memory (230) of FIG. 2) may store instructions that cause the electronic device (310) to operate according to at least one of the operations described below.
[0237] Referring to FIG. 17, in operation 1702, the electronic device (310) (e.g., processor (220)) can identify that an action of the IoT device (320) is completed. In one embodiment of the present disclosure, if the IoT device (320) is a washing machine, the action may include a washing operation. In operation 1704, based on identifying that the action is completed, the electronic device (310) (e.g., processor (220)) may collect sensor data (e.g., first sensor data) from at least one external sensor device grouped together with the IoT device (320). In one embodiment of the present disclosure, the at least one external sensor device may include a vibration sensor and / or a leak sensor.
[0238] In operation 1706, the electronic device (310) (e.g., processor (220)) can determine whether the value of the first sensor data collected from the at least one external sensor device falls within a specified threshold range (e.g., the predicted threshold range (1612) of FIG. 16). If the value of the first sensor data is within the threshold range, the electronic device (310) (e.g., processor (220)) can terminate the procedure. If the value of the first sensor data is not within the threshold range, the electronic device (310) (e.g., processor (220)) can proceed to operation 1708.
[0239] In operation 1708, the electronic device (310) (e.g., processor (220)) can determine whether there is other sensor data related to the IoT device (320) in addition to the at least one external sensor device (e.g., sensor data collected by an external sensor device connected to a hub). If there is no other sensor data, the electronic device (310) (e.g., processor (220)) can proceed to operation 1716. If there is other sensor data, the electronic device (310) (e.g., processor (220)) can proceed to operation 1710.
[0240] In operation 1710, the electronic device (310) (e.g., processor (220)) can collect sensor data (e.g., second sensor data) through an external sensor device connected to a hub (e.g., IoT device (320a) of FIG. 3).
[0241] In operation 1712, the electronic device (310) (e.g., processor (220)) can determine whether an error situation related to the IoT device (320) has been detected based on the first sensor data and the second sensor data. In one embodiment of the present disclosure, the electronic device (310) (e.g., processor (220)) may analyze the first sensor data and the second sensor data directly, or analyze the first sensor data and the second sensor data through an external electronic device (e.g., a hub, a server (350), or another edge computing device). If no error situation is detected as a result of the analysis, the electronic device (310) (e.g., processor (220)) may proceed to operation 1716. If an error situation is detected as a result of the analysis, the electronic device (310) (e.g., processor (220)) may proceed to operation 1714.
[0242] In operation 1714, the electronic device (310) (e.g., processor (220)) may provide a notification message to the user (e.g., display, or sound output) indicating that an error situation has occurred. In one embodiment of the present disclosure, the electronic device (310) (e.g., processor (220)) may transmit the notification message to a post-service center (602), an IoT management center (604), and / or a manufacturer (606). In one embodiment of the present disclosure, operation 1714 may correspond to the procedure of FIG. 18.
[0243] In operation 1716, the electronic device (310) (e.g., processor (220)) may transmit a detected situation (e.g., normal situation) and / or a report message containing the collected sensor data to the server (350).
[0244] FIG. 18 is a flowchart illustrating a procedure for analyzing an error situation according to one embodiment of the present disclosure.
[0245] According to embodiments of the present disclosure, at least one of the operations described below may be omitted, modified, or executed in a different order. In one embodiment of the present disclosure, at least one of the operations described below may be executed by a processor of an electronic device (310) (e.g., processor (220) of FIG. 2). In one embodiment of the present disclosure, a memory of an electronic device (310) (e.g., memory (230) of FIG. 2) may store instructions that cause the electronic device (310) to operate according to at least one of the operations described below.
[0246] Referring to FIG. 18, in operation 1802, an electronic device (310) (e.g., a processor (220)) can analyze an error situation detected for an IoT device (320) (e.g., an error situation detected in operation 1712 of FIG. 17). In one embodiment of the present disclosure, the electronic device (310) (e.g., a processor (220)) can retrieve an action guide corresponding to the error situation from a database that stores action guides corresponding to the error situations.
[0247] In operation 1804, the electronic device (310) (e.g., processor (220)) can determine whether the error situation is capable of self-correcting by the user. If self-correcting by the user is possible, the electronic device (310) (e.g., processor (220)) can proceed to operation 1810 and provide a self-correcting guide to the user (e.g., display or sound output). If self-correcting by the user is possible, the electronic device (310) (e.g., processor (220)) can proceed to operation 1806.
[0248] In operation 1806, the electronic device (310) (e.g., processor (220)) can determine whether the purchase of consumables for the IoT device (320) is necessary to resolve the error situation. If the purchase of consumables is necessary, the electronic device (310) (e.g., processor (220)) can proceed to operation 1812 and provide (e.g., display) information on the purchase of consumables (e.g., the website address or phone number of a consumables store) to the user. If the purchase of consumables is not necessary, the electronic device (310) (e.g., processor (220)) can proceed to operation 1808.
[0249] In operation 1808, the electronic device (310) (e.g., processor (220)) can provide (e.g., display) after-sales service information (e.g., the website address or phone number of an after-sales service center) to the user.
[0250] In one embodiment of the present disclosure, the IoT device (320) may be a washing machine, and external sensor devices (e.g., a leak sensor and a vibration sensor) may be located around the washing machine (e.g., in the same room). Here, the leak sensor may be installed in the drain of the washing machine, and the vibration sensor may be attached to the outside of the washing machine. In one embodiment of the present disclosure, the washing machine may be configured to provide only a power on / off function through an IoT service and may not be equipped with internal sensors.
[0251] In one embodiment of the present disclosure, the electronic device (310) may group the washing machine with the leak sensor and the vibration sensor through the procedure described above (e.g., the procedure of FIG. 12, FIG. 13, or FIG. 15). In one embodiment of the present disclosure, the electronic device (310) may determine the operating status of the washing machine through the grouped leak sensor and the vibration sensor, as in the procedure of FIG. 19.
[0252] FIG. 19 is a flowchart illustrating the detection of an error situation based on sensor data collected from grouped sensors according to one embodiment of the present disclosure.
[0253] According to embodiments of the present disclosure, at least one of the operations described below may be omitted, modified, or executed in a different order. In one embodiment of the present disclosure, at least one of the operations described below may be executed by a processor of an electronic device (310) (e.g., processor (220) of FIG. 2). In one embodiment of the present disclosure, a memory of an electronic device (310) (e.g., memory (230) of FIG. 2) may store instructions that cause the electronic device (310) to operate according to at least one of the operations described below.
[0254] Referring to FIG. 19, in operation 1902, the electronic device (310) receives information from the washing machine indicating the operating state of the washing machine and may receive sensor data from a leak sensor and a vibration sensor, respectively. In one embodiment of the present disclosure, the sensor data from the leak sensor may indicate that water flow is detected or that water flow is not detected. In one embodiment of the present disclosure, the sensor data from the vibration sensor may indicate the vibration intensity. In one embodiment, the operating state may indicate power on or power off.
[0255] In operation 1904, the electronic device (310) can determine whether the power of the washing machine is turned on based on information indicating the operation state. If the power of the washing machine is turned on, the electronic device (310) can proceed to operation 1906. If the power of the washing machine is not turned on, the electronic device (310) can proceed to operation 1918.
[0256] In operation 1906, the electronic device (310) can determine whether water is detected by the leak sensor. If water is not detected by the leak sensor, the electronic device (310) can proceed to operation 1908. If water is detected by the leak sensor, the electronic device (310) can proceed to operation 1910.
[0257] In operation 1910, the electronic device (310) can determine whether vibration is detected by the vibration sensor. If vibration is not detected by the vibration sensor, the electronic device (310) can proceed to operation 1912. If vibration is detected by the vibration sensor, the electronic device (310) can proceed to operation 1914.
[0258] In operation 1914, the electronic device (310) can determine whether the vibration intensity detected by the vibration sensor is greater than a predetermined value above a specified threshold (e.g., average intensity). If the vibration intensity is not greater than a predetermined value (D) above the threshold (TH) (e.g., average vibration intensity), the electronic device (310) can proceed to operation 1916. If the vibration intensity is greater than a predetermined value above the threshold, the electronic device (310) can proceed to operation 1922.
[0259] In operation 1918, the electronic device (310) can determine whether water is detected by the leak sensor. If water is not detected by the leak sensor, the electronic device (310) can terminate the procedure. If water is detected by the leak sensor, the electronic device (310) can proceed to operation 1920.
[0260] In one embodiment of the present disclosure, when the power of the washing machine is turned on and the leak sensor does not detect water, in operation 1908, the electronic device (310) can determine that the washing machine is in a 'washing state' in which it is rotating the laundry tub to wash the laundry.
[0261] In one embodiment of the present disclosure, if the power of the washing machine is turned on and the leak sensor detects water and the vibration intensity detected by the vibration sensor is less than a specified threshold, then in operation 1912, the electronic device (310) can determine that the washing machine is discharging water after 'washing is complete'.
[0262] In one embodiment of the present disclosure, if the power of the washing machine is turned on and the leak sensor detects water and the vibration intensity detected by the vibration sensor is greater than a specified threshold (e.g., 0), then in operation 1916, the electronic device (310) can determine that the washing machine is in a 'spin-drying state'.
[0263] In one embodiment of the present disclosure, if the power of the washing machine is turned on and the vibration intensity detected by the vibration sensor is greater than a specified threshold value (e.g., average value), the electronic device (310) may determine in operation 1922 that there is an error situation in which the washing machine is not level. Based on the detection of the error situation, the electronic device (310) may prevent the washing machine from malfunctioning in advance by providing a notification message to the user (e.g., display or sound output) to notify the washing machine to level the washing machine again.
[0264] In one embodiment of the present disclosure, if the power of the washing machine is turned on but the vibration intensity detected by the vibration sensor is less than a specified threshold for a specified period of time, the electronic device (310) may determine that the washing is 'completed' in operation 1912. When the washing is determined to be 'completed', the electronic device (310) may send a command to the washing machine to turn off the power, thereby saving energy.
[0265] In one embodiment of the present disclosure, when the power to the washing machine is off and the leak sensor detects water, the electronic device (310) may determine that there is a possibility of leakage because the water supply hose is improperly fixed or detached. In operation 1920, the electronic device (310) may provide a notification message to the user indicating the risk of leakage (e.g., a display or sound output) so that the user may inspect the water supply hose.
[0266] Embodiments of the present disclosure group a washing machine that does not include internal sensors with external sensor devices (e.g., vibration sensors and / or leak sensors) to determine the operating conditions of the washing machine, such as during washing, during water discharge, during spin drying, or completion of washing, and enable the user to enjoy an improved customer experience without purchasing a new home appliance.
[0267] FIGS. 20a, FIGS. 20b, and FIGS. 20c illustrate a user interface representing a grouped sensor according to various embodiments of the present disclosure.
[0268] Referring to FIG. 20a, the electronic device (310) may display a user interface (2010) based on completing sensor grouping. In one embodiment of the present disclosure, the user interface (2010) may include a first object corresponding to an IoT device (320) (e.g., a washing machine), at least one second object corresponding to at least one external sensor device (e.g., a vibration sensor), and a connecting line connecting at least one second object to the first object.
[0269] Referring to FIG. 20b, the electronic device (310) may display a user interface (2020) based on completing sensor grouping. In one embodiment of the present disclosure, the user interface (2020) may include a first object corresponding to an IoT device (320) (e.g., a washing machine), and a second object (e.g., "Connected: 5") indicating that there are one or more (e.g., 5) external sensor devices connected to the IoT device (320).
[0270] Referring to FIG. 20c, the electronic device (310) may display a user interface (2030) based on completing sensor grouping. In one embodiment of the present disclosure, the user interface (2030) may list a first object corresponding to an IoT device (320) (e.g., a washing machine) and at least one second object corresponding to at least one external sensor device connected to the IoT device (320).
[0271] An electronic device (310) according to one embodiment of the present disclosure may include a communication circuit (292), at least one processor (220), and a memory (230) for storing instructions. When the instructions are executed individually or collectively by the at least one processor, the electronic device may receive a first user input requesting sensor grouping of an Internet over Things (IoT) device (320). When the instructions are executed individually or collectively by the at least one processor, the electronic device may display a guidance message requesting movement to the IoT device based on the first user input. When the instructions are executed individually or collectively by the at least one processor, the electronic device may discover the IoT device using a short-range communication method through the communication circuit after displaying the guidance message. When the above instructions are executed individually or collectively by the at least one processor, the electronic device may discover one or more external sensor devices using the short-range communication method through the communication circuit after discovering the IoT device. When the above instructions are executed individually or collectively by the at least one processor, the electronic device may receive sensor device information and signal strength information from the one or more external sensor devices through the communication circuit. When the above instructions are executed individually or collectively by the at least one processor, the electronic device may group at least one of the one or more external sensor devices with the IoT device based on the sensor device information and the signal strength information.When the above instructions are executed individually or collectively by the at least one processor, the electronic device may determine the operating status of the IoT device based on sensor data received from the at least one grouped external sensor device through the communication circuit.
[0272] In one embodiment of the present disclosure, when the instructions are executed individually or collectively by the at least one processor, the electronic device may detect an error situation of the IoT device based on the sensor data and provide action guide information related to the error situation based on the detection of the error situation.
[0273] In one embodiment of the present disclosure, when the instructions are executed individually or collectively by the at least one processor, the electronic device may establish a device-to-device (D2D) connection with the IoT device based on the discovery of the IoT device, transmit a request message to the IoT device through the D2D connection, and receive device information including a device identifier (ID) of the IoT device from the IoT device through the D2D connection after transmitting the request message.
[0274] In one embodiment of the present disclosure, when the instructions are executed individually or collectively by the at least one processor, the electronic device may receive a second user input requesting a search for surrounding sensors after discovering the IoT device, and perform a scan to discover the one or more external sensor devices based on the second user input.
[0275] In one embodiment of the present disclosure, when the instructions are executed individually or collectively by the at least one processor, the electronic device may determine to group with the IoT device an external sensor device having a signal strength higher than a specified threshold among the one or more external sensor devices based on the signal strength information.
[0276] In one embodiment of the present disclosure, when the instructions are executed individually or collectively by the at least one processor, the electronic device may exclude from grouping an external sensor device having a sensor type that is not required to detect the operating status of the IoT device among the one or more external sensor devices based on the sensor device information. In one embodiment of the present disclosure, when the instructions are executed individually or collectively by the at least one processor, the electronic device may exclude from grouping an external sensor device having a sensor type of a sensor embedded in the IoT device based on the sensor device information.
[0277] In one embodiment of the present disclosure, when the instructions are executed individually or collectively by the at least one processor, the electronic device may display a user interface including objects corresponding to one or more first external sensor devices, receive a second user input selecting at least one of the objects through the user interface, and, based on the second user input, group at least one first external sensor device corresponding to the selected at least one object with the IoT device.
[0278] In one embodiment of the present disclosure, when the instructions are executed individually or collectively by the at least one processor, the electronic device may: transmit a request message to a server (350) for a list of sensors associated with the IoT device based on the first user input, receive from the server a list of sensors representing at least one second external sensor device after transmitting the request message, and group the at least one second external sensor device with the IoT device.
[0279] An Internet of Things (IoT) device (320) according to one embodiment of the present disclosure may include a communication circuit (414), at least one processor (412), and a memory (416) for storing instructions. When the instructions are executed individually or collectively by the at least one processor, the IoT device may receive a command requesting a search for surrounding sensors from an electronic device (310) via the communication circuit. When the instructions are executed individually or collectively by the at least one processor, the IoT device may discover one or more external sensor devices using a short-range communication method via the communication circuit based on receiving the command. When the instructions are executed individually or collectively by the at least one processor, the IoT device may receive sensor device information and signal strength information from the one or more external sensor devices via the communication circuit. When the above instructions are executed individually or collectively by the at least one processor, the IoT device may group at least one of the one or more external sensor devices with the IoT device based on the sensor device information and the signal strength information. When the above instructions are executed individually or collectively by the at least one processor, the IoT device may receive sensor data from the at least one external sensor device through the communication circuit. When the above instructions are executed individually or collectively by the at least one processor, the IoT device may transmit the sensor data to the electronic device (310) through the communication circuit.
[0280] In one embodiment of the present disclosure, when the instructions are executed individually or collectively by the at least one processor, the IoT device may determine, based on the signal strength information, to group with the IoT device an external sensor device having a signal strength higher than a specified threshold among the one or more external sensor devices. In one embodiment of the present disclosure, when the instructions are executed individually or collectively by the at least one processor, the IoT device may exclude from the grouping at least one external sensor device having a sensor type not required to detect the operating status of the IoT device among the one or more external sensor devices, based on the sensor device information. In one embodiment of the present disclosure, when the instructions are executed individually or collectively by the at least one processor, the IoT device may exclude from the grouping at least one external sensor device having a sensor type of a sensor embedded in the IoT device, based on the sensor device information.
[0281] A method performed by an electronic device (310) according to one embodiment of the present disclosure may include: receiving a first user input requesting sensor grouping of an Internet over things (IoT) device (320) (902); displaying a guidance message requesting movement to the IoT device based on the first user input (904); discovering the IoT device using a short-range communication method after displaying the guidance message (906); discovering one or more external sensor devices using the short-range communication method after discovering the IoT device (910); receiving sensor device information and signal strength information from the one or more external sensor devices (912); grouping at least one of the one or more external sensor devices with the IoT device based on the sensor device information and the signal strength information (914); and determining the operating status of the IoT device based on sensor data received from the at least one grouped external sensor device (916).
[0282] In one embodiment of the present disclosure, the method may include an operation of detecting an error situation of the IoT device based on sensor data, and an operation of providing action guide information related to the error situation based on the detection of the error situation.
[0283] In one embodiment of the present disclosure, the method may include, based on discovering the IoT device, establishing a device-to-device (D2D) connection with the IoT device, transmitting a request message to the IoT device through the D2D connection, and receiving device information including a device identifier (ID) of the IoT device from the IoT device through the D2D connection after transmitting the request message.
[0284] In one embodiment of the present disclosure, the method may include, after discovering the IoT device, receiving a second user input requesting a search for surrounding sensors, and performing a scan to discover one or more external sensor devices based on the second user input.
[0285] In one embodiment of the present disclosure, the method may include an operation of determining, based on the signal strength information, to group an external sensor device having a signal strength higher than a specified threshold among the one or more external sensor devices with the IoT device.
[0286] In one embodiment of the present disclosure, the method may include, based on the sensor device information, an operation of excluding from grouping an external sensor device having a sensor type that is not required to detect the operating status of the IoT device among the one or more external sensor devices. In one embodiment, the method may include, based on the sensor device information, an operation of excluding from grouping an external sensor device having a sensor type of a sensor embedded in the IoT device.
[0287] In one embodiment of the present disclosure, the method may include: displaying a user interface comprising objects corresponding to one or more first external sensor devices; receiving a second user input for selecting at least one of the objects through the user interface; and grouping at least one first external sensor device corresponding to the selected at least one object with the IoT device based on the second user input.
[0288] In one embodiment of the present disclosure, the method may include the operation of transmitting a request message to a server (350) for a list of sensors associated with the IoT device based on the first user input, the operation of receiving from the server a list of sensors representing at least one second external sensor device after transmitting the request message, and the operation of grouping the at least one second external sensor device with the IoT device.
[0289] A method performed by an Internet of Things (IoT) device (320) according to one embodiment of the present disclosure may include: receiving a command requesting a search for surrounding sensors from an electronic device (310) (802); discovering one or more external sensor devices using a short-range communication method based on receiving the command (804); receiving sensor device information and signal strength information from one or more external sensor devices (806); grouping at least one of the one or more external sensor devices with the IoT device based on the sensor device information and the signal strength information (808); and transmitting sensor data received from the at least one external sensor device to the electronic device.
[0290] In one embodiment of the present disclosure, the method may include an operation of determining, based on the signal strength information, to group with the IoT device an external sensor device having a signal strength higher than a specified threshold among the one or more external sensor devices. In one embodiment of the present disclosure, the method may include an operation of excluding from grouping at least one external sensor device having a sensor type not required to detect the operating status of the IoT device among the one or more external sensor devices, based on the sensor device information. In one embodiment of the present disclosure, the method may include an operation of excluding from grouping at least one external sensor device having a sensor type of a sensor embedded in the IoT device, based on the sensor device information.
[0291] According to another aspect of the present disclosure, one or more non-transient computer-readable storage media are provided for storing one or more computer programs, and when the one or more programs are executed individually or collectively by at least one processor, the electronic device is made to perform operations. The operations may include receiving a first user input requesting sensor grouping of an Internet of Things (IoT) device, displaying a guidance message requesting movement to the IoT device based on the first user input, after displaying the guidance message, discovering the IoT device using a short-range communication method, discovering one or more external sensor devices using the short-range communication method after discovering the IoT device, receiving sensor device information and signal strength information from the one or more external sensor devices through a communication circuit, grouping at least one of the one or more external sensor devices with the IoT device based on the sensor device information and the signal strength information, and determining the operating status of the IoT device based on sensor data received from the at least one grouped external sensor device.
[0292] According to another aspect of the present disclosure, one or more non-transient computer-readable storage media are provided for storing one or more programs, and when the one or more programs are executed individually or collectively by at least one processor, the Internet of Things (IoT) device performs operations. The operations may include receiving a command from an electronic device requesting a search for surrounding sensors, and based on receiving said command, discovering one or more external sensor devices using a short-range communication method through a communication circuit, receiving sensor device information and signal strength information from said one or more external sensor devices through said communication circuit, grouping at least one of said one or more external sensor devices with the IoT device based on said sensor device information and said signal strength information, receiving sensor data from said at least one external sensor device through said communication circuit, and transmitting said sensor data to said electronic device through said communication circuit.
[0293] The electronic device according to the various embodiments of the present disclosure may be of various forms. The electronic device may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a consumer electronics device. The electronic device according to the embodiments of this document is not limited to the devices described above.
[0294] The various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of said embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of said items unless the relevant context clearly indicates otherwise. In this document, phrases such as "A or B," "at least one of A and B," "at least one of A or B," "A, B or C," "at least one of A, B and C," and "at least one of A, B, or C" may each include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used simply to distinguish said components from other said components and do not limit said components in any other aspect (e.g., importance or order). Where any (e.g., 1st) component is referred to as “coupled” or “connected” to another (e.g., 2nd) component, with or without the terms “functionally” or “communicationly,” it means that said any component may be connected to said other component directly (e.g., via a wire), wirelessly, or through a third component.
[0295] The term “module” as used in the various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. A module may be a component formed integrally, or a minimum unit of said component or a part thereof that performs one or more functions. For example, according to one embodiment of the present disclosure, a module may be implemented in the form of an application-specific integrated circuit (ASIC).
[0296] Various embodiments of the present document may be implemented as software (e.g., program (240)) comprising one or more instructions stored in a storage medium (e.g., internal memory (236) or external memory (238)) readable by a machine (e.g., electronic device (201)). For example, a processor (e.g., processor (220)) of the machine (e.g., electronic device (201)) may call at least one of the one or more instructions stored from the storage medium and execute it. This enables the machine to be operated to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The storage medium readable by the machine may be provided in the form of a non-transitory storage medium. Here, 'non-temporary' simply means that the storage medium is a tangible device and does not contain a signal (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily.
[0297] According to one embodiment of the present disclosure, the method according to the various embodiments disclosed herein may be provided by being included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or an application store (e.g., Play Store). TM It can be distributed online (e.g., downloaded or uploaded) through ) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.
[0298] According to various embodiments of the present disclosure, each component (e.g., module or program) of the components described above may include a singular or multiple entities, and some of the multiple entities may be separated and placed in other components. According to various embodiments of the present disclosure, one or more of the components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Generally or additionally, multiple components (e.g., module or program) may be integrated into a single component. In such a case, according to various embodiments of the present disclosure, the integrated component may perform one or more functions of each of the components of the multiple components in the same or similar manner as those performed by the corresponding component among the multiple components prior to the integration. According to various embodiments of the present disclosure, operations performed by the module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.
[0299] It should be understood that various embodiments of the present disclosure according to the claims and description of this specification may be implemented in the form of hardware, software, or a combination of hardware and software.
[0300] Such software may be stored on a non-transitory computer-readable storage medium. The non-transitory computer-readable storage medium stores one or more computer programs (software modules), and the one or more computer programs include computer execution instructions that control the electronic device to perform the method of the present disclosure when executed by one or more processors of the electronic device.
[0301] Such software may be stored in volatile or non-volatile storage forms, for example, in storage devices such as read-only memory (ROM), regardless of whether it is eraseable or rewritable, or in memory forms such as random access memory (RAM), memory chips, devices, or integrated circuits (IC). Additionally, it may be stored on optically or magnetically readable media such as compact discs (CDs), digital video discs (DVDs), magnetic discs, magnetic tapes, etc. It should be understood that such storage devices and storage media are various embodiments of non-transient machine-readable storage media suitable for storing a computer program or a plurality of computer programs that include instructions for implementing various embodiments of the present disclosure when executed. Accordingly, various embodiments of the present disclosure provide a program including code for implementing an apparatus or method described in any one of the claims of this specification, and a non-transient machine-readable storage medium on which such a program is stored.
[0302] Although the present disclosure has been described and illustrated with reference to various embodiments, those skilled in the art will understand that various changes in form or detail may be made without departing from the spirit and scope of the present disclosure as defined by the appended claims and their equivalents.
Claims
1. In an electronic device (310), Communication circuit (292); Memory (230) comprising one or more storage media for storing instructions; and The electronic device comprises at least one processor (220) coupled to communicate with the communication circuit and the memory, wherein the instructions are executed individually or collectively by the at least one processor: Receiving a first user input requesting sensor grouping of an Internet of Things (IoT) device (320), and Based on the above first user input, a guidance message requesting movement to the IoT device is displayed, and After displaying the above guidance message, the IoT device is discovered using a short-range communication method through the above communication circuit, and After discovering the above IoT device, one or more external sensor devices are discovered using the above short-range communication method through the above communication circuit, and From the above one or more external sensor devices, sensor device information and signal strength information are received through the communication circuit, and Based on the sensor device information and the signal strength information, at least one external sensor device among the one or more external sensor devices is grouped with the IoT device, and An electronic device that determines the operating status of the IoT device based on sensor data received through the communication circuit from at least one grouped external sensor device.
2. In claim 1, when the instructions are executed individually or collectively by the at least one processor, the electronic device further: Detecting error situations of the IoT device based on the sensor data above, and An electronic device that provides action guide information related to the error situation based on the detection of the error situation.
3. In claim 1 or 2, when the instructions are executed individually or collectively by the at least one processor, the electronic device further: Based on the discovery of the above IoT device, a D2D (device-to-device) connection is established with the above IoT device, and A request message is transmitted to the IoT device through the above D2D connection, and An electronic device that receives device information including the device identifier (ID) of the IoT device from the IoT device via the D2D connection after transmitting the above request message.
4. In any one of claims 1 to 3, when the instructions are executed individually or collectively by the at least one processor, the electronic device further: After discovering the above IoT device, receive a second user input requesting a search for surrounding sensors, and An electronic device that performs a scan to detect one or more external sensor devices based on the second user input.
5. In any one of claims 1 to 4, when the instructions are executed individually or collectively by the at least one processor, the electronic device further: An electronic device that determines, based on the above signal strength information, to group an external sensor device having a signal strength higher than a specified threshold among the one or more external sensor devices with the IoT device.
6. In any one of claims 1 to 5, when the instructions are executed individually or collectively by the at least one processor, the electronic device further: Based on the sensor device information above, among the one or more external sensor devices, an external sensor device having a sensor type not required to detect the operating status of the IoT device is excluded from the grouping, and / or An electronic device that excludes an external sensor device having the sensor type of the sensor embedded in the IoT device from grouping based on the above sensor device information.
7. In any one of claims 1 to 6, when the instructions are executed individually or collectively by the at least one processor, the electronic device further: Displays a user interface including objects corresponding to one or more first external sensor devices, and A second user input is received to select at least one of the objects through the above user interface, and An electronic device that groups at least one first external sensor device corresponding to at least one selected object with the IoT device based on the second user input above.
8. In any one of claims 1 to 7, when the instructions are executed individually or collectively by the at least one processor, the electronic device further: Based on the above first user input, a request message for a list of sensors related to the IoT device is sent to the server (350), and After transmitting the above request message, receive a sensor list from the server representing at least one second external sensor device, and An electronic device that groups at least one second external sensor device with the IoT device.
9. In an Internet of Things (IoT) device (320), Communication circuit (414); Memory (416) comprising one or more storage media for storing instructions; and The IoT device comprises at least one processor (412) coupled to communicate with the communication circuit and the memory, and when the instructions are executed individually or collectively by the at least one processor: A command requesting a search for surrounding sensors is received from an electronic device (310) through the communication circuit, and Based on receiving the above command, one or more external sensor devices are detected using a short-range communication method through the communication circuit, and From the above one or more external sensor devices, sensor device information and signal strength information are received through the communication circuit, and Based on the sensor device information and the signal strength information, at least one external sensor device among the one or more external sensor devices is grouped with the IoT device, and Receive sensor data from at least one external sensor device through the communication circuit, and An IoT device that transmits the above sensor data to the above electronic device through the above communication circuit.
10. In claim 9, when the instructions are executed individually or collectively by the at least one processor, the IoT device further: Based on the above signal strength information, it is determined to group the external sensor device having a signal strength higher than a specified threshold among the one or more external sensor devices with the IoT device, and Based on the sensor device information above, at least one external sensor device having a sensor type not required to detect the operating status of the IoT device among the one or more external sensor devices is excluded from the grouping, and / or An IoT device that excludes at least one external sensor device having the sensor type of the sensor embedded in the IoT device from grouping based on the above sensor device information.
11. In a method performed by an electronic device (310), An operation (902) of receiving a first user input requesting sensor grouping of an Internet of Things (IoT) device (320); An operation (904) of displaying a guidance message requesting to move to the IoT device based on the first user input above; After displaying the above guidance message, the operation (906) of discovering the IoT device using a short-range communication method; After discovering the above IoT device, the operation (910) of discovering one or more external sensor devices using the above short-range communication method; The operation (912) of receiving sensor device information and signal strength information through a communication circuit from one or more of the above external sensor devices; An operation (914) of grouping at least one external sensor device among the one or more external sensor devices with the IoT device based on the sensor device information and the signal strength information; and A method comprising an operation (916) of determining the operating status of the IoT device based on sensor data received from at least one grouped external sensor device.
12. In Paragraph 11, An operation to detect an error situation of the IoT device based on the sensor data above; and A method comprising an action guide information related to the error situation based on the detection of the error situation.
13. In Paragraph 11 or 12, An operation to establish a D2D (device-to-device) connection with the IoT device based on the discovery of the IoT device; The operation of transmitting a request message to the IoT device through the above D2D connection; and A method comprising the operation of receiving device information including the device identifier (ID) of the IoT device from the IoT device via the D2D connection after transmitting the above request message.
14. In any one of paragraphs 11 through 13, After discovering the above IoT device, the operation of receiving a second user input requesting a search for surrounding sensors; and A method comprising the operation of performing a scan to discover one or more external sensor devices based on the second user input.
15. A method performed by an Internet of Things (IoT) device (320), Operation (802) of receiving a command from an electronic device (310) requesting a search for surrounding sensors; Based on receiving the above command, the operation (804) of detecting one or more external sensor devices using a short-range communication method; The operation (806) of receiving sensor device information and signal strength information through a communication circuit from one or more of the above external sensor devices; An operation (808) of grouping at least one external sensor device among the one or more external sensor devices with the IoT device based on the sensor device information and the signal strength information; and A method comprising the operation of transmitting sensor data received from at least one external sensor device to the electronic device.