Electronic device for providing internet of things service and control method therefor

Abstract

According to an embodiment, an electronic device comprises: a communication module; a display; and at least one processor operatively connected to the communication module and the display, wherein the at least one processor may obtain an indoor map, on the basis of a user account, through the communication module, automatically arrange, on the indoor map, one or more objects respectively corresponding to one or more external electronic devices registered in the user account, and display, on the display, the indoor map in which the one or more objects are arranged.

Description

Electronic device providing Internet of Things service and method for controlling same

[0001] Embodiments of the present disclosure relate to an electronic device providing an Internet of Things service and a method for controlling the same.

[0002] The variety of services and additional features offered through electronic devices, such as smartphones, is steadily increasing. To enhance the utility of these devices and satisfy the diverse needs of users, telecommunications service providers and electronic device manufacturers are competitively developing electronic devices to offer a variety of features and differentiate themselves from competitors. Consequently, the various functions offered through electronic devices are also becoming increasingly sophisticated.

[0003] As wireless communication technology advances, devices utilizing artificial intelligence (AI) are becoming more widely adopted. For example, home appliances connected to the Internet of Things (IoT) can utilize AI. IoT technology can collect and analyze data generated by these devices to provide intelligent Internet technology services that create new value in human lives. Through the convergence and integration of existing Internet technologies with various industries, IoT technology can be applied to areas such as smart homes, smart buildings, smart cities, smart cars, and smart appliances.

[0004] Meanwhile, homes are equipped with a variety of home appliances for the convenience of users. Various services are being proposed to utilize IoT technology to facilitate the operation and control of these appliances. Home network technology can provide various services to users within the home via the home network. For example, users can control various IoT devices (e.g., IoT-enabled home appliances) that make up the home network using personal electronic devices (e.g., smartphones).

[0005] For example, home network technology can provide users with objects of home appliances and / or furniture displayed on a map based on the structure of an indoor space, similar to the actual environment.

[0006] According to one embodiment, an electronic device may include a communication module, a display, and at least one processor operatively connected to the communication module and the display.

[0007] According to one embodiment, the at least one processor can obtain an indoor map based on a user account through the communication module.

[0008] In one embodiment, the at least one processor may automatically place at least one object, each corresponding to at least one external electronic device registered to the user account, on the indoor map.

[0009] In one embodiment, the at least one processor may display the indoor map on which the at least one object is placed on the display.

[0010] According to one embodiment, a method for controlling an electronic device may include an operation of obtaining an indoor map based on a user account via a communication module of the electronic device.

[0011] According to one embodiment, a method for controlling an electronic device may include an operation of automatically placing at least one object corresponding to at least one external electronic device registered to the user account on the indoor map.

[0012] According to one embodiment, a method of controlling an electronic device may include an operation of displaying the indoor map on which the at least one object is placed.

[0013] According to one embodiment, a non-transitory computer-readable recording medium storing one or more programs may include instructions for an electronic device to obtain an indoor map based on a user account through a communication module.

[0014] In one embodiment, the one or more programs may include commands for the electronic device to automatically place at least one object on the indoor map, each object corresponding to at least one external electronic device registered to the user account.

[0015] In one embodiment, the one or more programs may include instructions for causing the electronic device to display the indoor map on which the at least one object is placed on the display.

[0016] FIG. 1 illustrates an IoT (internet of things) system according to one embodiment.

[0017] FIG. 2 is a block diagram of an electronic device within a network environment according to one embodiment.

[0018] FIG. 3 is a drawing for explaining an indoor map provision system according to one embodiment.

[0019] FIG. 4 is a diagram for explaining an indoor map generation operation in which objects of an electronic device are placed according to one embodiment.

[0020] FIG. 5A is a diagram illustrating an operation of obtaining an indoor map based on the structure of an indoor space of an electronic device according to one embodiment.

[0021] FIG. 5b is a diagram for explaining an operation of obtaining an indoor map based on the structure of an indoor space of an electronic device according to one embodiment.

[0022] FIG. 6 is a diagram illustrating an operation of obtaining an indoor map based on a floor plan of an electronic device according to one embodiment.

[0023] FIG. 7A is a diagram illustrating an operation of providing an indoor map in which objects of an electronic device are automatically placed, according to one embodiment.

[0024] FIG. 7b is a drawing for explaining an operation of providing an indoor map in which objects are rearranged based on user input based on the indoor map illustrated in FIG. 7a.

[0025] FIG. 8 is a diagram illustrating an operation of an electronic device generating an indoor map in which objects are automatically placed based on a list of IoT devices pre-registered through an IoT application according to one embodiment.

[0026] FIG. 9A is a diagram for explaining an operation of an electronic device automatically placing an object when the IoT device is a light, according to one embodiment.

[0027] FIG. 9b is a diagram illustrating an operation of an electronic device automatically placing an object when the IoT device is a curtain or blind, according to one embodiment.

[0028] FIG. 9c is a diagram for explaining an operation of an electronic device automatically placing an object when the IoT device is a room control device, according to one embodiment.

[0029] FIG. 9d is a drawing for explaining an operation of an electronic device automatically placing an object when the IoT device is a door lock, according to one embodiment.

[0030] FIG. 9e is a diagram for explaining an operation of an electronic device automatically placing an object when the IoT device is a TV, according to one embodiment.

[0031] FIG. 10A is a diagram for explaining an operation of automatically placing an object corresponding to an IoT device whose location is difficult to infer, in an electronic device, according to one embodiment.

[0032] FIG. 10b is a diagram illustrating an operation of automatically placing an object corresponding to an IoT device whose location is difficult to infer, in an electronic device, according to one embodiment.

[0033] FIG. 11A is a diagram illustrating an operation of assigning a pre-registered room to an indoor map through an IoT application of an electronic device according to one embodiment.

[0034] FIG. 11b is a diagram illustrating an operation of assigning objects corresponding to IoT devices included in a pre-registered room to an indoor map through an IoT application of an electronic device according to one embodiment.

[0035] FIG. 12 is a drawing illustrating an operation of selecting objects to be displayed on an indoor map when assigning a pre-registered room to an indoor map through an IoT application of an electronic device according to one embodiment.

[0036] FIG. 13A is a diagram illustrating an operation of changing the location of an assigned room on an indoor map of an electronic device according to one embodiment.

[0037] FIG. 13b is a diagram illustrating an operation of deleting an assigned room on an indoor map of an electronic device according to one embodiment.

[0038] FIG. 14A is a diagram illustrating an operation of changing the location of an assigned room on an indoor map of an electronic device according to one embodiment.

[0039] FIG. 14B is a diagram illustrating a user interface displayed when an input is received to change the location of an assigned room on an indoor map of an electronic device to a location to which another room is already assigned, according to one embodiment.

[0040] FIG. 14c is a diagram illustrating an operation of switching the locations of multiple rooms assigned on an indoor map of an electronic device according to one embodiment.

[0041] FIG. 15A is a diagram illustrating an operation of merging multiple rooms on an indoor map of an electronic device according to one embodiment.

[0042] FIG. 15b is a diagram illustrating a user interface displayed when an input for merging multiple rooms on an indoor map of an electronic device is received, according to one embodiment.

[0043] FIG. 15C is a diagram illustrating a user interface displayed for modifying a room name when an input for merging multiple rooms on an indoor map of an electronic device is received, according to one embodiment.

[0044] FIG. 16A is a diagram for explaining an operation of placing an object corresponding to an IoT device that is not registered in any room on an indoor map in an IoT application of an electronic device according to one embodiment.

[0045] FIG. 16b is a diagram for explaining an operation of placing an object corresponding to an IoT device that is not registered in any room on an indoor map in an IoT application of an electronic device according to one embodiment.

[0046] FIG. 17A is a drawing for explaining an operation of changing the shape of an object of an electronic device according to one embodiment.

[0047] FIG. 17b is a drawing for explaining an operation of changing the shape of an object of an electronic device according to one embodiment.

[0048] FIG. 18 is a flowchart illustrating an operation of generating an indoor map in which objects of an electronic device are placed, according to one embodiment.

[0049] FIG. 19 is a flowchart illustrating an indoor map control operation of another user based on the authority of the other user, according to one embodiment.

[0050] FIG. 20 is a diagram illustrating an editing menu provided to another user based on the authority of the other user, according to one embodiment.

[0051] FIG. 1 illustrates an Internet of Things (IoT) system (100) according to one embodiment. Meanwhile, at least some of the components of FIG. 1 may be omitted, and the system may be implemented to include additional components not shown.

[0052] Referring to FIG. 1, an IoT system (100) according to one embodiment includes a plurality of electronic devices connectable to a data network (116 or 146). For example, the IoT system (100) may include at least one of a first IoT server (110), a first node (120), a voice assistance server (130), a second IoT server (140), a second node (150), or devices (121, 122, 123, 124, 125, 136, 137, 151, 152, 153).

[0053] According to one embodiment, the first IoT server (110) may include at least one of a communication interface (111), a processor (112), or a storage (113). The second IoT server (140) may include at least one of a communication interface (141), a processor (142), or a storage (143). The “IoT server” in this document may remotely control and / or monitor one or more devices (e.g., devices (121, 122, 123, 124, 125, 151, 152, 153)) via a relay device (e.g., the first node (120) or the second node (150)) or directly without a relay device, for example, based on a data network (e.g., the data network (116) or the data network (146)). Here, a "device" is not limited to a sensor, home appliance, office electronic device, or process-performing device that is deployed (or located) within a local environment, such as a home, office, factory, building, external branch, or other type of site. A device that receives a control command and performs an action corresponding to the control command may be referred to as a "target device." An IoT server may also be referred to as a central server, as it selects a target device from among multiple devices and provides control commands.

[0054] According to one embodiment, the first IoT server (110) may communicate with devices (121, 122, 123) via a data network (116). The data network (116) may mean a network for long-distance communication, such as the Internet or a computer network (e.g., a LAN or WAN), or may include a cellular network.

[0055] According to one embodiment, the first IoT server (110) may be connected to a data network (116) via a communication interface (111). The communication interface (111) may include a communication device (or communication module) for supporting communication of the data network (116), and may be integrated into a single component (e.g., a single chip) or implemented as a plurality of separate components (e.g., multiple chips). The first IoT server (110) may communicate with devices (121, 122, 123) via a first node (120). The first node (120) may receive data from the first IoT server (110) via the data network (116) and transmit the received data to at least some of the devices (121, 122, 123). Alternatively, the first node (120) may receive data from at least some of the devices (121, 122, 123) and transmit the received data to the first IoT server (110) via the data network (116). The first node (120) may function as a bridge between the data network (116) and the devices (121, 122, 123). Meanwhile, although FIG. 1 illustrates one first node (120), this is merely exemplary and there is no limitation on the number.

[0056] A "node" in this document may be an edge computing system or a hub device. According to one embodiment, the first node (120) supports wired and / or wireless communication with the data network (116), and may also support wired and / or wireless communication with devices (121, 122, 123). For example, the first node (120) may be connected to the devices (121, 122, 123) via a short-range communication network such as at least one of Bluetooth, Wi-Fi, Wi-Fi direct, Z-wave, Zig-bee, INSETEON, X10, etc.) or IrDA (infrared data association), but there is no limitation on the type of communication. The first node (120) may be deployed (or located) within an environment such as a home, an office, a factory, a building, an external branch, or other types of sites. Accordingly, the devices (121, 122, 123) may be monitored and / or controlled by services provided by the first IoT server (110), and the devices (121, 122, 123) may not be required to have the capability of full network communication (e.g., Internet communication) for direct connection to the first IoT server (110). Devices (121, 122, 123) are illustrated as being implemented as electronic devices within a home environment, such as light switches, proximity sensors, temperature sensors, etc., but this is by way of example only and is not limiting.

[0057] According to one embodiment, the first IoT server (110) may support direct communication with devices (124, 125). Here, "direct communication" may mean communication that does not pass through an intermediary device, such as the first node (120), for example, communication via a cellular communication network and / or a data network.

[0058] According to one embodiment, the first IoT server (110) may transmit a control command to at least some of the devices (121, 122, 123, 124, 125). Here, the “control command” may mean data that causes a controllable device to perform a specific operation, and the specific operation is an operation performed by the device, and may include outputting information, sensing information, reporting information, and managing (e.g., deleting or creating) information, and there is no limitation on its type. For example, the processor (112) may obtain information (or a request) for generating a control command from an external source (e.g., a voice assistant server (130), the second IoT server (140), an external system (160), or at least some of the devices (121, 122, 123, 124, 125)), and generate the control command based on the obtained information. Alternatively, the processor (112) may generate a control command based on whether the monitoring results of at least some of the devices (121, 122, 123, 124, 125) satisfy a specified condition. The processor (112) may control the communication interface (111) to transmit the control command to the target device.

[0059] According to one embodiment, the processor (112), or the processor (132), or the processor (142) may be implemented as a combination of one or more of a general-purpose processor such as a central processing unit (CPU), a digital signal processor (DSP), an application processor (AP), a communication processor (CP), a graphics-only processor such as a graphical processing unit (GPU), a vision processing unit (VPU), or an artificial intelligence-only processor such as a neural processing unit (NPU). The above-described processing units are merely exemplary, and those skilled in the art will understand that the processor (112) is not limited to any computational means that can execute instructions stored in the memory (113), for example, and output the executed results.

[0060] According to one embodiment, the processor (112) may configure a web-based interface based on the API (114) or expose resources managed by the first IoT server (110) to the outside. The web-based interface may, for example, support communication between the first IoT server (110) and an external web service. The processor (112) may also allow, for example, an external system (160) to control and / or access the devices (121, 122, 123). The external system (160) may be an independent system that is not associated with or is not a part of the system (100), for example. The external system (160) may be, for example, an external server or a website. However, security is required for access to the devices (121, 122, 123) or the resources of the first IoT server (110) from the external system (160). According to one embodiment, the processor (112) may externally expose an API endpoint (e.g., a URL (universal resource locator)) based on the API (114) of the automation application. As described above, the first IoT server (110) may transmit a control command to a target device among the devices (121, 122, 123). Meanwhile, the description of the communication interface (141), the processor (142), the API (144) of the storage (143), and the database (145) of the second IoT server (140) may be substantially the same as the description of the communication interface (111), the processor (112), the API (114) of the storage (113), and the database (115) of the first IoT server (110). In addition, the description of the second node (150) may be substantially the same as the description of the first node (120). The second IoT server (140) can transmit control commands to a target device among the devices (151, 152, 153).The first IoT server (110) and the second IoT server (140) may be operated by the same service provider in one embodiment, but may be operated by different service providers in another embodiment.

[0061] According to one embodiment, the voice assistant server (130) can transmit and receive data with the first IoT server (110) via a data network (116). The voice assistant server (130) according to one embodiment can include at least one of a communication interface (131), a processor (132), or a storage (133). The communication interface (131) can communicate with a smart phone (136) or an AI speaker (137) via a data network (not shown) and / or a cellular network (not shown). The smart phone (136) or the AI ​​speaker (137) can include a microphone, acquire a user voice, convert it into a voice signal, and transmit the voice signal to the voice assistant server (130). The processor (132) can receive a voice signal from the smart phone (136) or the AI ​​speaker (137) via the communication interface (131). The processor (132) can process the received voice signal based on the stored model (134). The processor (132) can generate (or confirm) a control command using the processing result based on information stored in the database (135).According to one embodiment, the storage unit (113, 133, 143) may include a non-transitory storage medium of at least one type among a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., SD or XD memory, etc.), a RAM (Random Access Memory), a SRAM (Static Random Access Memory), a ROM (Read-Only Memory), an EEPROM (Electrically Erasable Programmable Read-Only Memory), a PROM (Programmable Read-Only Memory), a magnetic memory, a magnetic disk, and an optical disk, and the type thereof is not limited.

[0062] FIG. 2 is a block diagram of an electronic device (201) within a network environment (200) according to various embodiments. Referring to FIG. 2, in the network environment (200), the electronic device (201) may communicate with the electronic device (202) via a first network (298) (e.g., a short-range wireless communication network), or may communicate with at least one of the electronic device (204) or the server (208) via a second network (299) (e.g., a long-range wireless communication network). In one embodiment, the electronic device (201) may communicate with the electronic device (204) via the server (208). According to one embodiment, the electronic device (201) may include a processor (220), a memory (230), an input module (250), an audio output module (255), a display module (260), an audio module (270), a sensor module (276), an interface (277), a connection terminal (278), a haptic module (279), a camera module (280), a power management module (288), a battery (289), a communication module (290), a subscriber identification module (296), or an antenna module (297). In some embodiments, the electronic device (201) may omit at least one of these components (e.g., the connection terminal (278)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (276), the camera module (280), or the antenna module (297)) may be integrated into one component (e.g., the display module (260)).

[0063] The processor (220) may, for example, execute software (e.g., a program (240)) to control at least one other component (e.g., a hardware or software component) of the electronic device (201) connected to the processor (220) and perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (220) may store commands or data received from other components (e.g., a sensor module (276) or a communication module (290)) in a volatile memory (232), process the commands or data stored in the volatile memory (232), and store result data in a non-volatile memory (234). According to one embodiment, the processor (220) may include a main processor (221) (e.g., a central processing unit or an application processor) or an auxiliary processor (223) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (221). For example, when the electronic device (201) includes the main processor (221) and the auxiliary processor (223), the auxiliary processor (223) may be configured to use less power than the main processor (221) or to be specialized for a given function. The auxiliary processor (223) may be implemented separately from the main processor (221) or as a part thereof.

[0064] The auxiliary processor (223) may control at least a portion of functions or states associated with at least one component (e.g., a display module (260), a sensor module (276), or a communication module (290)) of the electronic device (201), for example, on behalf of the main processor (221) while the main processor (221) is in an inactive (e.g., sleep) state, or together with the main processor (221) while the main processor (221) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (223) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (280) or a communication module (290)). In one embodiment, the auxiliary processor (223) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (201) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (208)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0065] The memory (230) can store various data used by at least one component (e.g., the processor (220) or the sensor module (276)) of the electronic device (201). The data can include, for example, software (e.g., the program (240)) and input data or output data for commands related thereto. The memory (230) can include a volatile memory (232) or a non-volatile memory (234).

[0066] The program (240) may be stored as software in the memory (230) and may include, for example, an operating system (242), middleware (244), or an application (246).

[0067] The input module (250) can receive commands or data to be used in a component of the electronic device (201) (e.g., a processor (220)) from an external source (e.g., a user) of the electronic device (201). The input module (250) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0068] The audio output module (255) can output audio signals to the outside of the electronic device (201). The audio output module (255) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0069] The display module (260) can visually provide information to an external party (e.g., a user) of the electronic device (201). The display module (260) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. In one embodiment, the display module (260) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0070] The audio module (270) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (270) can acquire sound through the input module (250), output sound through the sound output module (255), or an external electronic device (e.g., electronic device (202)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (201).

[0071] The sensor module (276) can detect the operating status (e.g., power or temperature) of the electronic device (201) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (276) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0072] The interface (277) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (201) to an external electronic device (e.g., the electronic device (202)). In one embodiment, the interface (277) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0073] The connection terminal (278) may include a connector through which the electronic device (201) may be physically connected to an external electronic device (e.g., the electronic device (202)). In one embodiment, the connection terminal (278) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0074] A haptic module (279) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (279) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0075] The camera module (280) can capture still images and moving images. According to one embodiment, the camera module (280) may include one or more lenses, image sensors, image signal processors, or flashes.

[0076] The power management module (288) can manage the power supplied to the electronic device (201). According to one embodiment, the power management module (288) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0077] A battery (289) may power at least one component of the electronic device (201). In one embodiment, the battery (289) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0078] The communication module (290) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (201) and an external electronic device (e.g., electronic device (202), electronic device (204), or server (208)), and the performance of communication through the established communication channel. The communication module (290) may operate independently from the processor (220) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (290) may include a wireless communication module (292) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (294) (e.g., a local area network (LAN) communication module, or a power line communication module). Any of these communication modules may communicate with an external electronic device (204) via a first network (298) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (299) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (292) may use subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (296) to verify or authenticate the electronic device (201) within a communication network such as the first network (298) or the second network (299).

[0079] The wireless communication module (292) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (292) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (292) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (292) can support various requirements specified in the electronic device (201), an external electronic device (e.g., the electronic device (204)), or a network system (e.g., the second network (299)). According to one embodiment, the wireless communication module (292) can support a peak data rate (e.g., 20 Gbps or more) for realizing eMBB, a loss coverage (e.g., 164 dB or less) for realizing mMTC, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for realizing URLLC.

[0080] The antenna module (297) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (297) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (297) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (298) or the second network (299), may be selected from the plurality of antennas, for example, by the communication module (290). A signal or power may be transmitted or received between the communication module (290) and an external electronic device via the at least one selected antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (297).

[0081] According to various embodiments, the antenna module (297) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.

[0082] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0083] According to one embodiment, commands or data may be transmitted or received between the electronic device (201) and an external electronic device (204) via a server (208) connected to a second network (299). Each of the external electronic devices (202 or 204) may be the same or a different type of device as the electronic device (201). According to one embodiment, all or part of the operations executed in the electronic device (201) may be executed in one or more of the external electronic devices (202, 204, or 208). For example, when the electronic device (201) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (201) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (201). The electronic device (201) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (201) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (204) may include an Internet of Things (IoT) device. The server (208) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (204) or the server (208) may be included in the second network (299).The electronic device (201) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0084] FIG. 3 is a drawing for explaining an indoor map provision system according to one embodiment.

[0085] Referring to FIG. 3, an electronic device (310) (e.g., device (124) of FIG. 1, electronic device (201) of FIG. 2, or processor (220) of FIG. 1) may communicate with a server (320) (e.g., first IoT server (110) of FIG. 1 or server (208) of FIG. 2). The server (320) may be a server that is linked with an application for controlling an IoT device.

[0086] In one embodiment, the electronic device (310) may automatically or manually place objects (e.g., furniture and / or IoT devices) on a map (e.g., a 2D viewer or a 3D viewer) generated by an application. The application may be capable of monitoring and controlling the status of the IoT devices.

[0087] According to one embodiment, the electronic device (310) may receive from the server (320) at least one floor plan identified based on addresses or GPS data stored in a user account.

[0088] In one embodiment, the electronic device (310) may request an indoor map corresponding to the selected floor plan from the server (320) based on a user input selecting at least one floor plan. In one embodiment, the electronic device (310) may display the indoor map received from the server (320).

[0089] According to one embodiment, the server (320) may store, for each user account, information about an indoor space (e.g., the name and / or size of the indoor space), location information about the indoor space (e.g., an address), information about rooms contained in the indoor space, furniture information, and information about connected devices. For example, the information about rooms may include layout information about the rooms (e.g., floor plan coordinates, wall coordinates, door coordinates, and / or window coordinates).

[0090] In one embodiment, the furniture information may include information about the coordinates, size, rotation, and / or visibility of the furniture contained in each room.

[0091] In one embodiment, information about linked devices may be stored grouped by room. Information about linked devices may also include information about devices not included in any room.

[0092] According to one embodiment, the electronic device (310) may receive information about an indoor space, information about rooms included in the indoor space, furniture information, and information about linked devices from the server (320). According to one embodiment, the electronic device (310) may automatically place objects corresponding to each linked device on the displayed indoor map.

[0093] According to one embodiment, the electronic device (310) can customize an indoor map based on user input. For example, the electronic device (310) can change the position of automatically placed objects or delete them based on user input. The electronic device (310) can add objects based on user input. The electronic device (310) can change the position of a room or add and / or delete objects based on user input.

[0094] According to one embodiment, the electronic device (310) can check the status or notifications of IoT devices through objects included in an indoor map displayed on the execution screen of the application. The electronic device (310) can control the IoT devices through the objects.

[0095] According to one embodiment, the electronic device (310) may transmit the generated indoor map to the server (320). According to one embodiment, the electronic device (310) may share the generated indoor map with another user's electronic device (340) through the server (320). The other user's electronic device (340) may display the shared indoor map (e.g., a 2D viewer or a 3D viewer) through the server (320). The other user's electronic device (340) may have different functions that can be performed through the indoor map depending on its authority.

[0096] According to one embodiment, the server (320) may store multiple indoor maps. According to one embodiment, the multiple indoor maps may be generated by the map engine (330).

[0097] According to one embodiment, the map engine (330) may acquire map data in vector form based on a planar image in raster form. The raster form may be image data composed of a continuous set of pixels. The vector form may be image data composed of the relative positions of continuous points or vertices.

[0098] According to one embodiment, the map engine (330) can classify the floor plan image into orthogonal, diagonal, or curved shapes. Deep learning / machine learning techniques can be used to recognize spatial structures, such as rooms, walls, and doors, from the floor plan image.

[0099] According to one embodiment, the map engine (330) can convert structural information of a recognized space into vector-format map data. According to one embodiment, the map engine (330) can obtain map data that vectorizes the structural information of a space based on whether the floor plan image is linear, diagonal, or curved.

[0100] According to one embodiment, the map data acquisition operation of the map engine (330) will be described in more detail with reference to FIG. 6 below.

[0101] FIG. 4 is a diagram for explaining an indoor map generation operation in which objects of an electronic device are placed according to one embodiment.

[0102] Referring to FIG. 4, in operation 410, an electronic device (e.g., device (124) of FIG. 1, electronic device (201) of FIG. 2, processor (220) of FIG. 1, or electronic device (310) of FIG. 3) can obtain an indoor map based on a user account through a communication module (e.g., communication module (290) of FIG. 2).

[0103] According to one embodiment, the electronic device may provide (e.g., display) at least one floor plan based on address information stored in a user account. For example, the electronic device may display a floor plan as illustrated in FIG. 5A below. According to one embodiment, the at least one floor plan may correspond to address information among multiple floor plans stored in a server (e.g., the first IoT server (110) of FIG. 1 , the server (208) of FIG. 2 , or the server (320) of FIG. 3 ).

[0104] According to one embodiment, the electronic device may provide (e.g., display) an indoor map corresponding to the selected floor plan based on a user input selecting at least one of the floor plans. For example, the electronic device may display an indoor map as illustrated in FIG. 5B .

[0105] In one embodiment, the indoor map may be obtained based on a floor plan. For example, the indoor map may be generated based on the floor plan by a map engine connected to a server. In one embodiment, the operation of the map engine that generates the indoor map using the floor plan will be described in more detail below with reference to FIG. 6.

[0106] According to one embodiment, the electronic device may obtain an indoor map corresponding to a floor plan based on a deep learning model stored in the memory of the electronic device. According to one embodiment, the electronic device may recognize the structure of a space including at least one of a room, a wall, or a door included in a floor plan image based on the deep learning model stored in the memory. For example, the deep learning model may be trained to obtain the structure of a space as output data by taking a floor plan image as input data.

[0107] In one embodiment, the electronic device may classify the purpose of each of the multiple spaces included in an indoor map based on the spatial structure. For example, the electronic device may classify each of the multiple spaces included in the indoor map as a living room, bathroom, kitchen, dining room, utility room, pantry, balcony, dressing room, powder room, bedroom, or entrance.

[0108] In one embodiment, in operation 420, the electronic device may automatically place at least one object corresponding to at least one external electronic device registered to the user account on the indoor map.

[0109] According to one embodiment, the electronic device can automatically place external electronic devices (or IoT devices) registered to the user's account on an indoor map. For example, the electronic device can automatically place objects corresponding to each IoT device on the indoor map. According to one embodiment, the user can check the status of the IoT devices through the objects corresponding to each IoT device. According to one embodiment, the IoT devices can also be controlled based on user input through the objects corresponding to each IoT device.

[0110] According to one embodiment, the electronic device can automatically place objects on an indoor map based on a list of pre-registered IoT devices. For example, the list of pre-registered IoT devices may include a list of rooms, each of which may be grouped by room. According to one embodiment, the operation of automatically placing objects on an indoor map based on a list of pre-registered IoT devices will be described in more detail below with reference to FIG. 8.

[0111] According to one embodiment, the electronic device may automatically place at least one object at a set location on an indoor map based on a set condition corresponding to the type of at least one external electronic device. For example, if the external electronic device is one of a light, a blind, a curtain, a room controller, a door lock, a ceiling-mounted device, and a TV, the electronic device may automatically place the object at a set location on the indoor map based on the type of the external electronic device. According to one embodiment, the operation of automatically placing the object based on the type of the external electronic device will be described in more detail with reference to FIGS. 9A to 9E below.

[0112] According to one embodiment, the electronic device may place an object corresponding to an external electronic device without a set location among at least one external electronic device, in a corner area of ​​a space included in an indoor map. For example, if there is no object placement condition according to the type of the external electronic device, the object may be placed in a corner of each space. For example, the electronic device may preferentially place an object corresponding to an external electronic device without a set location among at least one external electronic device, in a corner area of ​​the longest wall among the walls constituting the space included in the indoor map. This allows objects to be placed with a gap between them, and prevents incorrect input when the position is adjusted by the user. According to one embodiment, if there is no object placement condition according to the type of the external electronic device, the operation of automatically placing objects will be described in more detail with reference to FIGS. 10A and 10B below.

[0113] According to one embodiment, in operation 430, the electronic device may display an indoor map on which at least one object is placed. For example, as illustrated in FIG. 7A below, the electronic device may provide (e.g., display) an indoor map on which a plurality of objects corresponding to a plurality of registered IoT devices are automatically placed.

[0114] According to one embodiment, the electronic device may provide (e.g., display) a customized indoor map based on user input, such as an indoor map as illustrated in FIG. 7a, as illustrated in FIG. 7b.

[0115] According to one embodiment, an electronic device can customize an indoor map in which multiple objects are automatically placed based on user input. For example, the electronic device can add, delete, reposition, and / or reshape objects based on user input. According to one embodiment, the electronic device can add, delete, reposition, and / or reshape rooms based on user input.

[0116] According to one embodiment, the electronic device may rearrange at least one space among a plurality of spaces included in the indoor map based on receiving a user input for rearranging the space in the indoor map.

[0117] In one embodiment, the electronic device may assign rooms to areas included in an indoor map. For example, if a user input is received that selects a room from a room list and drags it to an area included in the indoor map, the electronic device may assign the selected room to the area from which the drag was released. According to one embodiment, the operation of assigning rooms is described in more detail below with reference to FIG. 11A.

[0118] In one embodiment, the electronic device may change a room assigned to an area within an indoor map to another area based on user input, or may de-assign a room assigned to an area. The operation of changing or de-assigning a room's assigned area according to one embodiment will be described in more detail below with reference to FIGS. 13A and 13B .

[0119] According to one embodiment, the electronic device may switch the assigned areas of multiple rooms, each assigned to a plurality of areas included in an indoor map, based on user input. According to one embodiment, the operation of switching the locations of the multiple assigned areas will be described in more detail below with reference to FIGS. 14A, 14B, and 14C.

[0120] In one embodiment, the electronic device may change a plurality of rooms assigned to each of a plurality of areas included in an indoor map to be assigned to a single area based on a user input. In one embodiment, the operation of merging a plurality of assigned areas into a single area will be described in more detail with reference to FIGS. 15A, 15B, and 15C below.

[0121] In one embodiment, the electronic device may reposition an object based on a user input that moves the position of at least one object among at least one object. For example, the electronic device may move the position of a selected object based on a user input that selects and drags a displayed object.

[0122] According to one embodiment, an electronic device may select an object to be displayed in a room allocated to an area included in an indoor map based on a user input. For example, when a room allocated to an area included in an indoor map is selected, the electronic device may display a plurality of IoT devices included in the room. The electronic device may display at least one object corresponding to each of at least one IoT device selected from among the plurality of IoT devices in an area of ​​the indoor map. According to one embodiment, an operation of selecting an object to be displayed from among the plurality of objects will be described in more detail below with reference to FIG. 12.

[0123] In one embodiment, the electronic device may, based on user input, add an object of an IoT device not included in a room in the IoT device list to a room assigned to an area included in an indoor map. The operation of adding an object not displayed on the indoor map according to one embodiment will be described in more detail below with reference to FIGS. 16A and 16B.

[0124] In one embodiment, the electronic device may hide objects displayed on an indoor map based on user input. For example, the electronic device may retain IoT devices within the room, but only delete objects displayed on the indoor map. According to one embodiment, the operation of hiding objects displayed on the indoor map will be described in more detail below with reference to FIG. 17A.

[0125] According to one embodiment, an electronic device can change the shape of an object based on user input. For example, when a user long-presses an object, the electronic device can display a list of icons. According to one embodiment, the electronic device can change the shape of the object to an icon selected from the icon list. According to one embodiment, the operation of changing the shape of an object will be described in more detail with reference to FIG. 17b below.

[0126] In one embodiment, the electronic device may transmit an indoor map generated based on user input to a server. For example, if a room allocation area or an object changes based on user input, the electronic device may transmit the change information to the server to update the indoor map. According to one embodiment, the operation of transmitting an updated indoor map based on user input to the server will be described in more detail below with reference to FIG. 18.

[0127] In one embodiment, an electronic device may share an indoor map, including at least one object, with an external electronic device via a communication module. For example, the external electronic device may be another user's electronic device. In one embodiment, the other user's electronic device may have different functions that can be performed via the indoor map depending on its permissions. In one embodiment, the operation of sharing an indoor map with another user's electronic device will be described in more detail with reference to FIGS. 19 and 20 below.

[0128] FIG. 5A is a diagram illustrating an operation of obtaining an indoor map based on the structure of an indoor space of an electronic device according to one embodiment.

[0129] Referring to FIG. 5A, an electronic device (e.g., device (124) of FIG. 1, electronic device (201) of FIG. 2, processor (220) of FIG. 1, or electronic device (310) of FIG. 3) may provide (e.g., display) at least one floor plan based on a user account. For example, the electronic device may display at least one floor plan selected from among a plurality of floor plans stored in a floor plan database of a server (e.g., first IoT server (110) of FIG. 1, server (208) of FIG. 2, or server (320) of FIG. 3) based on address information included in the user account.

[0130] According to one embodiment, the electronic device may further display a UI (511) related to at least one floor plan. The UI (511) related to at least one floor plan may include information regarding the number of at least one floor plan and the order of the currently displayed floor plans (510). For example, the electronic device may sequentially display the floor plans one by one based on the reception of a swipe gesture. According to one embodiment, the at least one floor plan may also be displayed in a list format.

[0131] According to one embodiment, the electronic device may receive a user input for selecting one of at least one floor plan. For example, the electronic device may select a floor plan (510) corresponding to an indoor space based on the user input among floor plans of multiple structures. For example, the user input for selecting one floor plan (510) may include selecting the floor plan (510) and selecting OK (or Next), or not entering any other user input for a set period of time while one floor plan (510) is displayed.

[0132] In one embodiment, the electronic device may transmit information about the selected floor plan (510) to a server.

[0133] FIG. 5b is a diagram for explaining an operation of obtaining an indoor map based on the structure of an indoor space of an electronic device according to one embodiment.

[0134] Referring to FIG. 5B, the electronic device may provide (e.g., display) an indoor map (520) corresponding to the selected floor plan. For example, the electronic device may receive and display an indoor map (520) corresponding to the selected floor plan (510), as illustrated in FIG. 5A, from a server. In one embodiment, although the indoor map (520) is illustrated as being 2D in FIG. 5B, it may also be displayed in 3D.

[0135] According to one embodiment, the indoor map (520) may recognize the structure of a space, such as a room, walls, and doors, in a floor plan. For example, the indoor map (520) may include coordinate information for each area of ​​the space.

[0136] According to one embodiment, the indoor map (520) may correspond to a floor plan selected from among multiple indoor maps stored on the server. According to one embodiment, the multiple indoor maps may be acquired based on multiple floor plans by the map engine illustrated in FIG. 6 below.

[0137] FIG. 6 is a diagram illustrating an operation of obtaining an indoor map based on a floor plan of an electronic device according to one embodiment.

[0138] Referring to FIG. 6, a map engine (330) (e.g., the map engine (330) of FIG. 3) can obtain an indoor map (620) based on a floor plan image (610). The map engine (330) can obtain information (621) (e.g., recognition information or coordinate information) related to the indoor map (620).

[0139] According to one embodiment, the map engine (330) may recognize the structure of a space including at least one room, wall, or door included in a floor plan image based on a deep learning model stored in memory. The deep learning model may be trained to obtain the structure of a space as output data by using the floor plan image as input data.

[0140] According to one embodiment, the map engine (330) can classify the planar image (610) into orthogonal, diagonal, or curved types. Since diagonal and curved types increase the complexity of vectorization, the electronic device can classify the type of the planar image (610) into orthogonal, diagonal, and curved types and select an algorithm optimized for each type. This can improve the processing speed of vectorization.

[0141] For example, the map engine (330) may extract thick black solid lines from the floor plan image (610). The map engine (330) may classify the floor plan image (610) as orthogonal if the angle between adjacent solid lines among the extracted solid lines is 90 degrees and the facing solid lines are parallel to each other. In one embodiment, the map engine (330) may classify the floor plan image (610) as diagonal if the angle between adjacent solid lines among the extracted solid lines is not 90 degrees or the facing solid lines are not parallel to each other. In another embodiment, the map engine (330) may classify the floor plan image (610) as curved if there is a part among the extracted solid lines whose slope continuously changes.

[0142] According to one embodiment, the map engine (330) can identify diagonal or curved portions within the plan image (610) based on the angle, parallelism, and change in slope between the extracted solid lines.

[0143] According to one embodiment, the map engine (330) can recognize spatial structures such as rooms, walls, and doors in a raster-type floor plan image (610) using deep learning or machine learning.

[0144] In one embodiment, as the types of floor plans increase or the number of objects to be recognized increases in addition to spatial structure information such as rooms, walls, and doors, the deep learning model can be retrained by adding floor plan labels as training data.

[0145] According to one embodiment, the map engine (330) may convert recognized spatial structure information into vector-type map data. For example, the map engine (330) may convert recognized spatial structure information into coordinate-based map data through a deep learning model, thereby generating location coordinates of rooms, walls, and doors, mapping spatial types (e.g., mapping each area of ​​an indoor map to a bedroom, living room, bathroom, etc.) and storing the map data (620, 621).

[0146] FIG. 7A is a diagram illustrating an operation of providing an indoor map in which objects of an electronic device are automatically placed, according to one embodiment.

[0147] Referring to FIG. 7a, an electronic device (e.g., device (124) of FIG. 1, electronic device (201) of FIG. 2, processor (220) of FIG. 1, or electronic device (310) of FIG. 3) can provide (e.g., display) an indoor map (710) in which a plurality of objects (711) are automatically arranged.

[0148] For example, the electronic device can automatically place objects (711) corresponding to IoT devices registered to a user account and objects corresponding to furniture registered to the user account on an indoor map (710). For example, IoT devices registered to a user account can be grouped by room, as illustrated in FIG. 8 below.

[0149] In one embodiment, the electronic device may place objects corresponding to IoT devices grouped by room in areas corresponding to the rooms on an indoor map. The electronic device may display all objects corresponding to IoT devices grouped by room on the indoor map.

[0150] For example, an electronic device may automatically place objects corresponding to an IoT device within an area corresponding to a room based on set conditions. According to one embodiment, the operation of automatically placing objects within an area corresponding to a room will be described in more detail below with reference to FIGS. 9A and 10B .

[0151] FIG. 7b is a drawing for explaining an operation of providing an indoor map in which objects are rearranged based on user input based on the indoor map illustrated in FIG. 7a.

[0152] Referring to FIG. 7B , the electronic device may provide (e.g., display) an indoor map (720) in which a space is modified or rearranged based on user input, and objects (721) are added, deleted, and / or rearranged. In one embodiment, objects (721) may be placed at locations on the indoor map (720) corresponding to actual spaces based on changes in the area assigned to a room or movement of the object's location based on user input.

[0153] In one embodiment, some objects may be deleted from the indoor map (720) based on user input. In one embodiment, registration of IoT devices corresponding to the deleted objects may be maintained.

[0154] In this way, by customizing the indoor map based on user input, the system can more intuitively check and control the status of IoT devices, more closely resembling the actual space. Furthermore, by displaying only a subset of objects corresponding to registered IoT devices, rather than all objects corresponding to the registered IoT devices, the gaps between objects are widened, preventing malfunctions in IoT device control through objects.

[0155] FIG. 8 is a diagram illustrating an operation of an electronic device generating an indoor map in which objects are automatically placed based on a list of IoT devices pre-registered through an IoT application according to one embodiment.

[0156] Referring to FIG. 8, an electronic device (e.g., device (124) of FIG. 1, electronic device (201) of FIG. 2, processor (220) of FIG. 1, or electronic device (310) of FIG. 3) may generate an IoT device list (810) through an application for controlling IoT devices. According to an embodiment, the IoT device list (810) may be generated based on user input. According to an embodiment, the IoT device list (810) may be grouped by room. For example, IoT devices included in a living room may be grouped under a living room item (811). IoT devices included in a kitchen may be grouped under a kitchen item (812). IoT devices included in an entrance may be grouped under a front door item (813).

[0157] According to one embodiment, the electronic device can identify the type of each area included in the indoor map (820) based on spatial structure information included in the indoor map (820).

[0158] According to one embodiment, the electronic device may automatically assign room items to each area of ​​the indoor map (820) based on the spatial information recognized when generating the indoor map (820) and the room items grouped by the user in the application. For example, the electronic device may check whether the name of the room item previously registered in the application matches the name of the type of each area included in the indoor map. The electronic device may assign a room item that matches the name of the type of area to the area. For example, the living room item (811) of the IoT device list (810) may be assigned to the living room area (821) on the indoor map (820). The kitchen item (812) of the IoT device list (810) may be assigned to the kitchen area (822) on the indoor map (820). The entrance area item (813) of the IoT device list (810) may be assigned to the entrance area (823) on the indoor map (820).

[0159] According to one embodiment, the electronic device may place objects corresponding to IoT devices included in a room item in an area assigned to the room item. The operation of automatically placing objects in an area according to one embodiment will be described in more detail with reference to FIGS. 9A and 10B below.

[0160] In this way, user convenience is improved by automatically placing objects corresponding to IoT devices on an indoor map, and malfunctions during touch control of objects can be reduced by distributing the objects.

[0161] FIG. 9A is a diagram for explaining an operation of an electronic device automatically placing an object when the IoT device is a light, according to one embodiment.

[0162] Referring to FIG. 9A, an electronic device (e.g., device (124) of FIG. 1, electronic device (201) of FIG. 2, processor (220) of FIG. 1, or electronic device (310) of FIG. 3) may, when the IoT device is a light, preferentially place a first object (910) corresponding to the light in the center of the room (910).

[0163] In one embodiment, if an object cannot be placed in the center, the electronic device may sequentially place the object to the right, left, above, or below the center. For example, since the second object (921) cannot be placed in the center of the room (910) because of the first object (920), it may be placed to the right of the center. Since the third object (922) cannot be placed in the center and to the right of the center of the room (910) because of the first object (920) and the second object (921), it may be placed to the left of the center. Since the fourth object (923) cannot be placed in the center, to the right of the center, and to the left of the center of the room (910) because of the first object (920), the second object (921), and the third object (922), it may be placed above the center. The fifth object (924) cannot be placed in the center, right of the center, left of the center, and above the center of the room (910) because of the first object (920), second object (921), third object (922), and fourth object (923), so it can be placed below the center.

[0164] In one embodiment, if an object cannot be placed anywhere on any of the four sides of the center, the electronic device may sequentially place objects diagonally from the center. In one embodiment, if an object cannot be placed anywhere on any of the four sides of the center, the electronic device may sequentially place objects starting from the area closest to the center among the placeable areas.

[0165] FIG. 9b is a diagram illustrating an operation of an electronic device automatically placing an object when the IoT device is a curtain or blind, according to one embodiment.

[0166] Referring to FIG. 9b, if the IoT device is a curtain or blind, the electronic device may place a first object (930) corresponding to the curtain or blind at the center of the longest window (911) in the room (910).

[0167] In one embodiment, if the object cannot be placed in the center of the window (911), the electronic device may sequentially place the object to the right, left, or above the center of the window (911). For example, since the second object (931) cannot be placed in the center of the window (911) due to the first object (900), it may be placed to the right of the center of the window (911). Since the third object (932) cannot be placed in the center and to the right of the center of the window (911) due to the first object (930) and the second object (931), it may be placed to the left of the center of the window (911).

[0168] In one embodiment, if an object cannot be placed on either the left or right side of the center of the window (911), the electronic device may place the object above the center of the window (911). In one embodiment, the electronic device may sequentially place the object starting from the area closest to the center of the window (911) among the placeable areas.

[0169] In one embodiment, even if the IoT device is a ceiling-mounted device (e.g., an air conditioner or air purifier), objects can be automatically placed on the indoor map under the same conditions as in FIG. 9b.

[0170] FIG. 9c is a diagram for explaining an operation of an electronic device automatically placing an object when an IoT device is a room controller, according to one embodiment.

[0171] Referring to FIG. 9c, if the IoT device is a room controller, the electronic device may place an object (940) corresponding to the room controller on the longest wall among the walls in the room (910) that has a door (912). In one embodiment, the electronic device may place the object (940) close to the center of the wall on which it is placed.

[0172] In one embodiment, if the object (940) cannot be placed at the center of the wall, the electronic device may sequentially place the object starting from the area closest to the center of the wall among the placeable areas.

[0173] FIG. 9d is a drawing for explaining an operation of an electronic device automatically placing an object when the IoT device is a door lock, according to one embodiment.

[0174] Referring to FIG. 9d, if the IoT device is a door lock, the electronic device may place an object (950) corresponding to the door lock at the center of the outer wall door (914) of the front door (913). In one embodiment, if there are multiple outer walls, the electronic device may place the object (950) on the door of the longest outer wall.

[0175] In one embodiment, if the object (950) cannot be placed in the center of the door (914), the electronic device may sequentially place the object starting from the area closest to the center of the door (914) among the placeable areas.

[0176] FIG. 9e is a diagram for explaining an operation of an electronic device automatically placing an object when the IoT device is a TV, according to one embodiment.

[0177] Referring to FIG. 9e, if the IoT device is a TV, the electronic device may place an object (950) corresponding to the TV at the center of the longest wall (916) among the walls of a space (915) (e.g., a living room or bedroom).

[0178] In one embodiment, if the object (960) cannot be placed at the center of the wall (916), the electronic device may sequentially place the object starting from the area closest to the center of the wall (916) among the placeable areas.

[0179] FIG. 10A is a diagram for explaining an operation of automatically placing an object corresponding to an IoT device whose location is difficult to infer, in an electronic device, according to one embodiment.

[0180] Referring to FIG. 10A, an electronic device (e.g., device (124) of FIG. 1, electronic device (201) of FIG. 2, processor (220) of FIG. 1, or electronic device (310) of FIG. 3) may search from a long wall of a room and place objects corresponding to IoT devices one by one from the left corner of the wall. The electronic device may search the long wall based on the length of the wall excluding the door. The electronic device may treat a window as a wall. When multiple walls of the same length are searched, the electronic device may preferentially place objects on the right wall and the bottom wall.

[0181] According to one embodiment, the electronic device may place the first object (1020) at the end of the longest wall (1011) excluding the door among the remaining walls (1011, 1012, 1013, 1014), excluding the wall-less portion (1015) in the room (1010).

[0182] In one embodiment, the electronic device may place a second object (1021) at an end of the second longest wall (1012) and further away from the first object (1020).

[0183] In one embodiment, the electronic device may place objects on the other end of the longest wall (1011) where no objects are placed, once all objects are placed on each wall (1011, 1012, 1013, 1014) of the room (1010). In one embodiment, the electronic device may not place objects on a part that is less than a set distance from the previously placed objects.

[0184] According to one embodiment, when objects are placed one at each end of all walls (1011, 1012, 1013, 1014) of (1010) as illustrated in FIG. 10a, the electronic device can place objects one at a time between the placed objects as illustrated in FIG. 10b.

[0185] FIG. 10b is a diagram illustrating an operation of automatically placing an object corresponding to an IoT device whose location is difficult to infer, in an electronic device, according to one embodiment.

[0186] Referring to FIG. 10B, the electronic device may place an object (1030) between objects positioned at both ends of the longest wall. In one embodiment, the electronic device may place an object (1031) between objects positioned at both ends of the second longest wall.

[0187] In one embodiment, when objects are placed on all walls of a room, the electronic device can place the objects parallel to the walls inward toward the room.

[0188] In this way, since most IoT devices are often placed on walls, it is expected that the actual location of the device and the location of the object are similar, and by placing the objects with a gap in the wall, the user can prevent incorrect input when adjusting the location.

[0189] FIG. 11A is a diagram illustrating an operation of assigning a pre-registered room to an indoor map through an IoT application of an electronic device according to one embodiment.

[0190] Referring to FIG. 11A, an electronic device (e.g., device (124) of FIG. 1, electronic device (201) of FIG. 2, processor (220) of FIG. 1, or electronic device (310) of FIG. 3) may display an indoor map and a list of IoT devices not assigned to the indoor map. In one embodiment, the list of IoT devices may be grouped according to room type.

[0191] According to one embodiment, the electronic device may receive an input (1121) to select a UI (1110) corresponding to a room (e.g., bedroom) that is not assigned to an indoor map and drag it to an area (1120) on the indoor map to which the room is not assigned.

[0192] According to one embodiment, the electronic device may display objects corresponding to IoT devices included in the selected room in the undragged area (1120).

[0193] In one embodiment, when the size of the area (1120) is small and it is difficult to display all objects, the electronic device may display a screen for selecting objects to be displayed in the area (1120), as illustrated in FIG. 11b.

[0194] FIG. 11b is a diagram illustrating an operation of assigning objects corresponding to IoT devices included in a pre-registered room to an indoor map through an IoT application of an electronic device according to one embodiment.

[0195] Referring to FIG. 11b, if the electronic device has a small area that makes it difficult to display all objects, it may display a message (1130) indicating that there is not enough space to display all objects. The message (1130) may include a UI for selecting objects to be displayed.

[0196] In one embodiment, when a user input is received for selecting a UI for selecting an object to be displayed, the electronic device may display a screen (1140) for selecting an object to be displayed. For example, the screen (1140) for selecting an object to be displayed may be a pop-up screen.

[0197] According to one embodiment, the electronic device may allow selection of only a limited number of objects from among a plurality of objects through a screen (1140) for selecting objects to be displayed.

[0198] According to one embodiment, the electronic device may display objects selected by the user in an area (1120) assigned to a room. According to one embodiment, the displayed objects may be automatically arranged in the manner illustrated in FIGS. 9A to 10B.

[0199] FIG. 12 is a drawing illustrating an operation of selecting objects to be displayed on an indoor map when assigning a pre-registered room to an indoor map through an IoT application of an electronic device according to one embodiment.

[0200] Referring to FIG. 12, an electronic device (e.g., device (124) of FIG. 1, electronic device (201) of FIG. 2, processor (220) of FIG. 1, or electronic device (310) of FIG. 3) may, when a room (e.g., living room) is assigned to an area (1210) of an indoor map, display a different color from other areas and display the name of the room in the area to which the room is assigned. According to one embodiment, the electronic device may place objects corresponding to IoT devices included in the room within the area (1210) to which the room is assigned.

[0201] In one embodiment, the electronic device may select an object to be displayed in an area (1210) based on user input.

[0202] According to one embodiment, when a user input (1211) for selecting an area (1210) on an indoor map is received, the electronic device may display a screen (1220) for editing an object. According to one embodiment, the screen (1220) for editing an object may include a UI for selecting an object to be displayed and a UI for hiding an object.

[0203] According to one embodiment, upon receiving a user input (1221) for selecting a UI for selecting an object to be displayed, the electronic device may display a screen (1230) for selecting an object to be displayed on an indoor map.

[0204] According to one embodiment, the electronic device may display all objects that can be displayed in the room-assigned area (1210) through a screen (1230) for selecting an object to be displayed in the room-assigned area (1210) and receive a user's selection.

[0205] According to one embodiment, the electronic device may display objects selected by the user in an area (1210) assigned to a room. According to one embodiment, the displayed objects may be automatically arranged in the manner illustrated in FIGS. 9A to 10B.

[0206] FIG. 13A is a diagram illustrating an operation of changing the location of an assigned room on an indoor map of an electronic device according to one embodiment.

[0207] Referring to FIG. 13A, an electronic device (e.g., device (124) of FIG. 1, electronic device (201) of FIG. 2, processor (220) of FIG. 1, or electronic device (310) of FIG. 3) may, when a room (e.g., living room) is assigned to a first area (1310) of an indoor map, display a different color from other areas in the area to which the room is assigned and display the name of the room. According to one embodiment, the electronic device may place objects corresponding to IoT devices included in the room within the first area (1310) to which the room is assigned.

[0208] In one embodiment, the electronic device may receive a user input (1311) of long-pressing a first area (1310) and dragging it to a second area (1320). The second area (1320) may be an area to which no room is assigned.

[0209] According to one embodiment, the electronic device may reallocate a room assigned to the first area (1310) to the second area (1320) based on a user input (1311) of long-pressing the first area (1310) and dragging it to the second area (1320). According to one embodiment, the electronic device may delete objects displayed in the first area (1310) from the first area (1310) and display objects (1330) corresponding to IoT devices included in the room reallocated to the second area (1320). According to one embodiment, the displayed objects (1330) may be automatically arranged in the manner illustrated in FIGS. 9A to 10B .

[0210] FIG. 13b is a diagram illustrating an operation of deleting an assigned room on an indoor map of an electronic device according to one embodiment.

[0211] Referring to FIG. 13B, when the electronic device receives a user input (1313) of long-pressing an area on an indoor map to which a room is assigned and dragging it to an unassigned list area (1340), the electronic device may release the room assignment from an area on the indoor map. In one embodiment, the unassigned list area (1340) may be a list of unassigned rooms and / or IoT devices on the indoor map.

[0212] In one embodiment, based on a user input (1313) of long-pressing and dragging an area on an indoor map to which a room is assigned to an unassigned list area (1340), the electronic device may unassign the room in the first area (1310) and add information about the unassigned room to the unassigned list area (1340).

[0213] FIG. 14A is a diagram illustrating an operation of changing the location of an assigned room on an indoor map of an electronic device according to one embodiment.

[0214] Referring to FIG. 14A, an electronic device (e.g., device (124) of FIG. 1, electronic device (201) of FIG. 2, processor (220) of FIG. 1, or electronic device (310) of FIG. 3) may display the first area (1410) and the second area (1420) in different colors and display the names of the respective rooms when a first room (e.g., living room) is assigned to a first area (1410) of an indoor map and a second room (e.g., kitchen) is assigned to a second area (1420). According to one embodiment, the electronic device may place objects corresponding to IoT devices included in the first room in the first area (1410), and place objects corresponding to IoT devices included in the second room in the second area (1420).

[0215] In one embodiment, the electronic device may receive a user input (1411) of long pressing a first area (1410) and dragging it to a second area (1420).

[0216] According to one embodiment, the electronic device may provide an option to switch or merge rooms assigned to each area, as illustrated in FIG. 14b, based on a user input (1411) of long-pressing a first area (1410) and dragging it to a second area (1420).

[0217] FIG. 14B is a diagram illustrating a user interface displayed when an input is received to change the location of an assigned room on an indoor map of an electronic device to a location to which another room is already assigned, according to one embodiment.

[0218] Referring to FIG. 14b, the electronic device may display a screen (1430) (e.g., a pop-up screen) including a UI (1431) for switching rooms assigned to each area and a UI (1432) for merging two rooms into one area based on a user input (1411) of long-pressing a first area (1410) and dragging it to a second area (1420).

[0219] According to one embodiment, based on the selection of the UI (1431) for switching the room assigned to each area, the electronic device can switch the room assigned to each area, as illustrated in FIG. 14c.

[0220] In one embodiment, based on the selection of the UI (1432) for merging two rooms into one area, the electronic device may assign the two rooms into one area as illustrated in FIGS. 15A to 15C below. The operation of merging two rooms into one area will be described in more detail with reference to FIGS. 15A to 15C below.

[0221] FIG. 14c is a diagram illustrating an operation of switching the locations of multiple rooms assigned on an indoor map of an electronic device according to one embodiment.

[0222] Referring to FIG. 14C, based on the selection of a UI (1431) for switching rooms assigned to each area, the electronic device may assign a second room (e.g., kitchen) to a first area (1410) and a first room (e.g., living room) to a second area (1420). According to an embodiment, the electronic device may delete objects displayed in the first area (1410) from the first area (1410) and display them in the second area (1420). According to an embodiment, the electronic device may delete objects displayed in the second area (1420) from the second area (1420) and display them in the first area (1410). According to an embodiment, objects displayed in the first area (1410) and the second area (1420) may be automatically arranged in the manner illustrated in FIGS. 9A to 10B.

[0223] According to one embodiment, when at least one of the first area (1410) and the second area (1420) has insufficient space to display objects, the electronic device may display a message indicating that there is insufficient space and display a screen for selecting an object to be displayed, as illustrated in FIG. 11B.

[0224] FIG. 15A is a diagram illustrating an operation of merging multiple rooms on an indoor map of an electronic device according to one embodiment.

[0225] Referring to FIG. 15A, an electronic device (e.g., device (124) of FIG. 1, electronic device (201) of FIG. 2, processor (220) of FIG. 1, or electronic device (310) of FIG. 3) may display the first area (1510) and the second area (1520) in different colors and display the names of the respective rooms when a first room (e.g., living room) is assigned to a first area (1510) of an indoor map and a second room (e.g., kitchen) is assigned to a second area (1520). According to an embodiment, the electronic device may place objects corresponding to IoT devices included in the first room in the first area (1510), and place objects corresponding to IoT devices included in the second room in the second area (1520).

[0226] In one embodiment, the electronic device may further display an unassigned list (1530) indicating rooms and / or IoT devices that are not assigned to the indoor map.

[0227] In one embodiment, the electronic device may receive a user input (1532) to select a UI (1531) corresponding to a third room (e.g., bedroom) included in the unplaced list (1530) and drag it to the first area (1510).

[0228] According to one embodiment, the electronic device may provide an option to switch or merge rooms assigned to each area, as illustrated in FIG. 15b, based on a user input (1532) of selecting a UI (1531) corresponding to a third room and dragging it to a first area (1510).

[0229] FIG. 15b is a diagram illustrating a user interface displayed when an input for merging multiple rooms on an indoor map of an electronic device is received, according to one embodiment.

[0230] Referring to FIG. 15b, the electronic device may display a screen (1540) (e.g., a pop-up screen) including a UI (1541) for switching rooms assigned to each area and a UI (1542) for merging two rooms into one area based on a user input (1532) of selecting a UI (1531) corresponding to a third room and dragging it to a first area (1510).

[0231] In one embodiment, based on the selection of the UI (1542) for merging two rooms into one area, the electronic device may assign two rooms (e.g., living room and bedroom) to the first area (1510). In one embodiment, the electronic device may display a screen (1550) for entering a name to be displayed in the first area (1510) to which the two rooms are assigned, as illustrated in FIG. 15c.

[0232] In one embodiment, based on the selection of a UI (1541) for switching the rooms assigned to each area, the electronic device may switch the assigned areas of the two rooms as illustrated in FIGS. 14A to 14C. For example, the electronic device may assign a third room to the first area (1510), and the assignment of the first room may be released, so that the UI for the first room may be included in the unassigned list (1530).

[0233] FIG. 15C is a diagram illustrating a user interface displayed for modifying a room name when an input for merging multiple rooms on an indoor map of an electronic device is received, according to one embodiment.

[0234] Referring to FIG. 15c, a screen (1550) for receiving input of a name to be displayed in a first area (1510) may include an area for text input (1551). According to an embodiment, the electronic device may determine the text input in the area for text input (1551) as the name of the first area (1510). According to an embodiment, the screen (1550) for receiving input of a name to be displayed in the first area (1510) may include a UI for selecting one of the names of two rooms, together with or instead of the area for text input (1551).

[0235] According to one embodiment, the electronic device may place objects corresponding to IoT devices included in a first room within a first area (1510) and objects corresponding to IoT devices included in a third room. According to one embodiment, the objects displayed in the first area (1510) may be automatically placed in the manner illustrated in FIGS. 9A to 10B .

[0236] According to one embodiment, when the first area (1510) has insufficient space to display objects, the electronic device may display a message indicating that there is insufficient space and display a screen for selecting objects to be displayed, as illustrated in FIG. 11b.

[0237] FIG. 16A is a diagram for explaining an operation of placing an object corresponding to an IoT device that is not registered in any room on an indoor map in an IoT application of an electronic device according to one embodiment.

[0238] Referring to FIG. 16A, an electronic device (e.g., device (124) of FIG. 1, electronic device (201) of FIG. 2, processor (220) of FIG. 1, or electronic device (310) of FIG. 3) may receive a user input (1611) of dragging a UI (1610) corresponding to an IoT device included in an unplaced list to a first area (1620) of an indoor map. According to one embodiment, a first room (e.g., a living room) may be assigned to the first area (1620).

[0239] According to one embodiment, the electronic device may place an object (1612) corresponding to the dragged UI (1610) at a location where the user input (1611) was released. For example, the object (1612) may be an icon of an IoT device corresponding to the selected UI (1610).

[0240] FIG. 16b is a diagram for explaining an operation of placing an object corresponding to an IoT device that is not registered in any room on an indoor map in an IoT application of an electronic device according to one embodiment.

[0241] Referring to FIG. 16b, the electronic device may receive a user input (1613) of dragging a UI (1610) corresponding to an IoT device included in the unassigned list to a second area (1630) of the indoor map. In one embodiment, the second area (1630) may not have a room assigned to it.

[0242] According to one embodiment, the electronic device may display a screen (1640) for entering a room name so that a new room is assigned to the second area (1630). For example, the screen (1640) for entering a room name may include an area (1641) for entering text and / or multiple UIs for selecting a room name.

[0243] According to one embodiment, the electronic device may display the name entered or selected through the screen (1640) for entering the room name in the second area (1630). According to one embodiment, the electronic device may place an object corresponding to the dragged UI (1610) at the location where the user input (1611) is released within the second area (1630). For example, the object may be an icon of an IoT device corresponding to the selected UI (1610).

[0244] FIG. 17A is a drawing for explaining an operation of changing the shape of an object of an electronic device according to one embodiment.

[0245] Referring to FIG. 17A, an electronic device (e.g., device (124) of FIG. 1, electronic device (201) of FIG. 2, processor (220) of FIG. 1, or electronic device (310) of FIG. 3) may receive a user input (1711) selecting an object (1710) placed in a first area on an indoor map. For example, the user input (1711) may be a long press.

[0246] According to one embodiment, the electronic device may display a screen (1720) for editing an object (1710) based on a user input (1711) for selecting an object (1710). According to one embodiment, the screen (1720) for editing an object (1710) may include a UI for changing an icon shape and a UI for hiding an icon.

[0247] In one embodiment, when an object (1730) whose icon shape cannot be changed is selected, the electronic device may display only a UI for hiding the icon on the screen (1731) for editing the object (1730).

[0248] FIG. 17b is a drawing for explaining an operation of changing the shape of an object of an electronic device according to one embodiment.

[0249] Referring to FIG. 17b, the electronic device may display an icon list (1740) based on receiving a user input (1721) for selecting a UI for changing the icon shape on a screen (1720) for editing an object (1710).

[0250] In one embodiment, the electronic device may display an object (1742) changed to the selected icon based on receiving a user input (1741) selecting an icon from a list of icons (1740).

[0251] In one embodiment, the electronic device may delete an icon displayed on an indoor map based on receiving a user input (1722) selecting a UI for hiding the icon on a screen (1720) for editing an object (1710). In one embodiment, the icon may be deleted on the indoor map, but the registration of the IoT device corresponding to the deleted object may be maintained.

[0252] FIG. 18 is a flowchart illustrating an operation of generating an indoor map in which objects of an electronic device are placed, according to one embodiment.

[0253] Referring to FIG. 18, an electronic device (e.g., device (124) of FIG. 1, electronic device (201) of FIG. 2, processor (220) of FIG. 1, or electronic device (310) of FIG. 3) may obtain an account (e.g., ID)-based indoor map in operation 1810. For example, the indoor map may be obtained based on address information stored in an account.

[0254] In one embodiment, in operation 1820, the electronic device may determine whether a map has already been generated. A generated map may mean that objects corresponding to IoT devices registered to an account are automatically placed on the indoor map, or manually placed and stored by user input.

[0255] In one implementation, if the map has already been generated (action 1820 - yes), the electronic device may terminate the process for generating the indoor map.

[0256] In one embodiment, if the map has not been generated (operation 1820 - No), in operation 1830, the electronic device may determine whether the map data has changed. For example, the map data may correspond to a floor plan selected by a user input from among at least one floor plan. In one embodiment, if a user input for changing the floor plan is received, the electronic device may determine that the map data has changed.

[0257] According to one embodiment, when the map data is changed (operation 1830 - Yes), in operation 1831, the electronic device may transmit the map data to a server (e.g., the first IoT server (110) of FIG. 1, the server (208) of FIG. 2, or the server (320) of FIG. 3). For example, the electronic device may transmit selected map data for a space for generating an indoor map to the server.

[0258] In one embodiment, the electronic device may determine whether the room and / or device data has changed in operation 1840 after operation 1831. In one embodiment, if the map data has not changed (operation 1830 - No), the electronic device may proceed to operation 1840.

[0259] In one embodiment, whether the room and / or device data is changed may be a change (e.g., addition, deletion, or renaming) of pre-registered rooms and IoT devices grouped by room by user input.

[0260] In one embodiment, when room and / or device data changes (operation 1840 - example), in operation 1841, the electronic device may transmit the room and device data to the server. For example, the information about the room and device data may be information about whether the data about the room and / or device has changed.

[0261] The electronic device may determine whether the room allocation area has changed in operation 1850 after operation 1841. In one embodiment, if the room and / or device data has not changed (operation 1840 - No), the electronic device may proceed to operation 1850.

[0262] In one embodiment, the determination of whether a room assignment area changes may be based on whether the area to which a room is assigned among the areas on the indoor map changes based on user input. For example, the electronic device may assign a room to an area whose type matches the area on the indoor map and the name of a previously registered room. For example, the electronic device may assign a previously registered room, "Living Room," to an area on the indoor map whose type is "Living Room."

[0263] According to one embodiment, the electronic device may change (e.g., add, delete, or move) the allocated area of ​​a room as shown in FIGS. 11A to 16 based on user input.

[0264] In one embodiment, when a room allocation area is changed (operation 1850 - Yes), in operation 1851, the electronic device may transmit room allocation information to the server. For example, the room allocation information may be information on whether the allocation area of ​​the room has changed.

[0265] The electronic device may determine whether the device has moved in operation 1860 after operation 1851. In one embodiment, if the room allocation area has not changed (operation 1850 - No), the electronic device may proceed to operation 1860.

[0266] In one embodiment, whether the device is moved may be whether objects corresponding to the device placed on the indoor map are moved by user input.

[0267] In one embodiment, when the device is moved (operation 1860 - example), in operation 1861, the electronic device may transmit room assignment information to the server.

[0268] The electronic device may store map data for the room and the device in operation 1870 after operation 1861. In one embodiment, if the device is not moved (operation 1860 - No), the electronic device may proceed to operation 1870.

[0269] In one embodiment, the electronic device may transmit the room and device coordinates for map data to the server in operation 1871. In FIG. 18, the coordinate information is illustrated as being transmitted after the information on whether there has been a change has been transmitted. However, in one embodiment, the coordinate information may also be transmitted when the information on whether there has been a change has been transmitted.

[0270] According to one embodiment, the order of the operations for checking whether there is a change is not limited to FIG. 18.

[0271] FIG. 19 is a flowchart illustrating an indoor map control operation of another user based on the authority of the other user, according to one embodiment.

[0272] Referring to FIG. 19, an owner (1920), who is a user of an electronic device (e.g., device (124) of FIG. 1, electronic device (201) of FIG. 2, processor (220) of FIG. 1, or electronic device (310) of FIG. 3), can grant permission to other users (members) for an indoor map. For example, the permission can be full permission, limited permission, or no permission. For example, with full permission, the owner can check the status and notifications for all IoT devices and control the IoT devices through the indoor map with the same permission as the owner. With full permission, the owner can edit the indoor map, such as assigning a room registered by user input to the indoor map or placing IoT devices on the indoor map, and can also delete the created indoor map.

[0273] For example, the limited permission allows you to check the status and notifications for all IoT devices and control them through the indoor map. However, the limited permission does not allow you to edit or delete the indoor map.

[0274] For example, no permission would disable all features for indoor maps, which would prevent indoor maps from being viewed.

[0275] In one embodiment, an administrator (1920) may grant permissions to other users through user input (1921) via a screen (e.g., a permissions setting screen) of an application (1910).

[0276] According to one embodiment, the application (1910) may register (1922) permissions granted to each user with the permission server (1911).

[0277] In one embodiment, when an administrator or other user (1930) runs an indoor map through an application (1910), the application (1910) may request authorization information (1932) from an authorization server (1911) and receive authorization information from the authorization server (1911).

[0278] For example, if the permission is full permission or limited permission, the application (1910) can request (1933) an indoor map from the map data server (1912) and receive (1934) the indoor map from the map data server (1912).

[0279] In one embodiment, the application (1910) may provide an indoor map.

[0280] For example, if there is no permission, the application (1910) cannot request an indoor map from the map data server (1912) and cannot provide an indoor map.

[0281] According to one embodiment, if the permission is full permission or limited permission, after providing map data, the application (1910) may request (1935) the status and / or device control of the IoT device to the device server (1913) (e.g., IoT device server) based on user input. According to one embodiment, the application (1910) may receive (1936) information on whether the IoT device control was successful and / or information on the status of the IoT device from the device server (1913). According to one embodiment, the application (1910) may provide (e.g., display) the received information on whether the control was successful and / or information on the status of the IoT device.

[0282] In one embodiment, if the permission is full permission or limited permission, the application (1910) may request (1937) a notification from an IoT device to the device server (1913) based on user input. In one embodiment, the application (1910) may receive (1938) a notification from the IoT device from the device server (1913) and provide (e.g., display) the notification.

[0283] FIG. 20 is a diagram illustrating an editing menu provided to another user based on the authority of the other user, according to one embodiment.

[0284] Referring to FIG. 20, an electronic device of another user (member) may provide indoor map-related functions based on the permissions granted by the owner. For example, if the other user's permission is full permission, the other user's electronic device may display a screen (2020) for editing an indoor map when selecting a menu (2010). For example, the screen (2020) for editing an indoor map may include a UI for editing the layout, a UI for placing devices, and a UI for deleting a map.

[0285] In some embodiments, if the other user has limited permission, the screen for editing (2020) may not be provided.

[0286] In this way, by providing floor plan-based map data and customizing functions, it is possible to provide an indoor map similar to the space actually used by the user.

[0287] Although the present disclosure illustrates an indoor map being displayed on a terminal, 2D maps or 3D maps can also be applied to large screens (e.g., TVs, billboards), XR devices, and robots, and can provide a rich experience.

[0288] According to one embodiment, an electronic device may include a communication module, a display, and at least one processor operatively connected to the communication module and the display.

[0289] According to one embodiment, the at least one processor can obtain an indoor map based on a user account through the communication module.

[0290] In one embodiment, the at least one processor may automatically place at least one object, each corresponding to at least one external electronic device registered to the user account, on the indoor map.

[0291] In one embodiment, the at least one processor may display the indoor map on which the at least one object is placed on the display.

[0292] In one embodiment, the at least one processor may reposition the one object based on receiving a user input that moves the position of the one object among the at least one object.

[0293] In one embodiment, the at least one processor may automatically place the at least one object at a set location on the indoor map based on a set condition corresponding to a type of the at least one external electronic device.

[0294] According to one embodiment, the at least one processor may place an object corresponding to an external electronic device without a set location among the at least one external electronic device in a corner area of ​​a space included in the indoor map.

[0295] In one embodiment, the at least one processor may place an object corresponding to an external electronic device without a set location among the at least one external electronic device in a corner area of ​​a longest wall among the walls constituting a space included in the indoor map.

[0296] According to one embodiment, the at least one processor can share the indoor map in which the at least one object is placed with an external electronic device through the communication module.

[0297] In one embodiment, the at least one processor may rearrange at least one space among a plurality of spaces included in the indoor map based on receiving a user input for rearranging a space in the indoor map.

[0298] According to one embodiment, the at least one processor may obtain a floor plan image based on address information corresponding to the user account, and obtain the indoor map based on the floor plan image.

[0299] According to one embodiment, the electronic device may further include a memory.

[0300] According to one embodiment, the at least one processor can recognize the structure of a space including at least one of a room, a wall, or a door included in the floor plan image based on a deep learning model stored in the memory.

[0301] According to one embodiment, the deep learning model may be trained to obtain a spatial structure as output data by using a floor plan image as input data.

[0302] According to one embodiment, the at least one processor may classify the purpose of each of the plurality of spaces included in the indoor map based on the structure of the space.

[0303] According to one embodiment, a method for controlling an electronic device may include an operation of obtaining an indoor map based on a user account via a communication module of the electronic device.

[0304] According to one embodiment, a method for controlling an electronic device may include an operation of automatically placing at least one object corresponding to at least one external electronic device registered to the user account on the indoor map.

[0305] According to one embodiment, a method of controlling an electronic device may include an operation of displaying the indoor map on which the at least one object is placed.

[0306] According to one embodiment, a method of controlling an electronic device may further include an action of repositioning one of the objects based on receiving a user input for moving a position of the one or more objects.

[0307] According to one embodiment, the operation of automatically placing the at least one object on the indoor map may automatically place the at least one object at a set location on the indoor map based on a set condition corresponding to a type of the at least one external electronic device.

[0308] According to one embodiment, the operation of automatically placing at least one object on the indoor map may place an object corresponding to an external electronic device without a set location among the at least one external electronic device in a corner area of ​​a space included in the indoor map.

[0309] According to one embodiment, the operation of automatically placing at least one object on the indoor map may place an object corresponding to an external electronic device without a set position among the at least one external electronic device in a corner area of ​​the longest wall among the walls constituting a space included in the indoor map.

[0310] According to one embodiment, the method for controlling an electronic device may further include an operation of sharing the indoor map on which the at least one object is arranged with an external electronic device through the communication module.

[0311] According to one embodiment, a method of controlling an electronic device may further include an operation of rearranging at least one space among a plurality of spaces included in the indoor map based on receiving a user input for rearranging a space of the indoor map.

[0312] According to one embodiment, the operation of obtaining the indoor map may include obtaining a floor plan image based on address information corresponding to the user account, and obtaining the indoor map based on the floor plan image.

[0313] According to one embodiment, the operation of obtaining the indoor map may recognize the structure of a space including at least one of a room, a wall, or a door included in the floor plan image based on a deep learning model stored in a memory of the electronic device.

[0314] According to one embodiment, the deep learning model may be trained to obtain a spatial structure as output data by using a floor plan image as input data.

[0315] According to one embodiment, the operation of obtaining the indoor map may classify the purpose of each of the plurality of spaces included in the indoor map based on the structure of the space.

[0316] According to one embodiment, a non-transitory computer-readable recording medium storing one or more programs may include instructions for an electronic device to obtain an indoor map based on a user account through a communication module.

[0317] In one embodiment, the one or more programs may include commands for the electronic device to automatically place at least one object on the indoor map, each object corresponding to at least one external electronic device registered to the user account.

[0318] In one embodiment, the one or more programs may include instructions for causing the electronic device to display the indoor map on which the at least one object is placed on the display.

[0319] In one embodiment, the one or more programs may include instructions for the electronic device to reposition one of the at least one objects based on receiving a user input that moves the position of the one or more objects.

[0320] According to one embodiment, the one or more programs may include commands for the electronic device to automatically place the at least one object at a set location on the indoor map based on a set condition corresponding to a type of the at least one external electronic device.

[0321] In one embodiment, the one or more programs may include commands for the electronic device to place an object corresponding to an external electronic device without a set location among the at least one external electronic device in a corner area of ​​a space included in the indoor map.

[0322] According to one embodiment, the one or more programs may include commands for the electronic device to place an object corresponding to an external electronic device without a set location among the at least one external electronic device in a corner area of ​​a longest wall among the walls constituting a space included in the indoor map.

[0323] In one embodiment, the one or more programs may include commands for the electronic device to share the indoor map, in which the at least one object is placed, with an external electronic device via the communication module.

[0324] In one embodiment, the one or more programs may include instructions for the electronic device to rearrange at least one space among a plurality of spaces included in the indoor map based on receiving a user input for rearranging the space of the indoor map.

[0325] In one embodiment, the one or more programs may include commands for causing the electronic device to obtain a floor plan image based on address information corresponding to the user account, and to obtain the indoor map based on the floor plan image.

[0326] According to one embodiment, the electronic device may further include a memory.

[0327] According to one embodiment, the one or more programs may include commands for the electronic device to recognize the structure of a space including at least one of a room, a wall, or a door included in the floor plan image based on a deep learning model stored in the memory.

[0328] According to one embodiment, the deep learning model may be trained to obtain a spatial structure as output data by using a floor plan image as input data.

[0329] According to one embodiment, the one or more programs may include instructions for the electronic device to classify the purpose of each of the plurality of spaces included in the indoor map based on the structure of the space.

[0330] Electronic devices according to the embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments disclosed in this document are not limited to the aforementioned devices.

[0331] The embodiments of this document and the terminology used herein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0332] The term "module" used in the embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0333] One embodiment of the present document may be implemented as software (e.g., a program (240)) including one or more instructions stored in a storage medium (e.g., an internal memory (236) or an external memory (238)) readable by a machine (e.g., an electronic device (201)). For example, a processor (e.g., a processor (220)) of a machine (e.g., an electronic device (101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0334] According to one embodiment, the method according to one embodiment disclosed in this document may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) via an application store (e.g., Play Store™) or directly between two user devices (e.g., smart phones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0335] According to one embodiment, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and arranged in other components. According to one embodiment, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to one embodiment, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In electronic devices, Communication module; display; and At least one processor operatively connected to the communication module and the display; At least one processor of the above, Obtain an indoor map based on the user account through the above communication module, Automatically place at least one object corresponding to at least one external electronic device registered to the user account on the indoor map, An electronic device set to display on the display the indoor map on which at least one object is placed.

2. In paragraph 1, At least one processor of the above, An electronic device for repositioning one object based on receiving a user input for moving the position of one of the at least one object.

3. In paragraph 1 or 2, At least one processor of the above, An electronic device that automatically places at least one object at a set location on the indoor map based on a set condition corresponding to a type of at least one external electronic device.

4. In paragraph 3, At least one processor of the above, An electronic device that places an object corresponding to an external electronic device having no set location among the at least one external electronic device in a corner area of ​​a space included in the indoor map.

5. In paragraph 4, At least one processor of the above, An electronic device that places an object corresponding to an external electronic device having no set location among the at least one external electronic device in a corner area of ​​the longest wall among the walls forming a space included in the indoor map.

6. In any one of paragraphs 1 to 5, At least one processor of the above, An electronic device that shares the indoor map on which at least one object is placed with an external electronic device through the communication module.

7. In any one of paragraphs 1 to 6, At least one processor of the above, An electronic device that rearranges at least one space among a plurality of spaces included in the indoor map based on receiving a user input for rearranging the spaces of the indoor map.

8. In any one of paragraphs 1 to 7, At least one processor of the above, An electronic device that obtains a floor plan image based on address information corresponding to the user account and obtains the indoor map based on the floor plan image.

9. In paragraph 8, memory; including more; At least one processor of the above, Based on the deep learning model stored in the above memory, the structure of a space including at least one of a room, a wall, or a door included in the above floor plan image is recognized, The above deep learning model is, An electronic device that is trained to obtain the structure of a space as output data by using a floor plan image as input data.

10. In paragraph 9, At least one processor of the above, An electronic device that classifies the purpose of each of a plurality of spaces included in the indoor map based on the structure of the space.

11. In a method for controlling an electronic device, An operation of obtaining an indoor map based on a user account through a communication module of the electronic device; An operation of automatically placing at least one object corresponding to at least one external electronic device registered to the user account on the indoor map; and A method for controlling an electronic device, comprising: an operation of displaying an indoor map on which at least one object is placed; 12. In paragraph 11, A method of controlling an electronic device, further comprising: an operation of repositioning one object based on receiving a user input for moving a position of one of the at least one object; 13. In paragraph 11 or 12, The operation of automatically placing at least one object on the indoor map comprises: A control method of an electronic device that automatically places at least one object at a set location on the indoor map based on a set condition corresponding to a type of at least one external electronic device.

14. In paragraph 13, The operation of automatically placing at least one object on the indoor map comprises: A method for controlling an electronic device for placing an object corresponding to an external electronic device having no set location among the at least one external electronic device in a corner area of ​​a space included in the indoor map.

15. In paragraph 14, The operation of automatically placing at least one object on the indoor map comprises: A method for controlling an electronic device for placing an object corresponding to an external electronic device having no set position among the at least one external electronic device in a corner area of ​​the longest wall among the walls forming a space included in the indoor map.

Images