Electronic device and control method therefor

Abstract

This electronic device comprises: a communication circuit; a memory configured to store instructions; and one or more processors including processing circuitry, wherein the one or more processors individually or collectively execute the stored instructions to: obtain integrated data including operation information of a plurality of devices, location information of the plurality of devices, and location information of a user; obtain group information including at least one device from among the plurality of devices through an artificial intelligence model on the basis of the integrated data; and transmit a control signal identified on the basis of the integrated data and the group information to at least one device included in the same group through the communication circuit.

Description

Electronic device and control method thereof

[0001] The present disclosure relates to an electronic device and a method for controlling the same.

[0002] With the recent advancement of AI home robot technology, technology is being developed to integrate and control multiple home appliances using AI home robots.

[0003] AI home robots can move around indoor spaces to assist users in their daily lives and perform appropriate activities, thereby supporting a convenient and efficient lifestyle. AI home robots can provide integrated control of multiple home appliances, enabling users to use them more efficiently and conveniently.

[0004] An electronic device according to one or more embodiments of the present disclosure comprises one or more processors including a communication circuit, a memory for storing instructions, and a processing circuitry, wherein the one or more processors execute the stored instructions individually or collectively to obtain integrated data including operation information of a plurality of devices, location information of the plurality of devices, and location information of a user, input the integrated data into an artificial intelligence model to obtain group information including at least one device among the plurality of devices, and transmit a control signal identified based on the integrated data and the group information to at least one device included in the same group through the communication circuit.

[0005] According to one or more embodiments, the electronic device further includes a sensor, and when the instructions are executed individually or collectively by the one or more processors, the electronic device inputs information corresponding to the identified user and the integrated data into the artificial intelligence model to obtain group information corresponding to the identified user, and transmits a control signal identified based on the group information corresponding to the identified user and the integrated data to at least one device included in the same group through the communication circuit.

[0006] According to one or more embodiments, when the instructions are executed individually or collectively by the one or more processors, the electronic device receives operation data for each of the plurality of devices, which forms the basis of the integrated data, from each of the plurality of devices through the communication circuit.

[0007] According to one or more embodiments, the electronic device further comprises a sensor, and when the instructions are executed individually or collectively by the one or more processors, the electronic device moves to the location of each of the plurality of devices and obtains operation data for each of the plurality of devices based on data obtained through the sensor.

[0008] According to one or more embodiments, when the instructions are executed individually or collectively by one or more processors, the electronic device transmits the integrated data to the device through the communication circuit when a signal corresponding to a communication connection is received from the device through the communication circuit, and operates in conjunction with the device that received the integrated data.

[0009] According to one or more embodiments, the electronic device further includes a sensor, and when the instructions are executed individually or collectively by the one or more processors, the electronic device obtains information corresponding to the space where the electronic device is located based on data obtained by the sensor, and obtains the control signal based on the information corresponding to the space, the group information, and the integrated data.

[0010] According to one or more embodiments, the electronic device further includes a speaker, and when the instructions are executed individually or collectively by the one or more processors, the electronic device outputs information corresponding to a control signal identified based on the group information and the integrated data through the speaker, and when user input for the information corresponding to the control signal is received, transmits the control signal to the at least one home appliance through the communication circuit.

[0011] According to one or more embodiments, the electronic device further includes a projection unit, and when the instructions are executed individually or collectively by the one or more processors, the electronic device projects information corresponding to a control signal identified based on the group information and the integrated data through the projection unit, and when user input for the information corresponding to the control signal is received, transmits the control signal to the at least one home appliance through the communication circuit.

[0012] According to one or more embodiments, the electronic device further includes an IR sensor, and when the instructions are executed individually or collectively by the one or more processors, if communication connection with a first device included in the same group is not possible, the electronic device moves to the location of the first device and outputs an IR signal corresponding to the control signal through the IR sensor.

[0013] According to one or more embodiments, when the instructions are executed individually or collectively by the one or more processors, the electronic device obtains the integrated data corresponding to the operation information of the plurality of devices by the user location based on the plurality of operation data and spatial user location data received from the plurality of devices.

[0014] A control method for an electronic device according to one or more embodiments of the present disclosure includes the operation of acquiring integrated data including operation information of a plurality of devices, location information of the plurality of devices, and location information of a user; the operation of acquiring group information including at least one device among the plurality of devices by inputting the integrated data into an artificial intelligence model; and the operation of transmitting a control signal identified based on the integrated data and the group information to at least one device included in the same group.

[0015] A non-transient computer-readable storage medium storing computer instructions that cause an electronic device to perform an operation when executed by a processor of an electronic device according to one or more embodiments of the present disclosure, wherein the operation comprises: an operation of acquiring integrated data including operation information of a plurality of devices, location information of the plurality of devices, and location information of a user; an operation of acquiring group information including at least one device among the plurality of devices by inputting the integrated data into an artificial intelligence model; and an operation of transmitting a control signal identified based on the integrated data and the group information to at least one device included in the same group.

[0016] FIG. 1 is a drawing for explaining the operation of an electronic device according to one or more embodiments.

[0017] FIG. 2 is a block diagram illustrating the configuration of an electronic device according to one or more embodiments.

[0018] FIG. 3 is a block diagram illustrating the detailed configuration of an electronic device according to one or more embodiments.

[0019] FIG. 4 is a diagram illustrating the process of acquiring integrated data of an electronic device according to one or more embodiments.

[0020] FIG. 5 is a drawing for illustrating integrated data according to one or more embodiments.

[0021] FIG. 6 is a diagram illustrating the integrated data transmission process of an electronic device according to one or more embodiments.

[0022] FIG. 7 is a diagram illustrating the process of acquiring group information of an electronic device according to one or more embodiments.

[0023] FIG. 8 is a diagram illustrating the process of acquiring user-specific group information of an electronic device according to one or more embodiments.

[0024] FIG. 9 is a diagram illustrating the process of transmitting control signals of an electronic device according to one or more embodiments.

[0025] FIG. 10 is a drawing for explaining the process of providing guide information of an electronic device according to one or more embodiments.

[0026] FIGS. 11 and FIGS. 12 are drawings for explaining the process of providing information through a projection part of an electronic device according to one or more embodiments.

[0027] FIG. 13 is a diagram illustrating a process for controlling a home appliance using an IR signal according to one or more embodiments.

[0028] FIG. 14 is a drawing for explaining the operation process of an electronic device according to one or more embodiments.

[0029] The terms used in the various embodiments of this Disclosure have been selected to be as widely used and general as possible, taking into account their functions within this disclosure; however, these terms may vary depending on the intent of those skilled in the art, case law, the emergence of new technologies, etc. Additionally, in specific cases, terms have been selected at the applicant's discretion, and in such cases, their meanings will be described in detail in the relevant description section of this disclosure. Therefore, terms used in this disclosure should be defined not merely by their names, but based on their meanings and the overall content of this disclosure.

[0030] In the present disclosure, expressions such as “have,” “may have,” “include,” or “may include” indicate the presence of such features (e.g., numerical values, functions, actions, or components such as parts) and do not exclude the presence of additional features.

[0031] The expression "at least one of A or / and B" should be understood as representing either "A" or "B" or "A and B".

[0032] Expressions such as "first," "second," "first," or "second" used in this disclosure may modify various components regardless of order and / or importance, and are used only to distinguish one component from another and do not limit said components.

[0033] Where it is stated that a component (e.g., Component 1) is "(operatively or communicatively) coupled with / to" or "connected to" another component (e.g., Component 2), it should be understood that the component may be directly connected to the other component or connected through the other component (e.g., Component 3).

[0034] The singular expression includes the plural expression unless the context clearly indicates otherwise. In this disclosure, terms such as “comprising” or “consisting of” are intended to specify the existence of the features, numbers, steps, actions, components, parts, or combinations thereof described in the specification, and should be understood as not precluding the existence or addition of one or more other features, numbers, steps, actions, components, parts, or combinations thereof.

[0035] In the present disclosure, a "module" or "part" performs at least one function or operation and may be implemented in hardware or software, or a combination of hardware and software. Additionally, a plurality of "modules" or a plurality of "parts" may be integrated into at least one module and implemented by at least one processor (not shown), except for a "module" or "part" that needs to be implemented in specific hardware.

[0036] In the present disclosure, the term "user" may refer to a person using an electronic device or a device used by such person.

[0037] An embodiment of the present disclosure will be described in more detail below with reference to the attached drawings.

[0038] FIG. 1 is a drawing for explaining the operation of an electronic device according to one or more embodiments.

[0039] According to one embodiment, the electronic device (100) can communicate with a plurality of home appliances and transmit control signals. Here, the electronic device (100) may be a mobile electronic device including a projector. The electronic device (100) may be implemented as various electronic devices such as a mobile robot, a robot vacuum cleaner, an AGV (Automated Guided Vehicle), an AMR (Autonomous Mobile Robot), a social robot, a projector, a portable projector, a tablet, a mobile device, a laptop, etc.

[0040] According to one embodiment, the electronic device (100) may include a display. Specifically, the electronic device (100) may directly display an acquired image or content on the display.

[0041] According to one embodiment, the electronic device (100) may not include a display. The electronic device (100) may be connected to an external display device and may transmit an image or content stored in the electronic device (100) to the external display device.

[0042] The electronic device (100) can transmit an image or content to an external display device along with a control signal for controlling the display of the image or content on the external display device. Here, the external display device may be connected to the electronic device (100) via a communication circuit (110) or an input / output interface (190). For example, the electronic device (100) may not include a display, such as a Set Top Box (STB).

[0043] According to one example, the electronic device (100) may include only a small display capable of displaying simple information such as text information. The electronic device (100) may transmit an image or content to an external display device via a wired or wireless connection through a communication circuit (110) or to an external display device via an input / output interface (190).

[0044] According to one embodiment, the electronic device (100) may receive operation log data for each of the plurality of devices from a plurality of home appliances. The operation log data may include data regarding the operation status and performance generated by the device during operation. For example, the operation log data may include data corresponding to the device's operation time, operation duration, energy consumption, operation mode, and operation setting value. The electronic device (100) may receive operation log data from each of the plurality of devices and identify the operation pattern of each of the plurality of devices based on the operation log data.

[0045] According to one embodiment, the electronic device (100) can move through a space and identify location log data of a user for each space. The location log data of a user for each space may include data regarding the user's movement path, time of movement, movement pattern, and time of stay for each space. For example, the electronic device (100) may classify the interior space of a house into a living room, a room, and a bathroom, and identify log data regarding the time of stay and time of movement of a user for each space.

[0046] According to one embodiment, the electronic device (100) can identify integrated data based on operation log data for each of a plurality of devices and location log data of a user by space.

[0047] The integrated data may be data that includes operation information for each of multiple devices based on the user's location. For example, the integrated data may be data that integrates the user's location log data for the living room space within the house and the operation log data for each of multiple devices located in the living room space.

[0048] Referring to FIG. 1, the electronic device (100) can move through space and receive operation log data for each of the devices (10-1 to 10-3) from a plurality of devices (10-1 to 10-3). The electronic device (100) can identify the location of a user through a sensor (140) and obtain user location log data based on the identified user location. The electronic device (100) can identify integrated data based on the device operation log data and user location log data.

[0049] According to one embodiment, the electronic device (100) can control the devices by grouping the devices to include at least one device among a plurality of devices. The electronic device (100) can control the devices by group based on identified integrated data.

[0050] Hereinafter, with reference to the drawings, various embodiments will be described in which an electronic device (100) obtains group information including at least one device among a plurality of devices and transmits a control signal to the device based on the integrated data.

[0051] FIG. 2 is a block diagram illustrating the configuration of an electronic device according to one or more embodiments.

[0052] According to FIG. 2, the electronic device (100) includes a communication circuit (110), a memory (120), and one or more processors (130). However, it is not limited thereto, and the electronic device (100) may be implemented with some components excluded or with other components included.

[0053] The communication circuit (110) may include wired or wireless input / output interfaces (or input / output terminals) according to various standards. The communication circuit (110) may be configured to communicate with various types of external devices according to various types of communication methods. The communication circuit (110) may include a wireless communication module or a wired communication module. Here, each communication module may be implemented in the form of at least one hardware chip.

[0054] The communication circuit (110) may include various interfaces such as HDMI (High Definition Multimedia Interface), MHL (Mobile High-Definition Link), USB (Universal Serial Bus), DP (Display Port), Thunderbolt, VGA (Video Graphics Array) port, RGB port, D-SUB (D-subminiature), DVI (Digital Visual Interface), Bluetooth, Zigbee, wired / wireless LAN (Local Area Network), WAN (Wide Area Network), Ethernet, IEEE 1394, AES / EBU (Audio Engineering Society / European Broadcasting Union), Optical, Coaxial, etc.

[0055] The memory (120) can store at least one instruction, data, program, etc. required for the operation of the electronic device (100). For example, the memory (120) can store contour highlighting processing information and location information corresponding to a selected image.

[0056] The memory (120) may be implemented in the form of a memory embedded in the electronic device (100) or in the form of a memory detachable from the electronic device (100), depending on the purpose of data storage. For example, data for operating the electronic device (100) may be stored in a memory embedded in the electronic device (100), and data for the expansion function of the electronic device (100) may be stored in a memory detachable from the electronic device (100).

[0057] In the case of memory embedded in the electronic device (100), it may be implemented as at least one of volatile memory (e.g., DRAM (dynamic RAM), SRAM (static RAM), or SDRAM (synchronous dynamic RAM), non-volatile memory (e.g., OTPROM (one time programmable ROM), PROM (programmable ROM), EPROM (erasable and programmable ROM), EEPROM (electrically erasable and programmable ROM), mask ROM, flash ROM, flash memory (e.g., NAND flash or NOR flash), hard drive, or solid state drive (SSD).

[0058] The memory (120) may be implemented as a single memory that stores data generated in various operations according to the present disclosure, but is not limited thereto, and the memory (120) may be implemented to include a plurality of memories that each store different types of data or each store data generated in different stages.

[0059] One or more processors (130) control the overall operation of the electronic device (100). Specifically, one or more processors (130) may be connected to each component of the electronic device (100) to control the overall operation of the electronic device (100). For example, one or more processors (130) may be electrically connected to the communication circuit (110) and the memory (120) to control the overall operation of the electronic device (100). One or more processors (130) may include a processing circuit and may be composed of one or more processors.

[0060] One or more processors (130) can perform the operation of an electronic device (100) according to various embodiments by executing one or more instructions stored in memory (120).

[0061] One or more processors (130) may include one or more of a CPU (Central Processing Unit), GPU (Graphics Processing Unit), APU (Accelerated Processing Unit), MIC (Many Integrated Core), DSP (Digital Signal Processor), NPU (Neural Processing Unit), hardware accelerator, or machine learning accelerator. One or more processors (130) may control one or any combination of other components of an electronic device and may perform operations or data processing related to communication. One or more processors (130) may execute one or more programs or instructions stored in memory. For example, one or more processors may perform a method according to one or more embodiments of the present disclosure by executing one or more instructions stored in memory.

[0062] When a method according to one or more embodiments of the present disclosure includes a plurality of operations, the plurality of operations may be performed by a single processor or by a plurality of processors. For example, when a first operation, a second operation, and a third operation are performed by a method according to one or more embodiments, the first operation, the second operation, and the third operation may all be performed by a first processor, or the first operation and the second operation may be performed by a first processor (e.g., a general-purpose processor) and the third operation may be performed by a second processor (e.g., an artificial intelligence dedicated processor).

[0063] One or more processors (130) may be implemented as a single-core processor including one core, or as one or more multicore processors including multiple cores (e.g., homogeneous multicore or heterogeneous multicore). When one or more processors (130) are implemented as multicore processors, each of the multiple cores included in the multicore processor may include internal processor memory such as cache memory or on-chip memory, and a common cache shared by multiple cores may be included in the multicore processor. Additionally, each of the multiple cores included in the multicore processor (or some of the multiple cores) may independently read and execute program instructions for implementing a method according to one or more embodiments of the present disclosure, or all (or some) of the multiple cores may be linked together to read and execute program instructions for implementing a method according to one or more embodiments of the present disclosure.

[0064] When a method according to one or more embodiments of the present disclosure includes a plurality of operations, the plurality of operations may be performed by one of the plurality of cores included in a multi-core processor, or may be performed by a plurality of cores. For example, when a first operation, a second operation, and a third operation are performed by a method according to one or more embodiments, the first operation, the second operation, and the third operation may all be performed by a first core included in a multi-core processor, or the first operation and the second operation may be performed by a first core included in a multi-core processor and the third operation may be performed by a second core included in a multi-core processor.

[0065] In the embodiments of the present disclosure, a processor may refer to a system-on-chip (SoC) in which one or more processors and other electronic components are integrated, a single-core processor, a multi-core processor, or a core included in a single-core processor or a multi-core processor, wherein the core may be implemented as a CPU, GPU, APU, MIC, DSP, NPU, hardware accelerator, or machine learning accelerator, but the embodiments of the present disclosure are not limited thereto. For convenience of explanation, one or more processors (130) will be referred to as processors (130) below.

[0066] According to one embodiment, the processor (130) can obtain integrated data corresponding to the operation information of multiple devices by user location.

[0067] According to one embodiment, the processor (130) can identify integrated data including operation information of multiple devices by user's location based on multiple operation log data and location log data by space received from multiple devices.

[0068] The integrated data may be data that integrates log data of devices operated at a specific point in time and location log data of the user. For example, if a user is in the living room at 12:00 PM and an air conditioner and air purifier placed in the living room are operating, the integrated data may include operation information of multiple devices for the living room at 12:00 PM.

[0069] According to one embodiment, the processor (130) can input integrated data into an artificial intelligence model to obtain group information including at least one device among a plurality of devices.

[0070] Group information may include information about a group comprising at least one device among a plurality of devices based on the device's function, the user's lifestyle pattern, and device usage information per user. For example, the group information may include information grouping air conditioners, fans, and air purifiers into a single group based on their blowing function.

[0071] According to one embodiment, the processor (130) can transmit an identified control signal based on group information and integrated data to at least one device included in the same group through the communication circuit (110).

[0072] FIG. 3 is a block diagram illustrating the detailed configuration of an electronic device according to one or more embodiments.

[0073] According to FIG. 3, the electronic device (100) includes a communication circuit (110), a memory (120), one or more processors (130), a sensor (140), a microphone (150), a speaker (160), a projection unit (170), a driving unit (180), and an input / output interface (190). A detailed description of the configurations shown in FIG. 3 that overlap with the configuration shown in FIG. 2 will be omitted.

[0074] The sensor (140) is configured to move through space and identify a receiver. The sensor (140) may include at least one of an IR sensor, a Lidar sensor, a depth camera, an IMU (Inertial Measurement Unit) sensor, a ToF (Time of Flight) sensor, a vision sensor, a light sensor, an RGB sensor, an image sensor, an infrared sensor, an ultrasonic sensor, a gyroscope, an accelerometer, and a proximity sensor.

[0075] A LiDAR sensor can project light (e.g., laser, near-infrared light, visible light, ultraviolet light, etc.) in a 360-degree direction and detect light reflected by various surrounding objects (e.g., walls, furniture, home appliances, etc.) to output sensing information for obtaining information about the distance to surrounding objects. A depth camera is a sensor that projects a laser or infrared light onto an external object and receives the returning light with a stereo camera to measure the distance to the external object in three dimensions and sense depth data. An IMU sensor is a sensor for detecting the movement of an electronic device and may include at least one of a geomagnetic sensor, an accelerometer, and a gyroscope. A ToF sensor can measure the distance to an external object by using the time (time of flight) for the reflected signal to be received after outputting a signal such as a laser.

[0076] The microphone (150) is configured to receive user voice or other sounds and convert them into audio data. The processor (130) can control the projection unit (170) based on the user voice signal received through the microphone (150).

[0077] The speaker (160) can convert and amplify a digital audio signal processed by the processor (130) into an analog audio signal and output it. For example, the speaker (160) may include at least one speaker unit, a D / A converter, an audio amplifier, etc., capable of outputting at least one channel. For example, the speaker (160) may output information corresponding to the caller and the caller's intention regarding a received call.

[0078] The projection unit (170) is configured to project (or project) an image. The projection unit (170) may include a light source, at least one lens (not shown), or a reflector. The projection unit (170) may project an image using one of the following projection methods: a cathode-ray tube (CRT) method, a liquid crystal display (LCD) method, a digital light processing (DLP) method, and a laser method.

[0079] The projection unit (170) can perform various functions under the control of the processor (130). For example, the projection unit (170) can adjust the focus of the image or perform a keystone correction function depending on the distance from the floor surface (e.g., projection distance). The keystone correction function refers to a function that corrects a distorted image. For example, the projection unit (170) can perform horizontal keystone correction if image distortion occurs in the left-right direction, and perform vertical keystone correction if image distortion occurs in the up-down direction. In addition, the projection unit (170) can perform quick corner keystone correction to correct the unbalanced corners of the area.

[0080] The driving unit (180) is configured to move the main body of the electronic device (100). The driving unit (180) may include a plurality of wheels, a driving motor for rotating each of the plurality of wheels, a gear, a shaft, etc. The plurality of wheels are provided on the lower side or side of the main body of the electronic device (100) to support the main body of the electronic device (100) from the bottom surface. When the driving motor operates and the driving force is transmitted to the plurality of wheels so that each wheel rotates, the electronic device (100) can be moved by the frictional force between the bottom surface and the wheels. In addition, the driving unit (180) may change the rotational speed of at least one of the plurality of wheels or adjust the alignment direction of the wheels differently when changing direction. Depending on the type of electronic device (100) and the characteristics of the space where the electronic device (100) is located (e.g., roughness of the bottom surface, frictional force, etc.), an endless track or the like may be used instead of wheels.

[0081] The input / output interface (190) may be any one of the following interfaces: HDMI (High Definition Multimedia Interface), MHL (Mobile High-Definition Link), USB (Universal Serial Bus), DP (Display Port), Thunderbolt, VGA (Video Graphics Array) port, RGB port, D-SUB (D-subminiature), DVI (Digital Visual Interface).

[0082] The input / output interface (190) can input and output at least one of audio and video signals. Depending on the implementation example, the input / output interface (190) may include separate ports for inputting and outputting only audio signals and for inputting and outputting only video signals, or it may be implemented as a single port for inputting and outputting both audio and video signals.

[0083] The electronic device (100) can transmit at least one of audio and video signals to an external device (e.g., an external display device or an external speaker) through an input / output interface (190). Specifically, an output port included in the input / output interface (190) may be connected to an external device, and the electronic device (100) can transmit at least one of audio and video signals to the external device through the output port.

[0084] The input / output interface (190) can be connected to a communication circuit (110). The input / output interface (190) can transmit information received from an external device to the communication circuit or transmit information received through the communication interface to an external device.

[0085] FIG. 4 is a diagram illustrating the process of acquiring integrated data of an electronic device according to one or more embodiments.

[0086] According to one embodiment, the electronic device (100) can obtain integrated data based on the operation log data of the device and the location log data of the user by space.

[0087] According to one embodiment, the electronic device (100) can receive operation log data for each of the plurality of devices from each of the plurality of devices through a communication circuit (110).

[0088] According to one embodiment, the electronic device (100) can move to the location of each of the plurality of devices and obtain operation log data for each of the plurality of devices based on data obtained through the sensor (140).

[0089] According to one embodiment, the electronic device (100) can move to the location of a device (hereinafter referred to as the first device) among a plurality of devices that cannot communicate with the electronic device (100) and obtain operation log data of the first device through a sensor (140).

[0090] According to one embodiment, the electronic device (100) can identify the location information of a user by space through a sensor (140) and obtain the user's location log data based on the location information.

[0091] According to one embodiment, the electronic device (100) can move through space and identify the location information of each user. The electronic device (100) can identify a plurality of users (e.g., User 1, User 2) and identify the location information of each user.

[0092] According to one example, the electronic device (100) can identify the user's time spent in each space and the movement path. For example, if the user stayed in the living room from 12:00 PM to 2:00 PM, the electronic device (100) can identify the user's location and the user's time spent in the living room.

[0093] Referring to FIG. 4, the electronic device (100) can move in space and obtain user location log data (410) for each user. The electronic device (100) can identify User 1 and User 2 among a plurality of users, and obtain location information and information on the time spent in a specific space for each user.

[0094] For example, if User 1 stays in the living room from 12:00 PM to 12:34 PM and stays in the baby room from 1:27 PM to 2:00 PM, the electronic device (100) can obtain location log data corresponding to the living room (12:00 PM - 12:34 PM) and the baby room (1:27 PM - 2:00 PM) for User 1.

[0095] The electronic device (100) can obtain operation log data for each device from a plurality of devices through a communication circuit (110). For example, the electronic device (100) can receive operation log data (430) including the location of the air conditioner, the operating time of the air conditioner, the set temperature, and the airflow information from the air conditioner (420) through the communication circuit (110).

[0096] Likewise, the electronic device (100) can obtain operation log data for each of the devices from a plurality of devices located within the space.

[0097] FIG. 5 is a drawing for illustrating integrated data according to one or more embodiments.

[0098] According to one embodiment, the electronic device (100) can identify integrated data including operation information of a plurality of devices based on the user's location. The electronic device (100) can identify integrated data including user location information and device operation information in a specific space.

[0099] According to one example, the electronic device (100) can classify the space where the electronic device (100) is located and obtain log data for each space. For example, the electronic device (100) can classify the space into a living room, a baby room, and a kitchen, and obtain operation log data of the device located in the space.

[0100] According to one example, the electronic device (100) can obtain operation log data of a device placed in the space where the user is located. For example, if the user is in the living room at 1:00 PM, the operation log data of a device placed in the living room at 1:00 PM can be obtained.

[0101] The integrated data may include operation log data of a device placed in the space where the user is located, based on the user's location. That is, if the user is located in the kitchen at a specific time, the electronic device (100) can obtain integrated data by utilizing the operation log data of the device placed in the kitchen at that time to integrate the user's location information and the device's operation log data.

[0102] Referring to FIG. 5, the electronic device (100) can classify spaces while moving. For example, the electronic device (100) can classify spaces into a living room (520-1), a baby room (520-2), and a kitchen (520-3). The electronic device (100) can identify the user's location and obtain operation log data (530) of a device placed in the space where the user is located. The electronic device (100) can obtain location log data corresponding to the time of stay, movement path, and location time of a specific space from the identified user's location. The electronic device (100) can obtain integrated data (510) by integrating the device operation log data (530) and the user's location log data.

[0103] FIG. 6 is a diagram illustrating the integrated data transmission process of an electronic device according to one or more embodiments.

[0104] According to one embodiment, the electronic device (100) can transmit identified integrated data (510) to each of a plurality of devices. When a device receives integrated data (510) from the electronic device (100), it can perform operation control based on the integrated data (510). For example, if a user is located in the living room during a specific time period, the device placed in the living room can perform operation control during that time period through learning data based on the integrated data.

[0105] According to one embodiment, when the electronic device (100) receives a communication connection signal from a new device through the communication circuit (110), it can transmit integrated data (510) to the new device. The new device can operate in conjunction with a plurality of devices based on the integrated data (510) received from the electronic device (100).

[0106] For example, if a new device is placed in the living room, and a device other than the new device placed in the living room operates, the new device can operate in conjunction with the device placed in the living room based on integrated data (510).

[0107] Referring to FIG. 6, the electronic device (100) can transmit the identified integrated data (510) to each of the multiple devices (610, 620). The electronic device (100) can also transmit the integrated data (510) to a new device (630). In the case of a device equipped with artificial intelligence technology, it can learn based on the received integrated data (510) and automatically control operation at a specific time. In the case of a new device (630), it can operate in conjunction with multiple devices based on the integrated data (510).

[0108] FIG. 7 is a diagram illustrating the process of acquiring group information of an electronic device according to one or more embodiments.

[0109] According to one embodiment, the electronic device (100) can input integrated data into an artificial intelligence model to obtain group information including at least one device among a plurality of devices.

[0110] According to one example, an artificial intelligence model may be trained to acquire group information based on functional information for each of multiple devices. The functional information may include a blower function, a voice recognition function, a washing function, a cooling function, and a content output function. For example, an air conditioner, a fan, and an air purifier with a blower function may be grouped into one group, and a TV, a washing machine, and an air conditioner with a voice recognition function may be grouped into one group.

[0111] For example, an artificial intelligence model can be trained to acquire group information based on log data of the device operated by the user among multiple devices. For instance, if a user uses an air conditioner and a TV simultaneously at a specific time, the artificial intelligence model can group the air conditioner and the TV into a single group based on the log data of the devices included in the integrated data.

[0112] For example, an artificial intelligence model can be trained to acquire group information based on the location information of devices. For instance, if an air conditioner, a fan, and a TV are placed in a living room and the user uses only the air conditioner and the TV, the artificial intelligence model can group the air conditioner and the TV into a single group based on integrated data.

[0113] Here, the term "training an artificial intelligence model" means that a basic artificial intelligence model (e.g., an artificial intelligence model containing arbitrary random parameters) is trained by a learning algorithm using multiple training data, thereby creating predefined behavioral rules or an artificial intelligence model configured to perform a desired characteristic (or objective). This learning may be performed via a separate server and / or system, but is not limited thereto, and may also be performed in a cooking device. Examples of learning algorithms include supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but are not limited to the examples mentioned above.

[0114] Here, the artificial intelligence model may be implemented as, for example, CNN (Convolutional Neural Network), RNN (Recurrent Neural Network), RBM (Restricted Boltzmann Machine), DBN (Deep Belief Network), BRDNN (Bidirectional Recurrent Deep Neural Network), or Deep Q-Networks, but is not limited thereto.

[0115] Referring to FIG. 7, an electronic device (100) can obtain group information (720) by inputting integrated data (510) into an artificial intelligence model (710). The artificial intelligence model (710) can be trained to obtain group information (720) based on the functional information of the device. The electronic device (100) can obtain group information (720) grouped by function through the artificial intelligence model (710). For example, the electronic device (100) can obtain group information grouped into one group of a cassette-type air conditioner with a blower function and a stand-type air conditioner through the artificial intelligence model (720).

[0116] FIG. 8 is a diagram illustrating the process of acquiring user-specific group information of an electronic device according to one or more embodiments.

[0117] According to one embodiment, when a user is identified based on data acquired by a sensor (140), the electronic device (100) can input information and integrated data about the identified user into an artificial intelligence model to obtain group information corresponding to the identified user.

[0118] Information about a user may include device operation information corresponding to each of multiple users. For example, if User 1 among multiple users operates an air conditioner and a TV at a specific time, the information about the user may include information about the devices operated by User 1. For example, if User 2 among multiple users operates a fan and an air purifier at the same time, the information about the user may include information about the devices operated by User 2.

[0119] Each of the multiple users may operate at least one of the multiple devices based on their own lifestyle patterns. For example, User 1 may watch TV at 6:00 PM and operate an air conditioner and a fan. For example, User 2 may operate a fan and an air purifier at 7:00 PM. As such, the types of devices used by each user may differ, and even the same user may use different types of devices depending on the season and time of day.

[0120] According to one embodiment, the electronic device (100) can obtain user-specific group information by inputting log data and integrated data of the device used by each user into an artificial intelligence model.

[0121] According to one embodiment, the electronic device (100) may transmit an identified control signal through a communication circuit to at least one device included in the same group based on group information and integrated data corresponding to the identified user. For example, the control signal may include a signal to control the operation of the TV and air conditioner at 6 PM for User 1.

[0122] Referring to FIG. 8, the electronic device (100) can identify a user based on data acquired by a sensor (140). For example, the electronic device (100) can receive a user list for multiple users from the user. The electronic device (100) can identify each of the multiple users based on the user list. Subsequently, the electronic device (100) can acquire log data (810) regarding operation information of multiple devices for each user and for each user's location.

[0123] The electronic device (100) can obtain user-specific group information by inputting user-specific device log data (810) and integrated data (510) into an artificial intelligence model (830). For example, in the case of User 1, if the air conditioner, TV, and fan are used in the living room at 6:00 PM, the electronic device (100) can obtain group information for User 1 in which the air conditioner, TV, and fan are grouped into one group. For example, in the case of User 2, if the fan and air purifier are used in the baby room at 6:00 PM, the electronic device (100) can obtain group information for User 2 in which the fan and air purifier are grouped into one group.

[0124] FIG. 9 is a diagram illustrating the process of transmitting control signals of an electronic device according to one or more embodiments.

[0125] According to one embodiment, the electronic device (100) may obtain a control signal for at least one device included in a group based on group information and integrated data. The control signal may be a signal containing control information for operating the device. The electronic device (100) may transmit the same control signal to a plurality of devices included in a group. Conversely, the electronic device (100) may transmit different control signals to each of the plurality of devices included in a group.

[0126] For example, if an air conditioner, a fan, and an air purifier with a blower function are grouped into one group, the electronic device (100) can obtain control signals for each of the air conditioner, fan, and air purifier to set the indoor temperature to 18 degrees.

[0127] According to one embodiment, the electronic device (100) can acquire information about the space where the electronic device (100) is located based on data acquired by the sensor (140), and can acquire a control signal based on the information about the space, group information, and integrated data.

[0128] Information about the space may include environmental indicator data about the space. For example, information about the space may include information corresponding to the temperature, humidity, air pollution level, and carbon dioxide concentration of the space. The electronic device (100) can move through the space via the sensor (140) and acquire information about the space.

[0129] According to one example, the electronic device (100) can obtain a control signal for a group using group information and integrated data based on information about the space. For example, if the temperature of the space is 25 degrees at 12:00 PM, the electronic device (100) can obtain a control signal for a group including a blower function based on integrated data.

[0130] Referring to FIG. 9, the electronic device (100) can acquire information about the indoor space at a specific time point through the sensor (140). The electronic device (100) can compare the information about the actual sensed space with the log data included in the integrated data based on the integrated data at that time point. The electronic device (100) can acquire a control signal based on the comparison data. The electronic device (100) can identify a group corresponding to the acquired control signal and transmit the control signal to the identified group.

[0131] For example, if the temperature of the indoor space is 25 degrees at 12:00 PM, the electronic device (100) can identify operation information of the device based on integrated data at 12:00 PM. If the user sets the temperature to 17 degrees using an air conditioner or a fan at 12:00 PM, a control signal to set the indoor temperature to 17 degrees can be obtained.

[0132] The electronic device (100) can identify the location of a user and identify a group with a blower function placed at the user's location. The electronic device (100) can transmit a control signal to the identified group.

[0133] FIG. 10 is a drawing for explaining the process of providing guide information of an electronic device according to one or more embodiments.

[0134] According to one embodiment, the electronic device (100) may output guide information corresponding to a control signal identified based on group information and integrated data through a speaker (160). The guide information may be information intended to provide information corresponding to the control signal to a user via text or voice. For example, the guide information may be information such as "The laundry is finished. Shall we operate the dryer?" or "The indoor temperature is high. Shall we operate the air conditioner?"

[0135] According to one embodiment, when the electronic device (100) receives a response command for guide information, it can transmit a control signal to at least one device through the communication circuit (110).

[0136] Referring to FIG. 10, the electronic device (100) can identify information about the indoor space through a sensor (140) and provide guide information (1010) corresponding to the identified information to the user through a speaker (160). For example, if the indoor temperature based on the sensing data sensed at 13:00 is higher than the indoor temperature based on the integrated data at 13:00, the electronic device (100) can output guide information (1010) such as "The indoor temperature is high. Shall we operate the air conditioner / fan?" through the speaker (160).

[0137] Subsequently, when a response command (1020) for guide information is received from the user, the electronic device (100) may transmit a control signal to at least one device to reduce the indoor temperature. The electronic device (100) may also transmit the control signal to a group including a blower function.

[0138] FIGS. 11 and FIGS. 12 are drawings for explaining the process of providing information through a projection part of an electronic device according to one or more embodiments.

[0139] According to one embodiment, when a user is identified, the electronic device (100) can move to the user's location and project integrated data-based group information through the projection unit (170). When a device included in a group is changed and the group information is updated, the electronic device (100) can project the updated group information through the projection unit (170).

[0140] According to one embodiment, the electronic device (100) can project guide information corresponding to a control signal identified based on group information and integrated data through a projection unit (170).

[0141] According to one embodiment, when the electronic device (100) receives a response command for guide information, it can transmit a control signal to at least one device through the communication circuit (110).

[0142] Referring to FIG. 11, when a user is identified, the electronic device (100) can move to the user's location and project integrated data-based group information through the projection unit (170). The electronic device (100) can project guide information corresponding to the identified control signal based on the group information and integrated data through the projection unit (170).

[0143] According to one embodiment, if the electronic device (100) cannot move to the user's location, it can provide integrated data-based group information through an external device communicating with the electronic device (100).

[0144] Referring to FIG. 12, when an electronic device (100) is located on the first floor and a user is located on the second floor, the electronic device (100) can provide integrated data-based group information (1220) to the user through the TV (1210) that the user is watching. The electronic device (100) can transmit group information to the TV (1210) that the user is watching, and can transmit a control signal to the TV (1210) to display group information through a display included in the TV (1210).

[0145] According to one embodiment, the electronic device (100) can transmit a control signal to an external display device to output a guide information UI (User Interface) corresponding to a control signal identified based on group information and integrated data through the external display device. The electronic device (100) can transmit a UI (User Interface) corresponding to the guide information to the external display device. The electronic device (100) can transmit a control signal to an external display device to output a guide information UI through the display of the external display device.

[0146] FIG. 13 is a diagram illustrating a device control process using an IR signal according to one or more embodiments.

[0147] According to one embodiment, if the first device included in the same group is a device that cannot communicate, the electronic device (100) can move to the location of the first device and transmit an IR signal corresponding to a control signal to the first device through an IR sensor.

[0148] Multiple devices may include devices capable of communicating with the electronic device (100) and devices that cannot communicate. A device that cannot communicate with the electronic device (100) may be a legacy device. A legacy device may be a device manufactured using older technology and older systems, and may be a device manufactured with an operating system and software different from the operating system and software of the latest device.

[0149] Legacy devices may be devices that cannot connect to or be compatible with an IoT server or multiple IoT devices in an IoT environment containing multiple IoT devices. Legacy devices may be devices that use communication protocols of a previous generation rather than the communication protocols currently used by the IoT server, or devices that do not support standardized IoT protocols.

[0150] Multiple IoT devices can communicate with each other to transmit and receive data. On the other hand, legacy devices may not be able to transmit or receive data with multiple devices due to the problem of not being able to connect to an IoT server or multiple IoT devices. Legacy devices can sense IR signals by including an IR receiver. In this case, the electronic device (100) can identify the location of the legacy device, move to the area where the legacy device is located, and transmit an IR signal to the legacy device through the IR sensor.

[0151] In this case, the electronic device (100) cannot receive log data from the first device, nor can it transmit a control signal based on integrated data to the first device. The electronic device (100) moves through space to identify the first device and can transmit an IR signal corresponding to the control signal to the first device through an IR sensor among the sensors attached to the electronic device (100).

[0152] Referring to FIG. 13, the electronic device (100) can move through space and identify the first device (1310). If the electronic device (100) has acquired group information, and one group includes the first device (1310) and an air conditioner, the electronic device (100) can control the first device (1310) through an IR signal (1320). On the other hand, the electronic device (100) can transmit a control signal to the air conditioner through a communication circuit (110).

[0153] According to one embodiment, the electronic device (100) can obtain a control signal of a device included in a group based on energy usage. The electronic device (100) can obtain a control signal of a device included in a group for optimal energy consumption based on season, time, and power price.

[0154] For example, if the power price for a device used in the evening is higher than during the day, the electronic device (100) can obtain a control signal to reduce power consumption during the evening compared to the day. For example, if the indoor temperature is set by operating only the air conditioner during the day, the electronic device (100) can set the indoor temperature by operating both the air conditioner and the fan during the evening.

[0155] According to one embodiment, the electronic device (100) can control the operating time of the device differently depending on at least one of the time of day and the presence or absence of a user in the indoor space. For example, if no user is identified in the indoor space, the electronic device (100) can control the operating time of the washing machine to be increased compared to when no user is identified in the indoor space. The washing machine can reduce power consumption when washing for 2 hours compared to washing for 1 hour. Accordingly, if no user is identified in the indoor space, the electronic device (100) can transmit a control signal to the washing machine to increase the operating time of the washing machine.

[0156] According to one embodiment, an electronic device (100) can obtain control signals for a plurality of devices included in a group of devices through an artificial intelligence model learned based on energy consumption. The artificial intelligence model may be learned to obtain control signals for devices based on at least one of time of day, season, and energy consumption. For example, if the energy consumption of a specific day is greater than the daily average energy consumption, the electronic device (100) can obtain control signals for devices to reduce energy consumption on that day.

[0157] According to one embodiment, the electronic device (100) can control the projection unit (170) based on a user voice signal received through the microphone (150). For example, when a user voice signal for projecting an A UI is received, the electronic device (100) can control the projection unit (170) to display the A UI.

[0158] According to one embodiment, the electronic device (100) can control an external display device connected to the electronic device (100) based on a user voice signal received through a microphone (150). Specifically, the electronic device (100) can generate a control signal to control the external display device so that an operation corresponding to the user voice signal is performed on the external display device, and can transmit the generated control signal to the external display device. Here, the electronic device (100) can store a remote control application for controlling the external display device. And, the electronic device (100) can transmit the generated control signal to the external display device using at least one communication method among Bluetooth, Wi-Fi, or infrared. For example, when a user voice signal for displaying content A is received, the electronic device (100) can transmit a control signal to the external display device to control the display of content A on the external display device. Here, the electronic device (100) may refer to various terminal devices capable of installing a remote control application, such as a smartphone or an AI speaker.

[0159] According to one embodiment, the electronic device (100) may use a remote control device to control an external display device connected to the electronic device (100) based on a user voice signal received through a microphone (150). Specifically, the electronic device (100) may transmit a control signal to the remote control device to control the external display device so that an operation corresponding to the user voice signal is performed on the external display device. The remote control device may transmit the control signal received from the electronic device (100) to the external display device. For example, when a user voice signal for displaying content A is received, the electronic device (100) transmits a control signal to the remote control device to control the display of content A on the external display device, and the remote control device transmits the received control signal to the external display device.

[0160] According to one embodiment, the communication circuit (110) may use the same communication module (e.g., Wi-Fi module) to communicate with an external device, such as a remote control device, and an external server.

[0161] According to one embodiment, the communication circuit (110) may use different communication modules to communicate with external devices, such as a remote control device and an external server. For example, the communication circuit (110) may use at least one of an Ethernet module or a Wi-Fi module to communicate with an external server, and may use a Bluetooth module to communicate with an external device, such as a remote control device. However, this is merely one embodiment, and the communication circuit (110) may use at least one of various communication modules when communicating with multiple external devices or external servers.

[0162] According to one embodiment, the electronic device (100) can receive a user voice signal through a microphone (150) included in the electronic device (100).

[0163] According to one embodiment, the electronic device (100) may receive a user voice signal from an external device including a microphone. Here, the external device may refer to a remote control device or a smartphone, etc. Here, the received user voice signal may be a digital voice signal, but may be an analog voice signal depending on the implementation example. The electronic device (100) may receive the user voice signal through a wireless communication method such as Bluetooth or Wi-Fi.

[0164] According to one embodiment, the electronic device (100) can obtain text information corresponding to a user voice signal from an external server. Specifically, the electronic device (100) can transmit a user voice signal (audio signal or digital signal) to an external server. Here, the external server may refer to a speech recognition server. Here, the speech recognition server can convert the user voice signal into text information using STT (Speech To Text). Then, the external server can transmit the text information corresponding to the converted user voice signal to the electronic device (100).

[0165] According to one embodiment, the electronic device (100) can independently acquire text information corresponding to a user voice signal. Specifically, the electronic device (100) may directly apply a Speech To Text (STT) function to a digital voice signal to convert it into text information and transmit the converted text information to an external server.

[0166] According to one embodiment, an external server may transmit text information corresponding to a user voice signal to an electronic device (100). Specifically, the external server may be a server that performs a voice recognition function of converting a user voice signal into text information.

[0167] According to one embodiment, an external server may transmit at least one of text information corresponding to a user voice signal or search result information corresponding to text information to an electronic device (100). Specifically, the external server may be a server that performs a search result providing function that provides search result information corresponding to text information in addition to a voice recognition function that converts a user voice signal into text information.

[0168] For example, the external server may be a server that performs both voice recognition and search result provision functions. As another example, the external server may perform only voice recognition functions, while the search result provision function may be performed on a separate server. To obtain search results, the external server may transmit text information to a separate server and obtain search results corresponding to the text information from the separate server.

[0169] According to one embodiment, a communication module for communication with an external device and an external server can be implemented in the same way. For example, the electronic device (100) communicates with the external device using a Bluetooth module, and the external server can also communicate using a Bluetooth module.

[0170] According to one embodiment, a communication module for communication with an external device and an external server may be implemented separately. For example, the electronic device (100) may communicate with an external device using a Bluetooth module and with an external server using an Ethernet modem or a Wi-Fi module.

[0171] According to one embodiment, the operation of identifying integrated data and obtaining group information can be performed by an external server of the electronic device (100). Specifically, the external server receives device operation log data and user location log data from the electronic device (100), and can identify integrated data including operation information of multiple devices by user location based on the received data. The external server can input the integrated data into an artificial intelligence model to obtain group information including at least one device among multiple devices. The external server can transmit the integrated data and group information to the electronic device (100).

[0172] FIG. 14 is a drawing for explaining the operation process of an electronic device according to one or more embodiments.

[0173] Referring to FIG. 14, in operation 1410, the electronic device (100) can identify integrated data including operation information of multiple devices by user's location based on multiple operation log data received from multiple devices and location log data by space.

[0174] In operation 1420, the electronic device (100) can input integrated data into an artificial intelligence model to obtain group information including at least one device among a plurality of devices.

[0175] In operation 1430, the electronic device (100) can identify a control signal for the device based on group information and integrated data.

[0176] In operation 1440, the electronic device (100) can transmit an identified control signal based on group information and integrated data to at least one device included in the same group.

[0177] Since specific methods for identifying integrated data and inputting it into an artificial intelligence model to obtain group information have been explained through the aforementioned embodiments, a detailed explanation thereof will be omitted.

[0178] The control method described in FIG. 14 can be performed by an electronic device (100) having the configuration of FIG. 2 described above, but is not necessarily limited thereto and can be performed by an electronic device having various configurations.

[0179] The various embodiments described above may be implemented as individual embodiments, or at least one embodiment may be combined with one another, either wholly or partially, to be implemented together in a single device.

[0180] According to the various embodiments described above, the electronic device (100) can control multiple devices in an integrated manner based on integrated data that takes into account the user's location, and can control multiple devices by group through group information.

[0181] Meanwhile, the various embodiments described above may be applied to a product as embodiments alone, but at least some of their contents may be combined with other embodiments of the present disclosure to be implemented together.

[0182] The various embodiments described above may be implemented as software containing instructions stored on a machine-readable storage medium (e.g., computer). The machine may include an electronic device (e.g., electronic device (100)) according to the disclosed embodiments, which is a device capable of calling instructions stored from the storage medium and operating according to the called instructions. When instructions are executed by a processor, the processor may perform a function corresponding to the instructions directly or by using other components under the control of the processor. Instructions may include code generated or executed by a compiler or an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory computer-readable storage medium. Here, "non-transitory" means only that the storage medium does not contain a signal and is tangible, and does not distinguish whether data is stored semi-permanently or temporarily in the storage medium.

[0183] In addition, according to one embodiment of the present disclosure, the method according to the various embodiments described above may be provided by being included in a computer program product.

[0184] Specifically, the method can identify integrated data including operation information of multiple devices by user's location based on multiple operation log data received from multiple devices and location log data by space, input the integrated data into an artificial intelligence model to obtain group information including at least one device among multiple devices, and transmit a control signal identified based on the group information and integrated data to at least one device included in the same group.

[0185] Computer program products may be distributed in the form of device-readable storage media (e.g., compact disc read-only memory (CD-ROM)) or online through an application store (e.g., Play Store™). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0186] In addition, computer instructions or programs for performing control methods of electronic devices according to the various embodiments described above may be stored on a non-transitory computer-readable medium. When computer instructions stored on such a non-transitory computer-readable medium are executed by a processor of a specific device, they cause the specific device to perform processing operations according to the various embodiments described above. A non-transitory computer-readable medium refers to a medium that stores data semi-permanently and is readable by a device, rather than a medium that stores data for a short period of time, such as a register, cache, or memory. Specific examples of a non-transitory computer-readable medium may include CDs, DVDs, hard disks, Blu-ray discs, USBs, memory cards, ROMs, etc.

[0187] Although preferred embodiments of the present disclosure have been illustrated and described above, the present disclosure is not limited to the specific embodiments described above. It is understood that various modifications can be made by those skilled in the art without departing from the essence of the present disclosure as claimed in the claims, and such modifications should not be understood individually from the technical spirit or perspective of the present disclosure.

Claims

1. In an electronic device, Communication circuit; Memory configured to store instructions; and One or more processors including processing circuitry; and The above one or more processors, By executing the stored instructions individually or collectively, Acquiring integrated data including operation information of multiple devices, location information of the multiple devices, and location information of a user, and Based on the above integrated data, group information including at least one of the plurality of devices is obtained through an artificial intelligence model, and An electronic device that transmits a control signal identified based on the integrated data and group information to at least one device included in the same group through the communication circuit.

2. In Paragraph 1, The above electronic device is, It further includes a sensor; When the above instructions are executed individually or collectively by the one or more processors, the electronic device, When the user is identified based on the data acquired by the sensor, group information corresponding to the identified user is obtained through the artificial intelligence model based on the information corresponding to the identified user and the integrated data, and An electronic device that transmits an identified control signal to at least one device included in the same group through the communication circuit, based on group information corresponding to the identified user and the integrated data.

3. In Paragraph 1, When the above instructions are executed individually or collectively by the one or more processors, the electronic device, An electronic device that receives operation data for each of the plurality of devices, which forms the basis of the integrated data, from each of the plurality of devices through the communication circuit.

4. In Paragraph 1, The above electronic device is, It further includes a sensor; When the above instructions are executed individually or collectively by the one or more processors, the electronic device, An electronic device that moves to the location of each of the plurality of devices and obtains operation data for each of the plurality of devices based on data obtained through the sensor.

5. In Paragraph 1, When the above instructions are executed individually or collectively by the one or more processors, the electronic device, When a signal corresponding to a communication connection is received from a device through the above communication circuit, the integrated data is transmitted to the device through the above communication circuit, and An electronic device that operates in conjunction with the device that receives the integrated data.

6. In Paragraph 1, The above electronic device is, It further includes a sensor; When the above instructions are executed individually or collectively by the one or more processors, the electronic device, Based on the data obtained by the above sensor, information corresponding to the space where the electronic device is located is obtained, and An electronic device that obtains the control signal based on information corresponding to the space, the group information, and the integrated data.

7. In Paragraph 1, The above electronic device is, Includes additional speakers, When the above instructions are executed individually or collectively by the one or more processors, the electronic device, Information corresponding to a signal based on the above group information and the above integrated data is output through the above speaker, and An electronic device that transmits the control signal to at least one home appliance through the communication circuit when user input for information corresponding to the above control signal is received.

8. In Paragraph 1, The above electronic device is, It further includes a projection section; and When the above instructions are executed individually or collectively by the one or more processors, the electronic device, Information corresponding to the control signal identified based on the group information and the integrated data is projected through the projection unit, and An electronic device that transmits the control signal to at least one home appliance through the communication circuit when user input for information corresponding to the above control signal is received.

9. In Paragraph 1, The above electronic device is, It further includes an IR sensor, When the above instructions are executed individually or collectively by the one or more processors, the electronic device, An electronic device that, if communication connection with a first device included in the same group is not possible, moves to the location of the first device and outputs an IR signal corresponding to the control signal through the IR sensor.

10. In Paragraph 1, When the above instructions are executed individually or collectively by the one or more processors, the electronic device, An electronic device that obtains the integrated data corresponding to the operation information of the plurality of devices by the user location based on the plurality of operation data received from the plurality of devices and the user location data by space.

11. In a method for controlling an electronic device, An operation to acquire integrated data including operation information of multiple devices, location information of the multiple devices, and location information of a user; The operation of obtaining group information including at least one of the plurality of devices through an artificial intelligence model based on the above integrated data; and A control method comprising: transmitting a control signal identified based on the integrated data and the group information to at least one device included in the same group.

12. In Paragraph 11, When the above user is identified, an operation to obtain group information corresponding to the identified user through the artificial intelligence model based on information corresponding to the identified user and the integrated data; and A control method comprising: transmitting an identified control signal to at least one device included in the same group based on group information corresponding to the identified user and the integrated data.

13. In Paragraph 11, A control method comprising: receiving operation data for each of the plurality of devices, which forms the basis of the integrated data, from each of the plurality of devices.

14. In Paragraph 11, A control method comprising: moving to the location of each of the plurality of devices and acquiring operation data for each of the plurality of devices based on data acquired through the electronic device.

15. A non-transient computer-readable storage medium storing computer instructions that cause said electronic device to perform an operation when executed by a processor of said electronic device, wherein said operation is, An operation to acquire integrated data including operation information of multiple devices, location information of the multiple devices, and location information of a user; The operation of inputting the above integrated data into an artificial intelligence model to obtain group information including at least one device among the plurality of devices; and A non-transient computer-readable storage medium comprising: an operation of transmitting a control signal identified based on the integrated data and the group information to at least one device included in the same group.

Images