Electronic device and control method thereof

Abstract

An electronic device is disclosed. One or more processors, when instructions are individually or collectively executed, cause the electronic device to: when a first home appliance among a plurality of home appliances is selected on an execution screen of an IoT application for controlling the plurality of home appliances, display a control screen for the first home appliance on a display; when a first function is selected on the control screen for the first home appliance, identify at least one of a second home appliance related to the first function and a second function related to the first function; and display a pop-up user interface (UI) including at least one of information on the second home appliance and information on the second function on the control screen for the first home appliance.

Description

Electronic device and control method thereof

[0001] The present disclosure relates to an electronic device and a method for controlling the same.

[0002] Recently, technology is being developed to control multiple IoT devices within a home simultaneously or sequentially using IoT (Internet of Things) applications.

[0003] Generally, users can select a home appliance they wish to control within an IoT application and choose one of its functions. However, to control other home appliances or functions associated with the selected appliance, users may face the inconvenience of having to return to the device list and search for the desired device or function.

[0004] In addition, users unfamiliar with IoT applications may have difficulty finding and controlling appliances or functions associated with the selected appliance.

[0005] The information described above may be provided as related art for the purpose of aiding understanding of the present disclosure. No claim or determination is made as to whether any of the foregoing may be applied as prior art related to the present disclosure.

[0006] The aspects of the present disclosure are to address at least the problems and / or disadvantages mentioned above and to provide at least the advantages described below. Accordingly, the aspects of the present disclosure provide an electronic device and a method for controlling the same that provide information related to the function of the electronic device.

[0007] Additional aspects will be presented in part in the following description, and in part may become apparent from the description or be learned by practicing the presented embodiments.

[0008] An electronic device according to one or more embodiments of the present disclosure comprises one or more processors including a display, a memory for storing instructions, and processing circuitry.

[0009] According to one or more embodiments, when the instructions are executed individually or collectively, the electronic device displays a control screen of the first home appliance through the display when a first home appliance among the plurality of home appliances is selected on an execution screen of an IoT application for controlling a plurality of home appliances, and when a first function is selected on the control screen of the first home appliance, identifies at least one of a second home appliance related to the first function and a second function related to the first function, and displays a Pop-Up User Interface (Pop-Up UI) including at least one of information about the second home appliance and information about the second function on the control screen of the first home appliance.

[0010] According to one or more embodiments, when the instructions are executed individually or collectively by the one or more processors, the electronic device obtains an association graph corresponding to the first function from a server corresponding to the IoT application when the first function is selected on the control screen of the first home appliance, and identifies at least one of information regarding the second home appliance and information regarding the second function based on the association graph, wherein the association graph is a graph in which the first function, the plurality of home appliances, and the plurality of functions are mapped based on the association score of each of the plurality of home appliances and the plurality of functions for the first function.

[0011] According to one or more embodiments, when the instructions are executed individually or collectively by the one or more processors, the electronic device displays a popup UI that includes at least one function different from the first function among the functions that can be performed on the first home appliance based on user input.

[0012] According to one or more embodiments, the plurality of functions are functions that can be performed in the plurality of home appliances including the first home appliance.

[0013] According to one or more embodiments, the association graph is,

[0014] If at least one of a new home appliance and a new function is identified based on log data related to the first function above, it is updated based on at least one of the new home appliance and the new function above.

[0015] According to one or more embodiments, the association score included in the association graph is updated based on at least one of the location information of the plurality of home appliances and the amount of log data accumulated from the plurality of home appliances while the first home appliance is operating.

[0016] According to one or more embodiments, when the instructions are executed individually or collectively by the one or more processors, the electronic device inputs information about the first function and information about the plurality of home appliances into an artificial intelligence model to obtain at least one of information about the second home appliance and information about the second function, and the artificial intelligence model is a model trained to identify at least one of the information about the second home appliance and information about the second function based on the association score of each of the plurality of home appliances and the plurality of functions with respect to the first function.

[0017] According to one or more embodiments, when the instructions are executed individually or collectively by the one or more processors, the electronic device obtains an association graph corresponding to the first home appliance from a server corresponding to the IoT application, identifies at least one of a third home appliance related to the first home appliance and a function related to the first home appliance based on the association graph, and displays a popup UI including at least one of information about the third home appliance and information about the function related to the first home appliance on the control screen of the first home appliance, wherein the third home appliance is a device identified regardless of whether the first function is selected.

[0018] A method for controlling an electronic device according to one or more embodiments of the present disclosure comprises: a step of displaying a control screen of a first home appliance when a first home appliance among a plurality of home appliances is selected on an execution screen of an IoT application for controlling a plurality of home appliances; a step of identifying at least one of a second home appliance related to the first function and a second function related to the first function when a first function is selected on the control screen of the first home appliance; and a step of displaying a Pop-Up User Interface (Pop-Up UI) on the control screen of the first home appliance, the Pop-Up UI including at least one of information about the second home appliance and information about the second function.

[0019] A system comprising an electronic device and a server according to one or more embodiments of the present disclosure includes, when a first home appliance among a plurality of home appliances is selected on an execution screen of an IoT application for controlling a plurality of home appliances, an electronic device that requests information related to the first function when a first function is selected on the control screen of the first home appliance, and a server that, when a request for information related to the first function is received, identifies at least one of a second home appliance related to the first function and a second function related to the first function, and transmits information identified by the electronic device; wherein the electronic device displays a Pop-Up User Interface (Pop-Up UI) on the control screen of the first home appliance, which includes at least one of information regarding the second home appliance and information regarding the second function, based on information received from the server.

[0020] The above and other aspect features and advantages of specific embodiments of the present disclosure will become more apparent from the following description, which is referenced together with the accompanying drawings.

[0021] FIG. 1 is a drawing for explaining the operation of an electronic device according to one or more embodiments.

[0022] FIG. 2 is a block diagram illustrating the configuration of an electronic device according to one or more embodiments.

[0023] FIG. 3 is a drawing for explaining an association graph corresponding to a first function of an electronic device according to one or more embodiments.

[0024] FIG. 4 is a diagram illustrating an association graph corresponding to a recommendation function of an electronic device according to one or more embodiments.

[0025] FIG. 5 is a diagram for explaining an association graph corresponding to one function of a second appliance of an electronic device according to one or more embodiments.

[0026] FIGS. 6 and FIGS. 7 are drawings for illustrating a popup UI of an electronic device according to one or more embodiments.

[0027] FIG. 8 is a diagram illustrating the process of obtaining recommendation information through an artificial intelligence model of an electronic device according to one or more embodiments.

[0028] FIG. 9 is a drawing for explaining the overall operation method of an electronic device according to one or more embodiments.

[0029] FIG. 10 is a sequence diagram for explaining the operation method of an electronic device and a server according to one or more embodiments.

[0030] FIG. 11 is a drawing for explaining a method of operation of an electronic device according to one or more embodiments.

[0031] It should be noted that the same reference numbers are used throughout the drawings to denote identical or similar elements, features, and structures.

[0032] The terms used in the various embodiments of this Disclosure have been selected to be as widely used and general as possible, taking into account their functions within this disclosure; however, these terms may vary depending on the intent of those skilled in the art, case law, the emergence of new technologies, etc. Additionally, in specific cases, terms have been selected at the applicant's discretion, and in such cases, their meanings will be described in detail in the relevant description section of this disclosure. Therefore, terms used in this disclosure should be defined not merely by their names, but based on their meanings and the overall content of this disclosure.

[0033] In the present disclosure, expressions such as “have,” “may have,” “include,” or “may include” indicate the presence of such features (e.g., numerical values, functions, actions, or components such as parts) and do not exclude the presence of additional features.

[0034] The expression "at least one of A or / and B" should be understood as representing either "A" or "B" or "A and B".

[0035] Expressions such as "first," "second," "first," or "second" used in this disclosure may modify various components regardless of order and / or importance, and are used only to distinguish one component from another and do not limit said components.

[0036] Where it is stated that a component (e.g., Component 1) is "(operatively or communicatively) coupled with / to" or "connected to" another component (e.g., Component 2), it should be understood that the component may be directly connected to the other component or connected through the other component (e.g., Component 3).

[0037] The singular expression includes the plural expression unless the context clearly indicates otherwise. In this disclosure, terms such as “comprising” or “consisting of” are intended to specify the existence of the features, numbers, steps, actions, components, parts, or combinations thereof described in the specification, and should be understood as not precluding the existence or addition of one or more other features, numbers, steps, actions, components, parts, or combinations thereof.

[0038] In the present disclosure, a "module" or "part" performs at least one function or operation and may be implemented in hardware or software, or a combination of hardware and software. Additionally, a plurality of "modules" or a plurality of "parts" may be integrated into at least one module and implemented by at least one processor (not shown), except for a "module" or "part" that needs to be implemented in specific hardware.

[0039] In the present disclosure, the term "user" may refer to a person using an electronic device or a device used by such person.

[0040] An embodiment of the present disclosure will be described in more detail below with reference to the attached drawings.

[0041] FIG. 1 is a drawing for explaining the operation of an electronic device according to one or more embodiments.

[0042] According to one embodiment, the electronic device (100) may provide a user interface (UI) to recommend home appliances and / or functions related to the functions of home appliances. Here, the electronic device (100) may be implemented as various types of electronic devices such as a user terminal device, a smart TV, a monitor, a kiosk, a tablet PC, an electronic photo frame, a large format display (LFD), a digital information display (DID), a video wall, a projector display, etc. However, in some cases, it may be implemented as a video processing device (e.g., a set-top box, one connected box) that is connected to the electronic device and provides video.

[0043] According to one embodiment, the electronic device (100) may display a Pop-Up User Interface (Pop Up UI) on the execution screen of an Internet of Things (IoT) application for controlling a first home appliance, the Pop-Up User Interface including at least one of information about a plurality of devices and information about a function related to a first function of the first home appliance.

[0044] The first function may be any one of the multiple functions of the first home appliance. For example, in the case of a robot vacuum cleaner, the first function may be the cleaning function of the robot vacuum cleaner.

[0045] The popup UI may be a UI corresponding to a small screen of a preset size or an icon for displaying information corresponding to a specific task on a control screen for controlling a first home appliance.

[0046] The popup UI may include an icon, an execution button, an input box, and a cancel button corresponding to the appliance and / or function related to the first function of the first appliance, and may, of course, include various execution icons or buttons. The popup UI is not limited thereto and may be referred to in various ways as an overlay UI, a floating window, a notification window, a recommendation UI, or a banner, but in this disclosure, it will be collectively referred to as a popup UI.

[0047] According to one embodiment, when a user input for performing a first function of a first home appliance is received, the electronic device (100) can identify a plurality of home appliances and a plurality of functions related to the first function.

[0048] For example, an electronic device (100) can obtain an association graph corresponding to a first function from a server and identify a plurality of home appliances and a plurality of functions related to the first function from the obtained association graph.

[0049] For example, the electronic device (100) can identify a plurality of home appliances and a plurality of functions related to a first function of a first home appliance based on log data for a plurality of home appliances. For example, the electronic device (100) can identify a plurality of home appliances and a plurality of functions related to a cleaning function based on log data for each of a plurality of home appliances while a robot vacuum cleaner performs a cleaning function.

[0050] According to one embodiment, the electronic device (100) may display a popup UI on the control screen of the first home appliance, the popup UI including at least one of information about a plurality of identified home appliances and information about a plurality of functions.

[0051] Referring to FIG. 1, when a robot vacuum cleaner is selected among a plurality of home appliances on the execution screen of an IoT application, the electronic device (100) can display a control screen (30) of the robot vacuum cleaner through a display. When the electronic device (100) receives a user input (10) corresponding to a cleaning function among the functions of the robot vacuum cleaner, it can identify at least one of a second home appliance and function related to the cleaning function.

[0052] For example, the electronic device (100) can obtain an association graph corresponding to the cleaning function of a robot vacuum cleaner through a server, and can identify an air purifier and a fan related to the cleaning function among a plurality of home appliances from the association graph. The electronic device (100) can identify the air purifier power off and the fan power off related to the cleaning function among a plurality of functions from the association graph.

[0053] The electronic device (100) can display a popup UI (20) on the control screen of the robot vacuum cleaner that includes at least one of information about a plurality of identified home appliances and information about their functions. For example, the electronic device (100) can display a popup UI (20) on the control screen of the robot vacuum cleaner that includes an air purifier, an air purifier power off, and a fan power off.

[0054] Hereinafter, with reference to the drawings, a method for an electronic device (100) to identify a second appliance related to a first function and a second function related to a first function and to provide a popup UI will be described.

[0055] FIG. 2 is a block diagram illustrating the configuration of an electronic device according to one or more embodiments.

[0056] According to FIG. 2, the electronic device (100) includes a display (110), a memory (120), and one or more processors (130). However, it is not limited thereto, and the electronic device (100) may be implemented with some components excluded or with other components included.

[0057] The display (110) is configured to display a pop-up UI on the control screen of the first home appliance. The display (110) may be implemented as a display including a self-emissive element or as a display including a non-emissive element and a backlight. For example, it may be implemented as various types of displays such as an LCD (Liquid Crystal Display), an OLED (Organic Light Emitting Diodes) display, an LED (Light Emitting Diodes), a micro LED, a Mini LED, a PDP (Plasma Display Panel), a QD (Quantum dot) display, or a QLED (Quantum dot light-emitting diodes). The display (110) may also include a driving circuit, a backlight unit, etc., which can be implemented in forms such as an a-si TFT, an LTPS (low temperature poly silicon) TFT, or an OTFT (organic TFT).

[0058] The memory (120) can store at least one instruction, data, program, etc. required for the operation of the electronic device (100). For example, the memory (120) can store contour highlighting processing information and location information corresponding to a selected image.

[0059] The memory (120) may be implemented in the form of a memory embedded in the electronic device (100) or in the form of a memory detachable from the electronic device (100), depending on the purpose of data storage. For example, data for operating the electronic device (100) may be stored in a memory embedded in the electronic device (100), and data for the expansion function of the electronic device (100) may be stored in a memory detachable from the electronic device (100).

[0060] In the case of memory embedded in the electronic device (100), it may be implemented as at least one of volatile memory (e.g., DRAM (dynamic RAM), SRAM (static RAM), or SDRAM (synchronous dynamic RAM), non-volatile memory (e.g., OTPROM (one time programmable ROM), PROM (programmable ROM), EPROM (erasable and programmable ROM), EEPROM (electrically erasable and programmable ROM), mask ROM, flash ROM, flash memory (e.g., NAND flash or NOR flash), hard drive, or solid state drive (SSD).

[0061] The memory (120) may be implemented as a single memory that stores data generated in various operations according to the present disclosure, but is not limited thereto, and the memory (120) may be implemented to include a plurality of memories that each store different types of data or each store data generated in different stages.

[0062] One or more processors (130) control the overall operation of the electronic device (100). Specifically, one or more processors (130) may be connected to each component of the electronic device (100) to control the overall operation of the electronic device (100). For example, one or more processors (130) may be electrically connected to the display (110) and memory (120) to control the overall operation of the electronic device (100). One or more processors (130) may include processing circuits and may be composed of one or more processors.

[0063] One or more processors (130) can perform the operation of an electronic device (100) according to various embodiments by executing one or more instructions stored in memory (120).

[0064] One or more processors (130) may include one or more of a CPU (Central Processing Unit), GPU (Graphics Processing Unit), APU (Accelerated Processing Unit), MIC (Many Integrated Core), DSP (Digital Signal Processor), NPU (Neural Processing Unit), hardware accelerator, or machine learning accelerator. One or more processors (130) may control one or any combination of other components of an electronic device and may perform operations or data processing related to communication. One or more processors (130) may execute one or more programs or instructions stored in memory. For example, one or more processors may perform a method according to one or more embodiments of the present disclosure by executing one or more instructions stored in memory.

[0065] When a method according to one or more embodiments of the present disclosure includes a plurality of operations, the plurality of operations may be performed by a single processor or by a plurality of processors. For example, when a first operation, a second operation, and a third operation are performed by a method according to one or more embodiments, the first operation, the second operation, and the third operation may all be performed by a first processor, or the first operation and the second operation may be performed by a first processor (e.g., a general-purpose processor) and the third operation may be performed by a second processor (e.g., an artificial intelligence dedicated processor).

[0066] One or more processors (130) may be implemented as a single-core processor including one core, or as one or more multicore processors including multiple cores (e.g., homogeneous multicore or heterogeneous multicore). When one or more processors (130) are implemented as multicore processors, each of the multiple cores included in the multicore processor may include internal processor memory such as cache memory or on-chip memory, and a common cache shared by multiple cores may be included in the multicore processor. Additionally, each of the multiple cores included in the multicore processor (or some of the multiple cores) may independently read and execute program instructions for implementing a method according to one or more embodiments of the present disclosure, or all (or some) of the multiple cores may be linked together to read and execute program instructions for implementing a method according to one or more embodiments of the present disclosure.

[0067] When a method according to one or more embodiments of the present disclosure includes a plurality of operations, the plurality of operations may be performed by one of the plurality of cores included in a multi-core processor, or may be performed by a plurality of cores. For example, when a first operation, a second operation, and a third operation are performed by a method according to one or more embodiments, the first operation, the second operation, and the third operation may all be performed by a first core included in a multi-core processor, or the first operation and the second operation may be performed by a first core included in a multi-core processor and the third operation may be performed by a second core included in a multi-core processor.

[0068] In the embodiments of the present disclosure, a processor may refer to a system-on-chip (SoC) in which one or more processors and other electronic components are integrated, a single-core processor, a multi-core processor, or a core included in a single-core processor or a multi-core processor, wherein the core may be implemented as a CPU, GPU, APU, MIC, DSP, NPU, hardware accelerator, or machine learning accelerator, but the embodiments of the present disclosure are not limited thereto. For convenience of explanation, one or more processors (130) will be referred to as processors (130) below.

[0069] According to one embodiment, when a first home appliance among a plurality of home appliances is selected on an execution screen of an IoT application for controlling a plurality of home appliances, the processor (130) can display a control screen of the first home appliance through a display (110).

[0070] According to one embodiment, when a first function is selected on the control screen of a first home appliance, the processor (130) can identify at least one of a second home appliance related to the first function and a second function related to the first function.

[0071] The second home appliance may be a home appliance related to the first function of the first home appliance among the plurality of home appliances. For example, if the power to the fan is turned off while the robot vacuum cleaner is performing a cleaning function, the fan may be a second home appliance related to the cleaning function of the robot vacuum cleaner.

[0072] The second function may be a function related to the first function among multiple functions of the home appliance. For example, if the dust concentration sensing function of the Air Monitor is activated while a robot vacuum cleaner is performing a cleaning function, the dust concentration sensing function may be a second function related to the first function.

[0073] The second function may be a function that can be performed on a plurality of home appliances including the first home appliance. For example, the second function may be a function that can be performed on the first home appliance, or a function that can be performed on other home appliances excluding the first home appliance.

[0074] According to one embodiment, the processor (130) may display a popup UI including at least one of information about the second home appliance and information about the second function on the control screen of the first home appliance.

[0075] FIG. 3 is a drawing for explaining an association graph corresponding to a first function of an electronic device according to one or more embodiments.

[0076] According to one embodiment, when a first function is selected on the control screen of a first home appliance, the electronic device (100) can obtain an association graph corresponding to the first function from a server corresponding to an IoT application.

[0077] The association graph may be a graph in which a first function, a plurality of home appliances, and a plurality of functions are mapped based on the association scores of each of the plurality of home appliances and the plurality of functions for the first function. The association graph may be a graph in which a plurality of home appliances and a plurality of functions are mapped for each of the plurality of functions of the home appliances.

[0078] For example, the association graph may be a graph in which multiple home appliances and multiple functions related to the cleaning function of a robot vacuum cleaner are mapped. For example, the association graph may be a graph in which multiple home appliances and multiple functions related to the power-off function of a TV are mapped.

[0079] Association graphs are not limited thereto and may be referred to as inter-device mapping graphs, correlation graphs, connection graphs, or relationship graphs, but in this disclosure, they will be collectively referred to as association graphs.

[0080] For example, the association graph may be a graph mapped based on a pre-set association score. The association score may be data that quantifies the degree of association with the first function. The association score may be a value set based on log data corresponding to each of multiple home appliances while the first function is being performed. That is, the more log data corresponding to a specific function of a specific home appliance is present while the first function is being performed, the higher the association score may be set.

[0081] For example, while a robot vacuum cleaner is performing a cleaning function, if the amount of log data corresponding to the fan's power-off function is the largest among the log data for all multiple home appliances, the correlation score between the cleaning function and the fan's power-off function can be set high. Conversely, if there is no log data corresponding to the fan's power-on function or the amount is the smallest, the correlation score between the cleaning function and the fan's power-on function can be set low.

[0082] The association score may be a pre-set score or a score identified from the usage patterns of home appliances for multiple users. The association score is not limited thereto and may be referred to as a dependency score, coupling strength score, interaction score, or similarity score, but in this disclosure, it will be collectively referred to as an association score.

[0083] According to one embodiment, the electronic device (100) can identify at least one of information about a second home appliance and information about a second function based on an association graph corresponding to a first function.

[0084] Referring to FIG. 3, a correlation graph corresponding to the cleaning function (320) of a robot vacuum cleaner (310) is illustrated. The cleaning function (320) can be mapped to an air purifier (330-1), an air monitor (330-2), and a fan (330-3) as the second appliance among the plurality of appliances. The cleaning function (320) can be mapped to an air purifier power off (340-1) and an air purifier fan mode windless (340-2) as the second function among the plurality of functions.

[0085] However, it is not limited to this, and when the electronic device (100) identifies log data corresponding to another home appliance or other function while performing a cleaning function, the association graph corresponding to the cleaning function (320) may be updated.

[0086] When the amount of log data corresponding to the power off (340-1) of the air purifier is large while the cleaning function (320) is being performed, the electronic device (100) can identify the correlation score (351) between the cleaning function (320) and the power off (340-1) of the air purifier as 10 points. Likewise, the electronic device (100) can identify the correlation score (352) between the cleaning function (320) and the air purifier (330-1) as 9 points, and the correlation score (353) between the cleaning function (320) and the fan (330-3) as 9 points.

[0087] On the other hand, while the cleaning function (320) is being performed, if the amount of log data corresponding to the fan mode low wind of the air purifier is small, the electronic device (100) can identify the correlation score (354) between the cleaning function (320) and the fan mode low wind of the air purifier as 1 point.

[0088] According to one embodiment, the electronic device (100) may display a popup UI on the control screen of the first home appliance, which includes at least one of information about the second home appliance and information about the second function, based on a correlation score included in a correlation graph corresponding to the first function.

[0089] For example, the electronic device (100) may display a popup UI on the control screen of the first home appliance containing three pieces of information in order of highest correlation score among information about the second home appliance and information about the second function. For example, the electronic device (100) may display a popup UI on the control screen of the first home appliance containing information corresponding to each of the air purifier power off (340-1), air purifier (330-1), and fan (353) that have a high correlation score with the first function.

[0090] According to one embodiment, the electronic device (100) obtains an association graph corresponding to a first home appliance from a server corresponding to an IoT application, and can identify at least one of a third home appliance related to the first home appliance and a function related to the first home appliance based on the association graph corresponding to the first home appliance.

[0091] According to one example, the electronic device (100) may obtain an association graph from a server and identify a third home appliance mapped to a first home appliance from the association graph. For example, the electronic device (100) may identify an air purifier, a fan, a smart TV, and an air monitor mapped to a robot vacuum cleaner as third home appliances. The electronic device (100) may identify a third home appliance associated with a first home appliance regardless of the first function selection for the first home appliance.

[0092] According to one example, the electronic device (100) can identify functions associated with the first home appliance mapped to the first home appliance from an association graph. For example, the electronic device (100) can identify increasing the volume of a smart TV and opening a window associated with a robot vacuum cleaner as functions associated with the first home appliance.

[0093] According to one embodiment, the electronic device (100) may display a popup UI on the control screen of the first home appliance, which includes at least one of information about the third home appliance and information about functions related to the first home appliance. For example, the electronic device (100) may display a popup UI on the control screen of the robot vacuum cleaner, which includes at least one of information about the smart TV, information about increasing the volume of the smart TV, and information about opening a window.

[0094] FIG. 4 is a diagram illustrating an association graph corresponding to a recommendation function of an electronic device according to one or more embodiments.

[0095] According to one embodiment, when any one of the home appliances or functions included in the pop-up UI is selected, the electronic device (100) can display the control screen of the selected home appliance through the display (110). When a function included in the pop-up UI is selected on the control screen of the selected home appliance, the electronic device (100) can transmit a control signal corresponding to the selected function to the home appliance.

[0096] According to one embodiment, when a second function is selected on the control screen of a selected home appliance, the electronic device (100) can obtain an association graph corresponding to the second function from a server corresponding to an IoT application.

[0097] Referring to FIG. 4, an association graph is illustrated that corresponds to the power off (340-1) function of an air purifier (330-1) associated with the cleaning function (320) of a robot vacuum cleaner (310). The power off (340-1) function can be mapped to a window device (410-1), an air monitor (410-2), and a fan (410-3) among a plurality of home appliances. The power off (340-1) function can be mapped to a window opening function (420-1) and a fan power off function (420-2) among a plurality of functions.

[0098] When the cleaning function (320) of the robot vacuum cleaner (310) and the power off (340-1) function of the air purifier (330-1) are being performed, if there is a large amount of log data corresponding to the window opening function (420-1), the electronic device (100) can identify the association score (431) between the power off (340-1) of the air purifier and the window opening function (420-1) as 10 points. Likewise, the electronic device (100) can identify the association score (432) between the power off (340-1) of the air purifier and the power off (420-2) of the fan as 8 points.

[0099] On the other hand, while the cleaning function (320) of the robot vacuum cleaner (310) and the power off (340-1) function of the air purifier (330-1) are being performed, if the amount of log data corresponding to the air monitor (410-2) is small, the electronic device (100) can identify the correlation score (433) between the power off (340-1) of the air purifier and the air monitor (410-2) as 4 points.

[0100] According to one example, the electronic device (100) may obtain an association graph corresponding to a first function of a first home appliance from a server to identify a second home appliance and a second function related to the first function. The electronic device (100) may obtain an association graph corresponding to a second function while the first function is operating from a server to identify a second home appliance and a function related to the second function.

[0101] According to one embodiment, the electronic device (100) may display a popup UI on the control screen of the second home appliance, which includes at least one of information about the home appliance and information about the function, based on a correlation score included in a correlation graph corresponding to the second function.

[0102] FIG. 5 is a diagram for explaining an association graph corresponding to one function of a second appliance of an electronic device according to one or more embodiments.

[0103] According to one embodiment, the electronic device (100) can obtain an association graph corresponding to a function of a second home appliance, rather than a second home appliance selected from a pop-up UI, from a server corresponding to an IoT application.

[0104] That is, in a situation where only the second home appliance is operating, rather than a situation where the first function of the first home appliance is operating, the electronic device (100) can obtain an association graph corresponding to the function of the second home appliance through a server.

[0105] In this case, there may be a difference between the association graph corresponding to the second function of the second home appliance selected from the popup UI and the association graph corresponding to the second function of the second home appliance when the first home appliance is not in operation. Specifically, the association scores corresponding to each of the multiple home appliances or multiple functions related to the second function of the second home appliance may differ.

[0106] Referring to FIG. 5, an association graph corresponding to the power off (340-1) function of the air purifier (330-1) is illustrated. This assumes a case where only the air purifier (330-1) is operating, rather than a case where the robot vacuum cleaner is operating. Referring to FIG. 4, when the cleaning function of the robot vacuum cleaner is being performed, the electronic device (100) can identify the association score (433) between the power off (340-1) function of the air purifier (330-1) and the air monitor (410-2) as 4 points. This is because, during the operation of the robot vacuum cleaner, the amount of log data corresponding to the air monitor (410-2) is small, so the association score (433) may be 4 points.

[0107] However, when only the power off (340-1) function of the air purifier (330-1) is operated, rather than when the robot vacuum cleaner is operating, the amount of log data corresponding to the air monitor is large, so the electronic device (100) can identify the correlation score (510) between the power off (340-1) function of the air purifier (330-1) and the air monitor as 7 points.

[0108] As such, the association graph corresponding to the second function of the second home appliance may be different for each case where the first function of the first home appliance is operated and when it is not operated.

[0109] According to one example, the electronic device (100) can obtain a correlation graph for multiple functions for multiple home appliances from a server. The electronic device (100) can obtain from the server a correlation graph for a second home appliance when the first home appliance is operating and a correlation graph for a second home appliance when the first home appliance is not operating.

[0110] According to one embodiment, the electronic device (100) can update an association graph corresponding to a first function and an association score included in the association graph corresponding to the first function.

[0111] According to one embodiment, if at least one of a new home appliance and a new function is identified based on log data related to a first function, the electronic device (100) can update an association graph corresponding to the first function based on at least one of the new home appliance and the new function.

[0112] For example, when an electronic device (100) identifies a new home appliance, such as an air conditioner, based on log data related to the cleaning function of a robot vacuum cleaner, it can update the association graph by adding mapping information in which the air conditioner and the cleaning function are mapped to the existing association graph.

[0113] According to one embodiment, the electronic device (100) can update the correlation score included in the correlation graph corresponding to the first function based on at least one of the location information of a plurality of home appliances and the amount of log data accumulated from a plurality of home appliances while the first home appliance is operating.

[0114] According to one example, the correlation score for the first function of a home appliance located in the same space as the first home appliance may be set higher than the correlation score for the first function of a home appliance not located in the same space as the first home appliance. For example, the correlation score for the TV power-on function of a light located in the same space as the TV may be set higher than the correlation score for the TV power-on function of a light not located in the same space as the TV.

[0115] When the first home appliance is operated, the amount of log data of a home appliance located in the same space as the first home appliance may be greater than the amount of log data of a home appliance not located in the same space as the first home appliance. Accordingly, the electronic device (100) can update the correlation score included in the correlation graph corresponding to the first function based on the location information of a plurality of home appliances relative to the first home appliance.

[0116] According to one example, while the first home appliance is operating, the electronic device (100) may identify that the correlation score between the first function of the first home appliance and the second home appliance is higher as the amount of log data accumulated in the second home appliance among the plurality of home appliances increases. The electronic device (100) may update the correlation scores for the plurality of home appliances and the plurality of functions mapped to the first function based on the amount of log data accumulated in each of the plurality of home appliances.

[0117] FIGS. 6 and FIGS. 7 are drawings for illustrating a popup UI of an electronic device according to one or more embodiments.

[0118] According to one embodiment, the electronic device (100) can identify at least one of information about a second home appliance and information about a second function from an association graph for a first function. The electronic device (100) can identify a preset number of information about second home appliances and / or information about a second function from the association graph in order of highest association score.

[0119] For example, the electronic device (100) may display a popup UI on the control screen of the first home appliance that includes only three pieces of information among the information corresponding to a plurality of second home appliances and the information corresponding to a plurality of second functions. For example, when the electronic device (100) identifies an air purifier, a fan, an air monitor dust concentration sensing function, and a wet cleaning function in order of highest correlation score from a correlation graph corresponding to the first function, it may display a popup UI on the control screen of the first home appliance that includes only three pieces of information among them: the air purifier, the fan, and the air monitor dust concentration sensing function.

[0120] According to one example, the electronic device (100) may display a pop-up UI corresponding to at least one of a home appliance that is different from the first home appliance and an identical home appliance on the control screen of the first home appliance based on user input.

[0121] For example, when the electronic device (100) receives user input to recommend a home appliance and / or function from a home appliance different from the first home appliance, it may display a popup UI including a home appliance and function different from the first home appliance on the control screen of the first home appliance. For example, when the electronic device (100) receives user input to recommend a function different from the first function from a home appliance identical to the first home appliance, it may display a popup UI including a function different from the first function from a home appliance identical to the first home appliance on the control screen of the first home appliance.

[0122] In FIG. 6, the explanation is based on the assumption that the popup UI includes only three pieces of information among the information corresponding to multiple second home appliances and the information corresponding to multiple second functions.

[0123] Referring to FIG. 6, the electronic device (100) can display a popup UI (610) on the control screen of the first home appliance, which includes at least one of a second home appliance related to a first function and a second function that is operable on a home appliance different from the first home appliance.

[0124] For example, the electronic device (100) can display a popup UI (610) including “air purifier power off”, “fan power off”, and “air purifier” on the control screen of the robot vacuum cleaner.

[0125] When the electronic device (100) receives user input to recommend a function different from the first function in the same home appliance as the first home appliance, it can display a pop-up UI (630) including at least one of the functions that are operable in the first home appliance among the second functions on the control screen of the first home appliance.

[0126] For example, the electronic device (100) can display a popup UI (630) including “driving mode setting”, “suction strength setting”, and “water spray amount setting” on the control screen of the robot vacuum cleaner.

[0127] According to one example, when the electronic device (100) receives user input to display additional recommendation information in addition to three recommendation information, it may display the remaining information, excluding three information among the plurality of home appliances and plurality of functions related to the first function, on the control screen of the first home appliance. For example, when the electronic device (100) receives user input corresponding to “more (620)” from the user, it may display additional information, excluding the information shown in 610, on the control screen of the first home appliance.

[0128] For example, the information included in the popup UI (610, 630) of FIG. 6 may have a higher correlation score the higher it is positioned. For example, the correlation score between the first functions of “power off the air purifier” may be higher than the correlation score between the first functions of “power off the fan”.

[0129] According to one embodiment, when the electronic device (100) receives user input to display additional recommendation information from the user, it may display a popup UI (710, 720) including a scroll bar on the control screen of the first home appliance.

[0130] Referring to FIG. 7, when the electronic device (100) receives user input corresponding to “more (620)” from the user, it can display a popup UI (710, 720) including a scroll bar on the control screen of the first home appliance. When the electronic device (100) receives user input corresponding to scrolling, it can display additional recommendation information in addition to three recommendation information. For example, when the electronic device (100) receives user input corresponding to scrolling, it can display information corresponding to “air purifier power off” and “air conditioner power off” in the popup UI (710) in addition to the recommendation information shown in 710.

[0131] FIG. 8 is a diagram illustrating the process of obtaining recommendation information through an artificial intelligence model of an electronic device according to one or more embodiments.

[0132] According to one embodiment, the electronic device (100) can obtain at least one of information (840) about a second home appliance and information (850) about a second function by inputting information (810) about a first function and information (820) about a plurality of home appliances into an artificial intelligence model (830).

[0133] According to one embodiment, the artificial intelligence model (830) may be a model trained to identify at least one of information about a second home appliance and information about a second function based on a plurality of home appliances and a correlation score for each of the plurality of functions for a first function.

[0134] According to one embodiment, the artificial intelligence model (830) may be a model trained to identify a second home appliance related to a first home appliance when information about the first home appliance is input.

[0135] For example, the artificial intelligence model (830) may be a model trained to identify a second home appliance associated with a first home appliance based on log data of the first home appliance. For example, the artificial intelligence model (830) may identify data related to the operation of a robot vacuum cleaner as training data based on log data of the robot vacuum cleaner, and identify an air purifier associated with the robot vacuum cleaner as a second home appliance based on the training data.

[0136] For example, the artificial intelligence model (830) may be a model trained to identify at least one second appliance associated with the first appliance based on information about the first appliance and an association graph. For example, the artificial intelligence model (830) may identify at least one second appliance with a high association score among a plurality of second appliances mapped to the first appliance based on the association graph.

[0137] Here, the term "training an artificial intelligence model" means that a basic artificial intelligence model (e.g., an artificial intelligence model containing arbitrary random parameters) is trained by a learning algorithm using multiple training data, thereby creating predefined behavioral rules or an artificial intelligence model configured to perform a desired characteristic (or objective). This learning may be performed via a separate server and / or system, but is not limited thereto, and may also be performed in a cooking device. Examples of learning algorithms include supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but are not limited to the examples mentioned above.

[0138] Here, the artificial intelligence model may be implemented as, for example, CNN (Convolutional Neural Network), RNN (Recurrent Neural Network), RBM (Restricted Boltzmann Machine), DBN (Deep Belief Network), BRDNN (Bidirectional Recurrent Deep Neural Network), or Deep Q-Networks, but is not limited thereto.

[0139] Referring to FIG. 8, the electronic device (100) can input information (810) about a first function and information (820) about a plurality of home appliances into an artificial intelligence model (830) to obtain at least one of information (840) about a second home appliance and information (850) about a second function.

[0140] FIG. 9 is a drawing for explaining the overall operation method of an electronic device according to one or more embodiments.

[0141] Referring to FIG. 9, in operation 910, when the electronic device (100) receives user input corresponding to finding a device on an IoT application control screen, it can identify a plurality of home appliances placed in the home.

[0142] In operation 920, when a first appliance among a plurality of appliances is selected, the electronic device (100) can display the control screen of the first appliance through a display.

[0143] In operation 930, the electronic device (100) can receive user input corresponding to the first function among the multiple functions of the first home appliance on the control screen of the first home appliance.

[0144] In operation 940, the electronic device (100) can transmit a control signal to the first appliance to control the first function based on user input corresponding to the first function.

[0145] In operation 950, the electronic device (100) identifies at least one of a second appliance related to a first function and a second function related to the first function, and can display a popup UI containing at least one of information about the second appliance and information about the second function on the control screen of the first appliance.

[0146] In operation 960, when the electronic device (100) receives user input corresponding to the second home appliance included in the pop-up UI, it can display the control screen of the second home appliance through the display.

[0147] According to one example, user input may perform different actions depending on the touch method, touch time, and touch pattern. For example, when the electronic device (100) receives user input for different touch times, it may perform different actions for a second home appliance included in a popup UI. For example, if the user touches the UI for the second home appliance through the display (110) for a short time, the electronic device (100) may display a control screen corresponding to the second home appliance at the touched location through the display (110). For example, if the user touches for a long time, the electronic device (100) may display a popup UI that allows editing the second home appliance at the touched location through the display (110).

[0148] For example, when the electronic device (100) receives user input regarding a different touch method, it may perform different actions on the second home appliance and the second function included in the pop-up UI. For example, if the user slides left or right through the display (110), the electronic device (100) may highlight one of the multiple second home appliances and multiple second functions. For example, if the user slides up or down through the display (110), the electronic device (100) may display the control screen of the first home appliance instead of the pop-up UI screen displayed on the display (110). For example, if the user touches twice through the display (110) for a preset time, the electronic device (100) may transmit a control signal to the device to operate the second home appliance or the second function at the touched location.

[0149] In operation 970, when the electronic device (100) receives user input to further display information about the second home appliance and information about the second function in the popup UI, it may display 7 devices / functions in the popup UI excluding 3 devices / functions displayed in the popup UI.

[0150] In operation 980, when the electronic device (100) receives user input to select at least one of the additionally displayed devices / functions, it can display the control screen of the selected home appliance through the display.

[0151] FIG. 10 is a sequence diagram for explaining the operation method of an electronic device and a server according to one or more embodiments.

[0152] According to one embodiment, the above-described embodiments may be implemented as a system including an electronic device (100) and a server (200).

[0153] Referring to FIG. 10, in operation 1010, when a first home appliance among a plurality of home appliances is selected on an execution screen of an IoT application for controlling a plurality of home appliances, the electronic device (100) can display a control screen of the first home appliance.

[0154] In operation 1020, when a first function is selected on the control screen of a first home appliance, the electronic device (100) can request information related to the first function from the server (200).

[0155] In operation 1030, when the server (200) receives a request for information related to the first function, it can identify at least one of the second appliance related to the first function and the second function related to the first function.

[0156] In operation 1040, the server (200) can transmit information corresponding to at least one of the second appliance related to the first function and the second function related to the first function to the electronic device (100).

[0157] In operation 1050, the electronic device (100) may display a popup UI on the control screen of the first home appliance based on information received from the server, the popup UI including at least one of information about the second home appliance and information about the second function.

[0158] In operation 1060, when a home appliance and / or function included in the pop-up UI is selected, the electronic device (100) can display a control screen of the home appliance corresponding to the selected home appliance or selected function through the display.

[0159] According to one embodiment, when a first function is selected on the control screen of a first home appliance, the electronic device (100) requests information regarding an association graph corresponding to the first function from a server (200), and when the server (200) receives the request for information regarding an association graph corresponding to the first function, the server (200) can transmit information regarding an association graph corresponding to the first function to the electronic device (100). Based on the association graph corresponding to the first function received from the server (200), the electronic device (100) can identify at least one of information regarding a second home appliance and information regarding a second function.

[0160] According to one embodiment, the server (200) transmits to the electronic device (100) a correlation score included in the correlation graph corresponding to the first function based on an information request for a correlation graph corresponding to the first function received from the electronic device (100), and the electronic device (100) may display a popup UI including at least one of information about the second home appliance and information about the second function based on the correlation score included in the correlation graph corresponding to the first function received from the server (200) on the control screen of the first home appliance.

[0161] FIG. 11 is a drawing for explaining a method of operation of an electronic device according to one or more embodiments.

[0162] Referring to FIG. 11, in operation 1110, the electronic device (100) can receive user input selecting a first home appliance among a plurality of home appliances on an execution screen of an IoT application for controlling a plurality of home appliances.

[0163] In operation 1120, when a first appliance among a plurality of appliances is selected, the electronic device (100) can display a control screen of the first appliance.

[0164] In operation 1130, when a first function is selected on the control screen of a first home appliance, the electronic device (100) can identify at least one of a second home appliance associated with the first function and a second function associated with the first function.

[0165] In operation 1140, the electronic device (100) may display a pop-up UI containing at least one of information about the second home appliance and information about the second function on the control screen of the first home appliance.

[0166] The control method described in FIG. 11 may be performed by an electronic device (100) having the configuration of FIG. 2 described above, but is not necessarily limited thereto and may be performed by an electronic device having various configurations.

[0167] The various embodiments described above may be implemented as individual embodiments, or at least one embodiment may be combined with one another, either wholly or partially, to be implemented together in a single device.

[0168] According to the various embodiments described above, a popup UI including a home appliance and / or a function related to a first function of a first home appliance is displayed on the control screen of a first home appliance, and the function of a second home appliance related to the first function can be easily and quickly controlled through the popup UI.

[0169] Meanwhile, the various embodiments described above may be applied to a product as embodiments alone, but at least some of their contents may be combined with other embodiments of the present disclosure to be implemented together.

[0170] The various embodiments described above may be implemented as software containing instructions stored on a machine-readable storage medium (e.g., computer). The machine may include an electronic device (e.g., electronic device (100)) according to the disclosed embodiments, which is a device capable of calling instructions stored from the storage medium and operating according to the called instructions. When instructions are executed by a processor, the processor may perform a function corresponding to the instructions directly or by using other components under the control of the processor. Instructions may include code generated or executed by a compiler or an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory computer-readable storage medium. Here, "non-transitory" means only that the storage medium does not contain a signal and is tangible, and does not distinguish whether data is stored semi-permanently or temporarily in the storage medium.

[0171] In addition, according to one embodiment of the present disclosure, the method according to the various embodiments described above may be provided by being included in a computer program product.

[0172] Specifically, a non-transient readable storage medium or computer program product may be provided that stores computer commands to perform the following operations: displaying a control screen of a first home appliance when a first home appliance among a plurality of home appliances is selected on an execution screen of an IoT application for controlling a plurality of home appliances; identifying at least one of a second home appliance related to the first function and a second function related to the first function when a first function is selected on the control screen of the first home appliance; and displaying a popup UI including at least one of information about the second home appliance and information about the second function on the control screen of the first home appliance.

[0173] Computer program products may be distributed in the form of device-readable storage media (e.g., compact disc read-only memory (CD-ROM)) or online through an application store (e.g., Play Store™). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0174] In addition, computer instructions or programs for performing control methods of electronic devices according to the various embodiments described above may be stored on a non-transitory computer-readable medium. When computer instructions stored on such a non-transitory computer-readable medium are executed by a processor of a specific device, they cause the specific device to perform processing operations according to the various embodiments described above. A non-transitory computer-readable medium refers to a medium that stores data semi-permanently and is readable by a device, rather than a medium that stores data for a short period of time, such as a register, cache, or memory. Specific examples of a non-transitory computer-readable medium may include CDs, DVDs, hard disks, Blu-ray discs, USBs, memory cards, ROMs, etc.

[0175] Although preferred embodiments of the present disclosure have been illustrated and described above, the present disclosure is not limited to the specific embodiments described above. It is understood that various modifications can be made by those skilled in the art without departing from the essence of the present disclosure as claimed in the claims, and such modifications should not be understood individually from the technical spirit or perspective of the present disclosure.

Claims

1. In an electronic device, display; Memory for storing instructions; and One or more processors including processing circuitry; and The above one or more processors, When the above instructions are executed individually or collectively, the electronic device, When a first home appliance is selected among the plurality of home appliances on the execution screen of an IoT application for controlling a plurality of home appliances, the control screen of the first home appliance is displayed through the display, and When a first function is selected on the control screen of the first home appliance, at least one of a second home appliance related to the first function and a second function related to the first function is identified, and An electronic device that displays a Pop-Up User Interface (Pop Up UI) including at least one of information about the second home appliance and information about the second function on the control screen of the first home appliance.

2. In Paragraph 1, When the above instructions are executed individually or collectively by the one or more processors, the electronic device, When a first function is selected on the control screen of the first home appliance, an association graph corresponding to the first function is obtained from a server corresponding to the IoT application, and Based on the above association graph, at least one of the information regarding the second home appliance and the information regarding the second function is identified, and The above association graph is, An electronic device, the graph in which the first function, the plurality of home appliances, and the plurality of functions are mapped based on the correlation score of each of the plurality of home appliances and the plurality of functions for the first function.

3. In Paragraph 1, When the above instructions are executed individually or collectively by the one or more processors, the electronic device, An electronic device that displays a popup UI including at least one function different from the first function among the functions that can be performed on the first home appliance based on user input.

4. In Paragraph 2, The above multiple functions are, An electronic device that is capable of performing functions in the above-mentioned plurality of home appliances.

5. In Paragraph 2, The above association graph is, An electronic device that is updated based on at least one of a new home appliance and a new function when at least one of the new home appliance and the new function is identified based on log data related to the first function.

6. In Paragraph 2, The association scores included in the above association graph are, An electronic device that is updated based on at least one of the location information of the plurality of home appliances and the amount of log data accumulated from the plurality of home appliances while the first home appliance is operating.

7. In Paragraph 1, When the above instructions are executed individually or collectively by the one or more processors, the electronic device, Information regarding the first function and information regarding the plurality of home appliances are input into an artificial intelligence model to obtain at least one of information regarding the second home appliance and information regarding the second function, and The above artificial intelligence model is, An electronic device, which is a model trained to identify at least one of information about a second home appliance and information about a second function based on the association scores of each of the plurality of home appliances and the plurality of functions for the first function.

8. In Paragraph 1, When the above instructions are executed individually or collectively by the one or more processors, the electronic device, Obtaining an association graph corresponding to the first home appliance from a server corresponding to the above IoT application, and Based on an association graph corresponding to the first home appliance, at least one of a third home appliance related to the first home appliance and a function related to the first home appliance is identified, and A popup UI including at least one of information regarding the third home appliance and information regarding a function related to the first home appliance is displayed on the control screen of the first home appliance, and The above-mentioned third home appliance is, An electronic device that is identified regardless of whether the above-mentioned first function is selected.

9. In a method for controlling an electronic device, A step of displaying a control screen for the first home appliance when the first home appliance among the plurality of home appliances is selected on the execution screen of an IoT application for controlling a plurality of home appliances; When a first function is selected on the control screen of the first home appliance, a step of identifying at least one of a second home appliance related to the first function and a second function related to the first function; and A control method comprising the step of displaying a Pop-Up User Interface (Pop Up UI) on the control screen of the first home appliance, the Pop-Up User Interface comprising at least one of information about the second home appliance and information about the second function.

10. In Paragraph 9, When a first function is selected on the control screen of the first home appliance, a step of obtaining an association graph corresponding to the first function from a server corresponding to the IoT application; and The method includes the step of identifying at least one of the information regarding the second home appliance and the information regarding the second function based on the association graph above. The above association graph is, A control method comprising a graph in which the first function, the plurality of home appliances, and the plurality of functions are mapped based on the correlation scores of each of the plurality of home appliances and the plurality of functions for the first function.

11. In Paragraph 9, A control method comprising: a step of displaying a popup UI that includes at least one function different from the first function among the functions that can be performed on the first home appliance based on user input.

12. In Paragraph 10, The above multiple functions are, A control method, which is a function that can be performed on the above-mentioned plurality of home appliances.

13. In Paragraph 10, A control method further comprising the step of updating the association graph based on at least one of the new home appliance and the new function when at least one of the new home appliance and the new function is identified based on log data related to the first function.

14. In Paragraph 10, A control method further comprising the step of updating an association score included in the association graph based on at least one of the location information of the plurality of home appliances and the amount of log data accumulated from the plurality of home appliances while the first home appliance is operating.

15. In a system including electronic devices and a server, An electronic device that, when a first home appliance among the plurality of home appliances is selected on an execution screen of an IoT application for controlling a plurality of home appliances, displays a control screen of the first home appliance, and when a first function is selected on the control screen of the first home appliance, requests information related to the first function; and A server that, upon receiving a request for information related to the first function, identifies at least one of a second home appliance related to the first function and a second function related to the first function, and transmits the information identified by the electronic device; The above electronic device is, A system that displays a Pop-Up User Interface (Pop Up UI) on the control screen of the first home appliance, including at least one of information about the second home appliance and information about the second function, based on information received from the server.

Images