Electronic apparatus and control method thereof

Abstract

Disclosed is an electronic apparatus. The apparatus comprises a communication circuit, a memory, and at least one processor which: acquires an image through a camera connected to the communication circuit; when the acquired image includes a preset object, acquires information corresponding to the object on the basis of the image; transmits, to a server through the communication circuit, the information corresponding to the object and information corresponding to server registration of the object; and receives, from the server through the communication circuit, a notification related to information corresponding to the object registered on the server.

Description

Electronic device and control method thereof

[0001] The present disclosure relates to an electronic device and a method for controlling the same, and more specifically, to an electronic device and a method for controlling the same for providing notification of the condition of a plant.

[0002] Internet of Things (IoT) technology can collect and analyze data generated from devices to provide various services to users.

[0003] For example, a server can provide users with data acquired from devices by linking with devices placed in locations registered to the server (e.g., home). Meanwhile, recently, sensors such as cameras are connected to devices to provide Internet of Things (IoT) related services to users.

[0004] The information described above may be provided as related art for the purpose of aiding understanding of the present disclosure. No claim or determination is made as to whether any of the foregoing may be applied as prior art related to the present disclosure.

[0005] An electronic device according to the present disclosure comprises at least one processor including a communication circuit, a memory for storing instructions, and a processing circuitry, wherein when the instructions are executed individually or collectively by the at least one processor, the electronic device may acquire an image through a camera connected to the communication circuit, and if the acquired image contains a pre-set object, acquire information corresponding to the object based on the image, transmit information corresponding to the object and information corresponding to server registration of the object to the server through the communication circuit, and receive a notification related to information corresponding to the object registered on the server from the server through the communication circuit.

[0006] A control method for an electronic device according to the present disclosure may include the steps of: acquiring an image through a camera connected to a communication circuit; acquiring information corresponding to an object based on the image if the acquired image contains a pre-set object; transmitting information corresponding to the object and information corresponding to the server registration of the object to a server through the communication circuit; and receiving a notification related to the information corresponding to the object registered on the server from the server through the communication circuit.

[0007] In a non-transient computer-readable recording medium that stores instructions executed by a control unit of an electronic device to perform a method according to the present disclosure, the method may include: acquiring an image through a camera connected to a communication circuit; if the acquired image contains a pre-set object, acquiring information corresponding to the object based on the image; transmitting information corresponding to the object and information corresponding to the server registration of the object to the server through the communication circuit; and receiving a notification related to the information corresponding to the object registered on the server from the server through the communication circuit.

[0008] In relation to the description of the drawings, the same or similar reference numerals may be used for identical or similar components.

[0009] FIG. 1 illustrates an IoT system (50) according to an embodiment of the present disclosure.

[0010] FIG. 2 is a block diagram illustrating the configuration of a camera connected to an electronic device according to one embodiment.

[0011] FIG. 3 is a block diagram illustrating the configuration of an electronic device according to one embodiment.

[0012] FIG. 4 is a drawing illustrating an example of a system that provides notification of the condition of a plant according to one embodiment.

[0013] FIG. 5a is a flowchart illustrating an example of an operation in which an electronic device provides notifications related to an object based on an image acquired through a camera, according to one embodiment.

[0014] FIG. 5b is a flowchart illustrating an example of an operation to transmit a notification related to a plant to a user device based on an image acquired through a camera, according to one embodiment.

[0015] FIG. 6 is a flowchart illustrating an example of an operation in which an electronic device transmits a notification of insufficient sunlight hours to a user device according to one embodiment.

[0016] FIG. 7 is a diagram illustrating an example of an operation in which an electronic device extracts a plurality of regions from an image according to one embodiment.

[0017] FIGS. 8A and FIGS. 8B are drawings illustrating an example of a notification regarding a lack of sunlight hours according to one embodiment.

[0018] FIG. 9 is a flowchart illustrating an example of an operation in which an electronic device transmits a notification of a water shortage state to a user device according to one embodiment.

[0019] FIGS. 10a and FIGS. 10b are drawings illustrating an example of a notification regarding a water shortage condition according to one embodiment.

[0020] FIG. 11 is a flowchart illustrating an example of an operation in which an electronic device transmits a notification about the condition of a plant organ to a user device, according to one embodiment.

[0021] FIGS. 12a and FIGS. 12b are drawings illustrating an example of a notification regarding the condition of a plant organ according to one embodiment.

[0022] FIG. 13 is a diagram illustrating an example of an operation to register a plant sensor to a user account according to one embodiment.

[0023] FIG. 14 is a diagram illustrating an example of an operation in which a user device provides information regarding the state of a plant to a user through an application, according to one embodiment.

[0024] FIG. 15 is a diagram illustrating an example of an operation to generate a pet sensor based on an image according to one embodiment.

[0025] FIG. 16 is a drawing for explaining an example of a pet sensor registered to a user account according to one embodiment.

[0026] FIG. 17 is a diagram illustrating an example of an operation to generate a temperature sensor based on an image according to one embodiment.

[0027] FIG. 18 is a diagram illustrating an example of a temperature sensor registered to a user account according to one embodiment.

[0028] The present disclosure will be described in detail below with reference to the attached drawings.

[0029] The electronic device according to the various embodiments disclosed in this document may be of various forms. The electronic device may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a consumer electronics device. The electronic device according to the embodiments of this disclosure is not limited to the devices described above.

[0030] The various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of said embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of said items unless the relevant context clearly indicates otherwise. In this document, phrases such as "A or B," "at least one of A and B," "at least one of A or B," "A, B or C," "at least one of A, B and C," and "at least one of A, B, or C" may each include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used simply to distinguish said components from other said components and do not limit said components in any other aspect (e.g., importance or order). Where any (e.g., 1st) component is referred to as "coupled" or "connected" to another (e.g., 2nd) component, with or without the terms "functionally" or "communicationly," it means that said any component may be connected to said other component directly (e.g., via a wire), wirelessly, or through a third component.

[0031] Throughout the specification, singular expressions include plural expressions unless the context clearly indicates otherwise. Wherever a part of the specification states that it "includes" a certain component, this means that, unless specifically stated otherwise, it does not exclude other components but may include additional components.

[0032] The term “module” as used in the various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. A module may be a component formed integrally, or a minimum unit of said component or a part thereof that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0033] FIG. 1 illustrates an IoT system (50) according to an embodiment of the present disclosure.

[0034] Referring to FIG. 1, the system (50) may include a plurality of electronic devices.

[0035] According to one embodiment, the system (50) (or IoT system) may include at least one of a server (10), devices (31, 32, 33, 34, 35), a user device (20), and a hub device (40). For example, a smart home environment may be implemented using the system (50). The number of devices (or devices) shown in FIG. 1 is an example and the present disclosure is not limited thereto.

[0036] According to one embodiment, the server (10) can remotely control and / or monitor at least one device (e.g., devices (31, 32, 33, 34, 35)) through a hub device (40) or directly without a hub device (40). The server (10) can be implemented as various computing devices such as a workstation, a cloud, a data drive, or a data station. The server (10) can be implemented as one or more servers that are physically or logically separated based on functions, detailed configurations of functions, or data, and can transmit and receive data and process the transmitted and received data through communication between each server.

[0037] According to one embodiment, the devices (31, 32, 33, 34, 35) may be sensors or home appliances placed (or located) within a local environment such as a house (hereinafter referred to as home), an office, etc.

[0038] A sensor can generate electrical information from non-electronic information that can be processed by a device or apparatus. The information may be referred to as sensor data. For example, the sensor may be a camera capable of acquiring images through shooting, a motion sensor capable of detecting movement, a door sensor for detecting the opening / closing of a door, a window sensor for detecting the opening / closing of a window, a temperature sensor for detecting temperature, a humidity sensor for detecting humidity, a smoke sensor for detecting smoke, a sound sensor for detecting sound, or a leak detection sensor for detecting leaks.

[0039] The home appliance may be at least one of various types of home appliances. For example, the home appliance may include, but is not limited to, at least one of a television, speaker, lighting, refrigerator, dishwasher, electric range, robot vacuum cleaner, air conditioner, clothing care device, washing machine, dryer, and microwave oven. These home appliances are merely examples, and in addition to the home appliances mentioned above, devices capable of performing the operations described below by connecting to other home appliances, a server (10), a user device (20), or a hub device (40) may be included in the devices (31, 32, 33, 34, 35) according to one embodiment. As an example that is not limited, the home appliance may include a sensor.

[0040] According to one embodiment, the user device (20) may be carried by the user or placed in the user's home or office, etc. The user device (20) may include, but is not limited to, a personal computer, a terminal, a portable telephone, a smartphone, a handheld device, a wearable device (e.g., a smart watch, a smart ring).

[0041] According to one embodiment, the hub device (40) communicates with the server (10) using wired communication and / or wireless communication and can be connected to devices (33, 34, 35) using wired communication and / or wireless communication. For example, the hub device (40) can communicate with the devices (33, 34, 35) via a short-range wireless network such as Bluetooth, BLE (Bluetooth Low Energy), Wi-Fi, Zigbee, or Z-Wave. For example, devices that do not have the capability for network communication to connect directly to the server (10) can be connected to the server (10) through the hub device (40).

[0042] According to one embodiment, the server (10) can communicate with devices (31, 32, 33, 34, 35) or a user device (20) through a network. For example, the server (10) can transmit data to devices (31, 32, 33, 34, 35) or a user device (20) through a network and receive data from devices (31, 32, 33, 34, 35) or a user device (20).

[0043] For example, multiple electronic devices can be connected through a network. The network may include at least one of a wide area network (WAN), such as the Internet, a local area network (LAN) formed around an access point (AP), and a short-range wireless network.

[0044] The server (10) may be connected to a network. The network may include a network for remote communication, such as the Internet or a computer network (e.g., LAN or WAN). Additionally, the network may include a cellular network.

[0045] The connection relay can connect devices (31, 32), user devices (20), or hub devices (40) to a network to which the server (10) is connected. Devices (31, 32), user devices (20), or hub devices (40) can be connected to the server (10) via the network. Devices (33, 34, 35) connected to the hub device (40) can be connected to the network via the hub device (40) and connected to the server (10) via the network. The connection relay can communicate with devices (31, 32), user devices (20), or hub devices (40) using wireless communication such as Wi-Fi, and can connect to the network to which the server (10) is connected using wired communication. As an example, without limitation, devices (31, 32), user devices (20), or hub devices (40) can be connected to the network using wired communication (e.g., wired Ethernet) and connected to the server (10) via the network. As another example, devices (31, 32) or user devices (20) can be connected to the server (10) via a network using cellular communication.

[0046] According to one embodiment, the server (10) can perform functions such as managing user accounts, registering devices (31, 32, 33, 34, 35) associated with user accounts, and managing or controlling the registered devices (31, 32, 33, 34, 35). For example, a user can create a user account by accessing the server (10) through a user device (20). A user account can be identified by an ID and password set by the user. The server (10) can register devices (31, 32, 33, 34, 35) to the user account according to a set procedure. For example, the server (10) can register, manage, and control the devices (31, 32, 33, 34, 35) by linking the registration information of the devices (31, 32, 33, 34, 35) to the user account. Registration information may be stored in the memory of the server (10). For example, registration information may include identification information of the device (e.g., serial number, MAC address, or Wi-Fi SSID (service set identifier)), the location and / or room of the device, and the capability of the device. A location registered in the server (10) refers to a place registered in the server (10) (e.g., home), and a room registered in the server (10) may refer to a room (e.g., Room 1, Room 2, etc.) included in the location registered in the server (10) (e.g., home). Information regarding the location and / or room of the device may be entered by the user through the user device (20) and may include information regarding the location and / or room where the device is placed.

[0047] According to one embodiment, an application for controlling devices (31, 32, 33, 34, 35) may be stored in the memory of the user device (20). The application may be installed on the user device (20) at the time of manufacturing or downloaded and installed from an external server. For example, the user may connect to the server (10) by running the application installed on the user device (20) to create a user account, and communicate with the server (10) based on the logged-in user account to register, manage, and control the devices (31, 32, 33, 34, 35).

[0048] According to one embodiment, the devices (31, 32, 33, 34, 35) can transmit data regarding the operating status of the devices (31, 32, 33, 34, 35) to another device, a user device (20), or a server (10) via a network. The data regarding the operating status may include device status information (e.g., device on / off, operating mode, etc.) and sensor data.

[0049] For example, when a request is received from the server (10), when a specific event (e.g., acquisition / change of sensor data, acquisition / change of status information, etc.) occurs in the devices (31, 32, 33, 34, 35), or periodically or in real time, the devices (31, 32, 33, 34, 35) may transmit the information to another device, a user device (20), or the server (10). When the server (10) receives data regarding the operation status from the devices (31, 32, 33, 34, 35), it may update the stored information and transmit the updated information to the user device (20) via a network. The update of information may include various operations that change the existing information, such as adding new information to the existing information or replacing the existing information with new information.

[0050] According to one embodiment, the server (10) may transmit a control command to at least one of the devices (31, 32, 33, 34, 35). A device that receives the control command and performs an action corresponding to the control command may be referred to as the target device. The control command may refer to data that causes a controllable device to perform a specific action. The specific action is an action performed by the device and may include, but is not limited to, outputting information, detecting (or sensing) information, managing information (e.g., deleting or creating). A user may control the target device among the devices (31, 32, 33, 34, 35) using an application installed on the user device (20). For example, when a user logs into a user account using an application installed on the user device (20), the devices (31, 32, 33, 34, 35) registered to the user account may be displayed on the display of the user device (20). The user may input user input into the application to control a target device among the devices (31, 32, 33, 34, 35). The server (10) may obtain information (or a request) for generating a control command from the user device (20), generate a control command based on the received request, and transmit the generated control command to the target device. As an example, but not limited to, if the server (10) identifies that the result of monitoring at least one device among the devices (31, 32, 33, 34, 35) satisfies a specified condition, it may generate a control command to control the device and transmit the generated control command to the device. In this disclosure, the term "specified" may be replaced with expressions such as "pre-set," "pre-defined," etc.

[0051] FIG. 2 is a block diagram illustrating the configuration of a camera connected to an electronic device according to one embodiment.

[0052] Referring to FIG. 2, the electronic device (100) can receive an image from the camera (200) through an input interface.

[0053] The camera (200) can be connected to the electronic device (100) via a USB terminal. The camera (200) can photograph the interior of the house. The shooting direction of the camera (200) can be controlled by the user. For example, the user can adjust the shooting direction of the camera (200) to photograph the direction in which a plant is located. The camera (200) can acquire an image corresponding to the subject by converting light emitted or reflected and transmitted from the subject into an electrical signal using an image sensor. According to one embodiment, the image sensor may include one image sensor selected from among image sensors with different attributes, such as an RGB sensor, a BW (black and white) sensor, an IR sensor, or a UV sensor, a plurality of image sensors having the same attribute, or a plurality of image sensors having different attributes.

[0054] FIG. 3 is a block diagram illustrating the configuration of an electronic device according to one embodiment.

[0055] At least one of the devices (31, 32, 33, 34, 35) of FIG. 1 or the electronic device (100) of FIG. 2 may correspond to the electronic device (100) of FIG. 3. The electronic device (100) of FIG. 3 may include at least one of the devices (31, 32, 33, 34, 35) of FIG. 1 or the electronic device (100) of FIG. 2. Referring to FIG. 3, the electronic device (100) may include at least one processor (110) (hereinafter referred to as processor (110)), at least one memory (120) (hereinafter referred to as memory (120)), at least one communication circuit (130) (hereinafter referred to as memory (130)), and at least one input interface (140) (hereinafter referred to as input interface (140)).

[0056] A processor (110) can control the overall operation of an electronic device (100). Specifically, the processor (110) can control the overall operation of the electronic device (100) by being connected to each component of the electronic device (100). The processor (110) may include one or more of a CPU (Central Processing Unit), GPU (Graphics Processing Unit), APU (Accelerated Processing Unit), MIC (Many Integrated Core), DSP (Digital Signal Processor), NPU (Neural Processing Unit), hardware accelerator, or machine learning accelerator. The processor (110) can control one or any combination of other components of the electronic device (100) and can perform operations or data processing related to communication. The processor (110) can execute one or more programs or instructions stored in the memory (120) of the electronic device (100). For example, the processor (110) can perform the method according to one embodiment of the present disclosure by executing one or more instructions stored in memory (120).

[0057] When a method according to one embodiment of the present disclosure includes a plurality of operations, the plurality of operations may be performed by a single processor or by a plurality of processors. For example, when a first operation, a second operation, and a third operation are performed by a method according to one embodiment, the first operation, the second operation, and the third operation may all be performed by a first processor, or the first operation and the second operation may be performed by a first processor (e.g., a general-purpose processor) and the third operation may be performed by a second processor (e.g., an artificial intelligence dedicated processor).

[0058] The processor (110) may be implemented as a single-core processor including one core, or as one or more multicore processors including multiple cores (e.g., homogeneous multicore or heterogeneous multicore). When the processor (110) is implemented as a multicore processor, each of the multiple cores included in the multicore processor may include internal processor memory such as cache memory or on-chip memory, and a common cache shared by the multiple cores may be included in the multicore processor. Additionally, each of the multiple cores included in the multicore processor (or some of the multiple cores) may independently read and execute program instructions for implementing a method according to one embodiment of the present disclosure, or all (or some) of the multiple cores may be linked together to read and execute program instructions for implementing a method according to one embodiment of the present disclosure.

[0059] When a method according to one embodiment of the present disclosure includes a plurality of operations, the plurality of operations may be performed by one of the plurality of cores included in a multi-core processor, or may be performed by a plurality of cores. For example, when a first operation, a second operation, and a third operation are performed by a method according to one embodiment, the first operation, the second operation, and the third operation may all be performed by a first core included in a multi-core processor, or the first operation and the second operation may be performed by a first core included in a multi-core processor and the third operation may be performed by a second core included in a multi-core processor.

[0060] The memory (120) can store data necessary for various embodiments. Depending on the purpose of data storage, the memory (120) may be implemented in the form of a memory embedded in the electronic device (100) or in the form of a memory that can be attached to and detached from the electronic device (100). For example, data for operating the electronic device (100) may be stored in a memory embedded in the electronic device (100), and data for the expansion function of the electronic device (100) may be stored in a memory that can be attached to and detached from the electronic device (100). Meanwhile, the memory embedded in the electronic device (100) may be implemented as at least one of volatile memory (e.g., DRAM (dynamic RAM), SRAM (static RAM), or SDRAM (synchronous dynamic RAM), etc.), non-volatile memory (e.g., OTPROM (one-time programmable ROM), PROM (programmable ROM), EPROM (erasable and programmable ROM), EEPROM (electrically erasable and programmable ROM), mask ROM, flash ROM, flash memory (e.g., NAND flash or NOR flash, etc.), hard drive, or solid state drive (SSD). Additionally, the memory that is detachable from the electronic device (100) may be implemented in the form of a memory card (e.g., CF (compact flash), SD (secure digital), Micro-SD (micro secure digital), Mini-SD (mini secure digital), xD (extreme digital), MMC (multi-media card), etc.), external memory connectable to a USB port (e.g., USB memory), etc. there is.

[0061] According to one example, the memory (120) may store at least one instruction or computer program including instructions for controlling an electronic device (100).

[0062] In the above-described embodiment, various data is described as being stored in the external memory (120) of the processor (110), but at least some of the above-described data may be stored in the internal memory of the processor (110) according to at least one implementation example of the electronic device (100) or the processor (110).

[0063] In the embodiments of the present disclosure, a processor may mean a system-on-chip (SoC) in which one or more processors and other electronic components are integrated, a single-core processor, a multi-core processor, or a core included in a single-core processor or a multi-core processor, wherein the core may be implemented as a CPU, GPU, APU, MIC, DSP, NPU, hardware accelerator, or machine learning accelerator, but the embodiments of the present disclosure are not limited thereto.

[0064] The communication circuit (130) can communicate with an external device through a nearby access point (AP). The access point (AP) can connect the local area network (LAN) to which the electronic device (200) is connected to a wide area network (WAN) to which the external device is connected. The electronic device (200) can be connected to the external device through the network (WAN). Additionally, the communication circuit (130) can perform device-to-device (D2D) communication with the external device. For example, the communication circuit (130) can communicate with the external device over short distances without using an access point.

[0065] The communication circuit (130) can communicate with an external device using various types of communication methods. For example, the communication circuit (130) may include a LAN communication module such as an Ethernet module. The communication circuit (130) may include wireless communication modules such as Wi-Fi, Wi-Fi Direct, Bluetooth, BLE (Bluetooth Low Energy), Zigbee, NFC, Z-Wave, and infrared communication. The communication circuit (130) may include cellular communication modules such as 3G (3rd Generation), 3GPP (3rd Generation Partnership Project), LTE (Long Term Evolution), and 5G.

[0066] According to one embodiment, the communication circuit (130) may use the same communication module (e.g., Wi-Fi module) to communicate with an external device, such as a remote control device, and an external server.

[0067] According to one embodiment, the communication circuit (130) may use different communication modules to communicate with external devices, such as a remote control device and an external server. For example, the communication circuit (130) may use at least one of an Ethernet module or a Wi-Fi module to communicate with an external server, and may use a Bluetooth module to communicate with an external device, such as a remote control device. However, this is merely one embodiment, and the communication circuit (130) may use at least one of various communication modules when communicating with multiple external devices or external servers.

[0068] An interface is a configuration created to interact between two or more systems, devices, programs, or users. An interface may include at least one of an input interface (140) or an output interface (not shown).

[0069] The interface may be any one of HDMI (High Definition Multimedia Interface), MHL (Mobile High-Definition Link), USB (Universal Serial Bus), DP (Display Port), Thunderbolt, VGA (Video Graphics Array) port, RGB port, D-SUB (D-subminiature), or DVI (Digital Visual Interface). The input / output interface (155) may input and output at least one of audio and video signals. Depending on the implementation example, the interface may include separate ports for inputting and outputting only audio signals and for inputting and outputting only video signals, or it may be implemented as a single port for inputting and outputting both audio and video signals. The electronic device (100) may transmit at least one of the audio and video signals to an external device (e.g., an external display device or an external speaker) through the interface. An output port included in the input / output interface may be connected to an external device, and the electronic device (100) may transmit at least one of the audio and video signals to the external device through the output port.

[0070] The interface can be connected to a communication interface. The interface can transmit information received from an external device to a communication circuit or transmit information received through a communication circuit to an external device.

[0071] The input interface (140) is configured to receive various signals, data, etc. from a wired device. When an external microphone is connected through the input interface (140), the electronic device (100) can receive user queries input into the external microphone through the input interface. The input interface (140) may also be referred to as a connection port.

[0072] According to one embodiment, there may be an embodiment in which an electronic device (100) performs an operation corresponding to a user voice signal received through a microphone (not shown).

[0073] According to one embodiment, the electronic device (100) can control a display (not shown) based on a user voice signal received through a microphone (not shown) included in the electronic device (100). For example, when a user voice signal for displaying content A is received, the electronic device (100) can control the display (not shown) to display content A. However, it is not limited thereto, and the electronic device (100) can receive a user voice signal received through a microphone mounted on an external electronic device (e.g., a remote control device, etc.) via a communication circuit (130).

[0074] According to one embodiment, the electronic device (100) can control an external display device connected to the electronic device (100) based on a user voice signal received through a microphone (not shown). The electronic device (100) can generate a control signal to control the external display device so that an operation corresponding to the user voice signal is performed on the external display device, and can transmit the generated control signal to the external display device. The electronic device (100) can store a remote control application for controlling the external display device. Furthermore, the electronic device (100) can transmit the generated control signal to the external display device using at least one communication method among Bluetooth, Wi-Fi, or infrared. For example, when a user voice signal for displaying content A is received, the electronic device (100) can transmit a control signal to the external display device to control the display of content A on the external display device. The electronic device (100) may refer to various terminal devices capable of installing a remote control application, such as a smartphone or an AI speaker.

[0075] According to one embodiment, the electronic device (100) may use a remote control device to control an external display device connected to the electronic device (100) based on a user voice signal received through a microphone (not shown). The electronic device (100) may transmit a control signal to the remote control device to control the external display device so that an operation corresponding to the user voice signal is performed on the external display device. The remote control device may transmit the control signal received from the electronic device (100) to the external display device. For example, when a user voice signal for displaying content A is received, the electronic device (100) transmits a control signal to the remote control device to control the display of content A on the external display device, and the remote control device transmits the received control signal to the external display device. An input interface (140) may be provided in an area of ​​the outer wall surface of the electronic device (100). For example, the input interface (140) may be provided in an area of ​​the front portion of the housing. However, the present disclosure is not limited thereto, and the input interface (140) may be provided at various locations, such as the front and / or side of the housing.

[0076] Meanwhile, the above-described configuration is exemplary, and it is understood that in carrying out the present disclosure, new configurations may be added or some configurations may be omitted in addition to such configurations.

[0077] For example, the electronic device (100) may further include a display (not shown), an output interface (not shown), and a built-in camera (not shown), but is not limited thereto.

[0078] An output interface (not shown) includes a circuit, and the processor (110) can visually or audibly transmit various information related to the electronic device (100) to the user through the output interface (not shown). The output interface (not shown) may include a Liquid Crystal Display (LCD) panel, a Light Emitting Diode (LED) panel, a speaker, etc.

[0079] The display (not shown) may be implemented as a display including a self-emissive element or as a display including a non-emissive element and a backlight. For example, it may be implemented as various types of displays such as an LCD (Liquid Crystal Display), an OLED (Organic Light Emitting Diodes) display, an LED (Light Emitting Diodes), a micro LED, a Mini LED, a PDP (Plasma Display Panel), a QD (Quantum dot) display, and a QLED (Quantum dot light-emitting diodes). The display (not shown) may also include a driving circuit, a backlight unit, etc., which can be implemented in forms such as an a-si TFT, an LTPS (low temperature poly silicon) TFT, or an OTFT (organic TFT). According to one example, the display (not shown) may be implemented as a flat display, a curved display, a folding or / and rolling flexible display, etc.

[0080] According to one embodiment, the electronic device (100) can directly display the acquired image or content on a display (not shown).

[0081] According to one embodiment, the electronic device (100) may not include a display (not shown). The electronic device (100) may be connected to an external display device and may transmit an image or content stored in the electronic device (100) to the external display device.

[0082] The electronic device (100) can transmit an image or content to an external display device along with a control signal for controlling the display of the image or content on the external display device. The external display device may be connected to the electronic device (100) via a communication circuit (130) or an interface. For example, the electronic device (100) may not include a display, such as a Set Top Box (STB).

[0083] The electronic device (100) may include only a small display capable of displaying simple information such as text information. The electronic device (100) may transmit images or content to an external display device via a wired or wireless connection through a communication circuit (130) or to an external display device via an interface.

[0084] The built-in camera (not shown) may refer to a camera included in the electronic device (100). The camera (200) can acquire an image corresponding to the subject by converting light emitted or reflected and transmitted from the subject into an electrical signal using an image sensor. According to one embodiment, the image sensor may include, for example, one image sensor selected from image sensors with different attributes such as an RGB sensor, a BW (black and white) sensor, an IR sensor, or a UV sensor, a plurality of image sensors having the same attribute, or a plurality of image sensors having different attributes.

[0085] FIG. 4 is a diagram illustrating an example of a system that provides notification of the state of an object according to one embodiment.

[0086] Referring to FIG. 4, the electronic device (100) can obtain images of objects (300-1, 300-2, 300-3) located inside the house from the camera (200). For example, the electronic device (100) can receive images from the camera (200) through an input interface (140). However, it is not limited thereto, and the camera (200) may include a camera built into the electronic device (100).

[0087] According to one embodiment, the electronic device (100) may include a TV, but is not limited thereto. For example, the electronic device (100) may include at least one of devices that interact with a user device (e.g., user device (20) of FIG. 1) through a server (e.g., server (10) of FIG. 1, hereinafter referred to as server), such as devices (e.g., devices (31, 32, 33, 34, 35) of FIG. 1). According to one embodiment, the electronic device (100) may include an IoT camera. The IoT camera may include a camera connected to a server (e.g., server (10) of FIG. 1) via a data network.

[0088] According to one embodiment, the objects (300-1, 300-2, 300-3) may include objects that can be registered on an IoT platform. An IoT platform may include a platform for controlling and managing devices (e.g., the devices (31, 32, 33, 34, 35) of FIG. 1) in an IoT system. A server may control or manage devices registered on the IoT platform.

[0089] According to one embodiment, the server may include information regarding the type, function, and attributes of an object for each object. The information regarding the object (e.g., the type, function, and attributes of the object) may be information for defining objects that can be supported by the server. Objects supported by the server may refer to objects that can be registered on an IoT platform. That is, the objects (300-1, 300-2, 300-3) may include objects that can be supported by the server. In the drawings below, the details of transmitting a notification to a user device based on the status information of an object are described in detail.

[0090] FIG. 5a is a flowchart illustrating an example of an operation in which an electronic device provides notifications related to an object based on an image acquired through a camera, according to one embodiment.

[0091] The processor (110) of the electronic device (100) can perform at least one of the operations of FIG. 5a. Instructions stored in the memory (120) of the electronic device (100) can cause the electronic device (100) to perform the operations of FIG. 5a when executed by the processor (110) of the electronic device (100). However, this is not limited thereto, and the operations of FIG. 5a may be divided and performed by a server (e.g., the server (10) of FIG. 1) or the electronic device (100). For example, among the operations of FIG. 5a, "operation A" may be performed by the "electronic device" and "operation B" may be performed by the "server".

[0092] In operation 505 of FIG. 5a, according to one embodiment, the electronic device (100) can acquire an image from a camera (200) through a communication circuit (130). According to one embodiment, the electronic device (100) can acquire an image through a camera (200) connected via an input interface (140). However, it is not limited thereto, and the electronic device (100) can acquire an image based on a camera mounted on the electronic device (100). The image may include an image of a house environment. For example, the image may include objects.

[0093] In operation 510 of FIG. 5a, according to one embodiment, the electronic device (100) can identify whether the image contains a pre-configured object. The pre-configured object may include an object that can be registered as an IoT device on a server including an IoT server. For example, the pre-configured object may include an object that is supported by the IoT server. The pre-configured object may include, for example, a plant, a thermometer, pet-related objects (e.g., potty pad, food bowl, etc.), a window, etc., which are objects that can be registered on an IoT platform. Information regarding the pre-configured objects may be stored in memory (120) at the time of manufacture or initial use of the electronic device (100), or may be periodically updated and changed from a server (e.g., server (10) of FIG. 1). For example, information regarding the pre-configured objects may be stored in memory (120).

[0094] According to one embodiment, an electronic device (100) can input an image into an artificial intelligence model to identify whether there is a preset object. The artificial intelligence model may include a deep learning model trained to identify objects contained in the image.

[0095] For example, an artificial intelligence model may include a model trained using an image as input data and the type of object (or object type) contained in the image as output data. Here, being created through learning may mean that a basic artificial intelligence model is trained using multiple training data by a learning algorithm, thereby creating a predefined behavioral rule or artificial intelligence model configured to perform a desired characteristic (or objective). Such learning may be performed on the device itself where the artificial intelligence according to the present disclosure is executed, or it may be performed through a separate server and / or system. Examples of learning algorithms include supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but are not limited to the examples described above.

[0096] An artificial intelligence model can be composed of multiple neural network layers. Each of the multiple neural network layers has multiple weight values ​​and performs neural network operations through calculations between the results of previous layers and the multiple weights. The multiple weights possessed by the multiple neural network layers can be optimized based on the learning results of the artificial intelligence model. For example, the multiple weights can be updated during the learning process so that the loss or cost values ​​obtained by the artificial intelligence model are reduced or minimized.

[0097] Artificial neural networks may include deep neural networks (DNNs), such as, but are not limited to, Convolutional Neural Networks (CNNs), Deep Neural Networks (DNNs), Recurrent Neural Networks (RNNs), Restricted Boltzmann Machines (RBMs), Deep Belief Networks (DBNs), Bidirectional Recurrent Deep Neural Networks (BRDNNs), Generative Adversarial Networks (GANs), or Deep Q-Networks.

[0098] According to one embodiment, the artificial intelligence model may be implemented in the form of an on-device stored in memory (120), but is not necessarily limited thereto. For example, the artificial intelligence model may be stored in a server (e.g., server (10) of FIG. 1), and the processor (110) may receive information about the type of object included in the image after sending a prompt containing an image to the server.

[0099] In operations 510-Y and 515 of FIG. 5a, according to one embodiment, if an image contains a pre-set object, the electronic device (100) can obtain information corresponding to the object based on the image. The information corresponding to the object may include information about the state of the object. According to one embodiment, the electronic device (100) can obtain information about the state of the object by analyzing a region containing the object using a pre-trained model. The method of analyzing a region containing the object may include various methods such as computer vision, deep learning models, multimodal LLM, etc.

[0100] For example, if the image includes a thermometer, the electronic device (100) can analyze the area containing the thermometer to obtain information about the current temperature (e.g., 7 degrees). For example, if the image includes a pet's food bowl, the electronic device (100) can analyze the area containing the food bowl to determine whether there is enough food or not enough food.

[0101] In operation 520, according to one embodiment, the electronic device (100) can transmit information corresponding to an object and information corresponding to the server registration of the object to a server through a communication circuit. The information corresponding to the server registration of the object may include a signal for registering a sensor for detecting the state of the object to an IoT platform.

[0102] According to one embodiment, information about an object and a sensor corresponding to the object may be stored in memory (120) in the form of mapping information. For example, if the electronic device (100) detects a plant from an image, it may identify a plant sensor; if it detects a potty pad, it may identify a pet sensor; and if it detects a thermometer, it may identify a temperature sensor. The mapping information about the object and the sensor corresponding to the object may be stored in memory (120) at the time of manufacture or initial use of the electronic device (100), or may be periodically updated and changed from a server (e.g., server (10) of FIG. 1).

[0103] A signal for registering a sensor for detecting the state of an object to an IoT platform (or IoT server) may include registration information for identifying the sensor. For example, the registration information may include type information and a sensor ID (identification) corresponding to the sensor for detecting the state of the object. The type of the sensor may include a category of the object for classifying the object according to its role or function. The type of the sensor may include information for identifying the type of sensor, such as a thermometer sensor, a pet sensor, or a plant sensor.

[0104] According to one embodiment, the electronic device (100) can generate a sensor ID corresponding to each object. The sensor ID may include information on a sensor unique identifier (device unique identifier). The electronic device (100) can generate a random ID.

[0105] For example, let us assume a case where an image contains multiple plants (e.g., a first plant, a second plant, a third plant). An electronic device (100) can generate registration information corresponding to each of the multiple plants. For example, the electronic device (100) can generate registration information for the first plant (e.g., type information: plant sensor, sensor ID: first plant), registration information for the second plant (e.g., type information: plant sensor, sensor ID: second plant), and registration information for the third plant (e.g., type information: plant sensor, sensor ID: third plant). The electronic device (100) can transmit the generated registration information to a server (e.g., the server (10) of FIG. 1). Based on the received registration information, the server can register the sensors corresponding to the plants on an IoT platform.

[0106] According to one embodiment, the electronic device (100) can transmit a signal for registering a sensor for detecting the state of an object to an IoT platform (or IoT server) and information corresponding to the object to a server (e.g., server (10) of FIG. 1) through a communication circuit (130).

[0107] In operation 525 of FIG. 5a, according to one embodiment, the electronic device (100) can receive a notification related to information (e.g., the state of an object) corresponding to an object registered on the server through a communication circuit (130). The electronic device (100) can display a notification related to a plant on a display.

[0108] Information corresponding to an object and notifications related to the object corresponding to the information corresponding to the object can be defined in advance on the IoT platform. For example, a server (e.g., server (10) of FIG. 1) can define an object profile that includes the type of the object, the state of the object, and the state of the object. That is, the server can register and manage objects using the object profile. For example, the object profile may include at least one of the type, function, and state of the object.

[0109] According to one embodiment, a server can identify whether a situation requiring notification to a user is necessary based on information corresponding to an object received from an electronic device (100). For example, the server can receive information corresponding to an object from the electronic device (100) (e.g., an image containing an object, status information of an object, etc.). The server can analyze the information corresponding to an object received from the electronic device (100). The server can identify whether a notification to a user is necessary based on the information corresponding to the object. If a notification to a user is necessary, the server can transmit a notification related to the information corresponding to the object to the electronic device (100).

[0110] For example, if the image contains a thermometer, the server can analyze the area containing the thermometer to obtain information about the current temperature (e.g., 7 degrees). In this case, if it is set to provide a notification to the user when the temperature is 5 degrees or higher, the server can identify that a notification needs to be provided to the user. The server can provide a notification about the temperature information through the electronic device (100).

[0111] For example, if the image includes a pet's food bowl, the server can analyze the area containing the food bowl to identify whether there is currently food. In this case, if the system is configured to provide a notification to the user when there is no food in the bowl, the server can identify that a notification needs to be provided to the user. The server can provide a notification to the user containing information about the food shortage status through the electronic device (100).

[0112] However, it is not limited to this, and the electronic device (100) can analyze information corresponding to an object and transmit it to a server. The server can identify whether a notification is required to the user based on information regarding the current temperature received from the electronic device (100).

[0113] For example, if the image includes a thermometer, the electronic device (100) can analyze the area containing the thermometer to obtain information about the current temperature (e.g., 7 degrees). The electronic device (100) can transmit the information about the current temperature (e.g., 7 degrees) to a server. Based on the information about the current temperature received from the electronic device (100), the server can identify whether a notification is required to the user.

[0114] For example, if the image includes a pet's food bowl, the electronic device (100) can analyze the area containing the food bowl to identify whether there is currently food. The electronic device (100) can transmit information corresponding to the food bowl (e.g., whether there is currently food) to a server. Based on the information regarding the food bowl status received from the electronic device (100), the server can identify whether a notification is required to the user.

[0115] According to one embodiment, the electronic device (100) communicates with a server (e.g., server (10) of FIG. 1) through a communication circuit (130) to transmit notifications related to the object to a user device connected to an IoT platform based on information about the state of the object.

[0116] A user device connected to an IoT platform may include a user terminal device (e.g., user device (20) of FIG. 1) for managing and controlling devices (e.g., devices (31, 32, 33, 34, 35) of FIG. 1) by accessing the database of the IoT platform through a user account.

[0117] FIG. 5b is a flowchart illustrating an example of an operation to transmit a notification related to a plant to a user device based on an image acquired through a camera, according to one embodiment.

[0118] The processor (110) of the electronic device (100) can perform at least one of the operations of FIG. 5b. Instructions stored in the memory (120) of the electronic device (100) can cause the electronic device (100) to perform the operations of FIG. 5b when executed by the processor (110) of the electronic device (100). However, this is not limited thereto, and the operations of FIG. 5b may be divided and performed by a server (e.g., the server (10) of FIG. 1) or the electronic device (100). For example, among the operations of FIG. 5b, "operation A" may be performed by the "electronic device" and "operation B" may be performed by the "server".

[0119] In operation 530 of FIG. 5b, according to one embodiment, the electronic device (100) can acquire an image through a camera (200) connected to a communication circuit (130). According to one embodiment, the electronic device (100) can acquire an image through a camera (200) connected via an input interface (140). For example, the image may include plants.

[0120] In operation 535 of FIG. 5b, according to one embodiment, if the electronic device (100) detects that a preset object included in an acquired image corresponds to a plant, it can transmit information corresponding to server registration of a sensor corresponding to the plant to a server (e.g., server (10) of FIG. 1) through a communication circuit (130). The information corresponding to server registration of a sensor corresponding to the plant may include a signal for registering a sensor for the plant to an IoT platform.

[0121] According to one embodiment, when the electronic device (100) identifies that there is a plant in the image, it can transmit a signal to a server (e.g., server (10) of FIG. 1) through a communication circuit (130) to register a sensor for the plant to an IoT platform.

[0122] According to one embodiment, an electronic device (100) can input an image into an artificial intelligence model to identify whether there is a plant. The artificial intelligence model may include a deep learning model trained to identify plants included in the image.

[0123] For example, the artificial intelligence model may include a model trained using an image as input data and the type of plant (or plant type) included in the image as output data. According to one embodiment, the artificial intelligence model may be implemented in the form of an on-device stored in memory (120), but is not necessarily limited thereto. For example, the artificial intelligence model may be stored on a server, and the processor (110) may receive information about the type of plant included in the image after sending a prompt containing the image to the server.

[0124] The signal for registering to a user account may include registration information for the server to identify the plant sensor. For example, the registration information may include type information of the plant sensor (e.g., plant sensor) and a sensor ID (e.g., first plant sensor). The server may register the plant sensor to an IoT platform based on the plant sensor's registration information. For example, the server may manage and control the plant sensor by connecting it to a user account through the IoT platform.

[0125] In operation 540 of FIG. 5b, according to one embodiment, the electronic device (100) can transmit information corresponding to a plant to a server via a communication circuit (130) based on an image acquired through a camera (200). The information corresponding to the plant may include at least one of the plant's sunlight hours, watering cycle, and the condition of the plant organ.

[0126] According to one embodiment, the electronic device (100) can obtain information about the sunlight hours of a plant, the watering cycle, and the condition of a plant organ based on an image obtained using a camera (200).

[0127] Plant daylight hours may refer to the amount of time a plant is exposed to sunlight during the day. Watering cycle may refer to the interval at which water is supplied to the plant. The condition of plant organs may include information regarding the degree of wilting of the plant's vegetative organs (leaves, stems, flowers). The condition of plant organs may include information regarding the state of the plant's vegetative organs, such as withered leaves, dried stems, or fallen flowers, but is not limited to the examples described above.

[0128] According to one embodiment, the electronic device (100) can obtain a notification related to a plant through the plant's status information. The electronic device (100) can transmit the notification related to the plant to a user device through a server.

[0129] The operation for obtaining information on the plant's sunlight hours, watering cycle, and the condition of the plant organs is described in FIGS. 6 to 12.

[0130] In operation 545 of FIG. 5b, according to one embodiment, the electronic device (100) may receive a notification related to a plant based on information corresponding to the plant from a server (e.g., server (10) of FIG. 1) via a communication circuit (130). The electronic device (100) may display the notification related to the plant on a display.

[0131] According to one embodiment, the electronic device (100) communicates with a server through a communication circuit (130) and can transmit a notification related to a plant to a user device (e.g., the user device (20) of FIG. 1) based on acquired information. A description of the notification related to a plant is provided in FIG. 6 through FIG. 12.

[0132] FIG. 6 is a flowchart illustrating an example of an operation in which an electronic device transmits a notification of insufficient sunlight hours to a user device according to one embodiment.

[0133] The processor (110) of the electronic device (100) can perform at least one of the operations of FIG. 6. When the instructions stored in the memory (120) of the electronic device (100) are executed by the processor (110) of the electronic device (100), the electronic device (100) can perform the operations of FIG. 6.

[0134] In operation 610 of FIG. 6, according to one embodiment, the electronic device (100) can extract multiple regions of a plant from images acquired at multiple points in time through a camera (200).

[0135] According to one embodiment, the electronic device (100) can receive images from the camera (200) at a plurality of points in time. For example, the electronic device (100) can receive images at preset time intervals (e.g., 30 minutes).

[0136] According to one embodiment, the electronic device (100) can extract multiple regions of a plant from multiple images. The multiple regions of a plant may include first regions corresponding to the plant, second regions corresponding to the soil in which the plant is planted, and third regions corresponding to at least one of the flower, stem, and leaf of the plant. A detailed description of the operation of extracting multiple regions is described in FIG. 7.

[0137] FIG. 7 is a diagram illustrating an example of an operation in which an electronic device extracts a plurality of regions from an image according to one embodiment.

[0138] Referring to FIG. 7, an electronic device (100) can input an image (710) into an artificial intelligence model (720) to extract (or obtain) multiple regions (730, 740, 750). The electronic device (100) can input the image into the artificial intelligence model (720) to identify whether there is a plant. The artificial intelligence model may include a deep learning model trained to identify multiple regions (730, 740, 750) of a plant included in the image. For example, the artificial intelligence model may include a model trained using an image containing a plant as input data and multiple regions (730, 740, 750) included in the image as output data.

[0139] A plurality of regions (730, 740, 750) may include, for example, a region (730, hereinafter referred to as the first region) corresponding to any one of at least one plant included in the image, a region (740, hereinafter referred to as the second region) corresponding to the soil in which the plant is planted among the first region, and a region (750, hereinafter referred to as the third region) corresponding to at least one of a flower, stem, or leaf among the first region. The electronic device (100) can obtain information about the state of the plant based on the plurality of regions.

[0140] According to one embodiment, an electronic device (100) can transmit information corresponding to a plurality of regions to a server (e.g., server (10) of FIG. 1) through a communication circuit (130). For example, the electronic device (100) can transmit a plurality of regions to the server. The server can analyze the plurality of regions received from the electronic device (100). For example, the electronic device (100) can analyze the plurality of regions to obtain information corresponding to an object. The electronic device (100) can transmit information corresponding to the analyzed object to the server.

[0141] In 620 of FIG. 6, according to one embodiment, an electronic device (100) can obtain information about the sunlight hours of a plant by inputting first regions (e.g., 730 of FIG. 7) into an artificial intelligence model. The artificial intelligence model may include a model learned with the regions corresponding to the plant as input data and the sunlight hours of the plant as output data. For example, the electronic device (100) can use the artificial intelligence model to identify light that has a different range of illumination over time among the light irradiated to a plurality of first regions. Light that has a different range of illumination over time may include, for example, a solar light source. The electronic device (100) can obtain a pattern of light irradiated to the first region. For example, the electronic device (100) can use the artificial intelligence model to identify light irradiated to the first region at a plurality of points in time and identify the time from the first point in time to the second point in time as the sunlight hours. The first point in time may refer to the point in time identified as the first time when light is irradiated to the first region. The second point in time may refer to the point in time when the light irradiated in the first area disappears after the first point in time. For example, if the light is identified as being irradiated for the first time in an image acquired at 7:00 AM and the light being irradiated is identified as disappearing in an image acquired at 6:00 PM, the electronic device (100) can identify the sunlight duration as 11 hours.

[0142] According to one embodiment, an electronic device (100) can obtain sunlight hours based on weather information. For example, the electronic device (100) can obtain sunlight hours based on images obtained on sunny days or days with bright sunlight. For example, the electronic device (100) may not measure sunlight hours on days when it is raining or cloudy. For example, the electronic device (100) can obtain weather information by calling an application programming interface (API) that provides weather services.

[0143] In operation 630 of FIG. 6, according to one embodiment, the electronic device (100) can identify whether the sunlight duration of the plant is less than the minimum sunlight duration.

[0144] According to one embodiment, the electronic device (100) may store information regarding the minimum sunlight hours and minimum watering cycle of a plant corresponding to each type of a plurality of plants in a memory (120). Information regarding the minimum sunlight hours and minimum watering cycle of a plant corresponding to each type of a plurality of plants may be stored in the memory (120) at the time of manufacture or at the time of initial use, but is not limited thereto. For example, information regarding the minimum sunlight hours and minimum watering cycle of a plant corresponding to each type of a plurality of plants may be updated by user input, or updated by a server at any time or periodically.

[0145] For example, the electronic device (100) can store information about the type of plant (e.g., Sanseveria, cactus, lavender, etc.) and the minimum sunlight hours and minimum watering cycle of the plant corresponding to each type (e.g., Sanseveria (minimum sunlight hours: 4 hours, minimum watering cycle: 2 weeks), cactus (minimum sunlight hours: 7 hours, minimum watering cycle: 3 weeks), lavender (minimum sunlight hours: 7 hours, minimum watering cycle: 2 weeks), etc.).

[0146] In operations 630-Y and 640 of FIG. 6, according to one embodiment, if the sunlight hours of a plant are identified as being less than the minimum sunlight hours, the electronic device (100) can communicate with a server through a communication circuit (130) to send a notification of the lack of sunlight hours to a user device.

[0147] Meanwhile, the operation described above in FIG. 6 can be performed on a server (e.g., the server (10) of FIG. 1). According to one embodiment, the electronic device (100) can transmit the first regions to the server through the communication circuit (130). The server can obtain information about the sunlight hours of the plants based on the first regions. Since the operation of obtaining information about the sunlight hours of the plants based on the first regions has been described above, redundant content is omitted. The server, the electronic device (100), can obtain the sunlight hours based on weather information.

[0148] According to one embodiment, the server can identify whether the sunlight duration of a plant is less than the minimum sunlight duration. The server can store information in memory regarding the minimum sunlight duration and minimum watering cycle for each type of plant corresponding to each type of plant. If it is identified that the sunlight duration of a plant is less than the minimum sunlight duration, the server can transmit a notification regarding the insufficient sunlight duration to an electronic device (100) via a communication circuit. The electronic device (100) can display the notification regarding the insufficient sunlight duration on a display.

[0149] FIG. 8a is a drawing illustrating an example of a notification regarding a lack of sunlight hours according to one embodiment.

[0150] Referring to FIG. 8a, according to one embodiment, a server (e.g., server (10) of FIG. 1) can send a notification of insufficient sunlight hours to an electronic device (100) if it is identified that the sunlight hours of a plant are less than the minimum sunlight hours.

[0151] For example, if the sunlight hours of the plant (e.g., 5 hours) are less than the minimum sunlight hours (e.g., 7 hours), the server may provide a notification from the electronic device (100) regarding the type of plant and the lack of sunlight hours.

[0152] The electronic device (100) can display a notification on the display regarding the lack of sunlight hours.

[0153] FIG. 8b is a drawing illustrating an example of a notification regarding a lack of sunlight hours according to one embodiment.

[0154] Referring to FIG. 8, according to one embodiment, if the electronic device (100) identifies that the sunlight duration of a plant is less than the minimum sunlight duration, the electronic device (100) can transmit a notification (810) about the lack of sunlight duration to a user device (800).

[0155] For example, the electronic device (100) can provide a notification (810) on the user device (800) about the type of plant and the lack of sunlight hours when the plant's sunlight hours (e.g., 5 hours) are less than the minimum sunlight hours (e.g., 7 hours).

[0156] The user device (800) can display a notification on the display regarding the lack of sunlight.

[0157] FIG. 9 is a flowchart illustrating an example of an operation in which an electronic device transmits a notification of a water shortage state to a user device according to one embodiment.

[0158] The processor (110) of the electronic device (100) can perform at least one of the operations of FIG. 9. When the instructions stored in the memory (120) of the electronic device (100) are executed by the processor (110) of the electronic device (100), the electronic device (100) can perform the operations of FIG. 9.

[0159] In operation 910 of FIG. 9, according to one embodiment, the electronic device (100) can extract multiple regions of a plant from images acquired at multiple points in time through a camera (200).

[0160] In 920 of FIG. 9, according to one embodiment, an electronic device (100) can obtain information about the watering cycle of a plant by inputting second regions (e.g., 740 of FIG. 7) into an artificial intelligence model. The artificial intelligence model may include a model learned by taking a region corresponding to the soil where the plant is planted as input data and the watering cycle of the plant as output data.

[0161] For example, the electronic device (100) can obtain a watering cycle based on the soil color included in a plurality of second regions using an artificial intelligence model. For example, the electronic device (100) can identify the soil as dry soil if the soil color is light brown or gray, and as soil where watering is completed if the soil color is dark brown. For example, the electronic device (100) can use an artificial intelligence model to identify the time when watering is completed among a plurality of time points, and identify the time interval from the first time point to the second time point as the time of sunlight. The first time point may refer to the time when watering was performed in the second region. The second time point may refer to the time when watering was performed in the second region after the first time point.

[0162] For example, if the first watering is identified as completed in an image acquired at 1:00 PM and the second watering is identified as completed in an image acquired at 6:00 PM, the electronic device (100) can identify the watering cycle as 5 hours.

[0163] In operation 930 of FIG. 9, according to one embodiment, the electronic device (100) can identify whether the watering cycle of the plant is shorter than the minimum cycle time. According to one embodiment, the electronic device (100) can store information about the minimum watering cycle corresponding to the type of plant in memory (120).

[0164] In operations 930-Y and 940 of FIG. 9, according to one embodiment, if the watering cycle of a plant is identified as being shorter than the minimum cycle time, the electronic device (100) can communicate with a server through a communication circuit (130) to send a notification of a water shortage to a user device.

[0165] Meanwhile, the operation described above in FIG. 9 can be performed on a server (e.g., the server (10) of FIG. 1). According to one embodiment, the electronic device (100) can transmit a second area to the server through a communication circuit (130). The server can obtain information about the watering cycle of the plant based on the second area.

[0166] According to one embodiment, the server can identify whether the watering cycle of the plant is shorter than the minimum cycle time. If it is identified that the watering cycle of the plant is shorter than the minimum cycle time, the server can transmit a notification of a water shortage to the electronic device (100) via a communication circuit. The electronic device (100) can display the notification of the water shortage on a display.

[0167] FIG. 10a is a drawing illustrating an example of a notification regarding a water shortage condition according to one embodiment.

[0168] Referring to FIG. 10a, according to one embodiment, a server (e.g., server (10) of FIG. 1) can send a notification of insufficient sunlight hours to an electronic device (100) if it is identified that the sunlight hours of a plant are less than the minimum sunlight hours.

[0169] For example, if the server identifies that the watering cycle of the plant is shorter than the minimum cycle time, it can provide a notification of the water shortage from the electronic device (100).

[0170] The electronic device (100) can display a notification of a water shortage on the display.

[0171] FIG. 10b is a drawing illustrating an example of a notification regarding a water shortage condition according to one embodiment.

[0172] Referring to FIG. 10b, according to one embodiment, if the electronic device (100) identifies that the watering cycle of a plant is shorter than the minimum cycle time, the electronic device (100) can transmit a notification (1010) about the watering cycle shortage to a user device (1000).

[0173] For example, the electronic device (100) can provide a notification (1010) on the user device (1000) about the type of plant (e.g., second plant) and the lack of watering cycle when the plant's watering cycle (e.g., 5 hours) is shorter than the minimum cycle time (e.g., 8 hours).

[0174] The user device (1000) can display a notification (1010) on the display regarding the shortage of the water supply cycle.

[0175] FIG. 11 is a flowchart illustrating an example of an operation in which an electronic device transmits a notification about the condition of a plant organ to a user device, according to one embodiment.

[0176] The processor (110) of the electronic device (100) can perform at least one of the operations of FIG. 11. When the instructions stored in the memory (120) of the electronic device (100) are executed by the processor (110) of the electronic device (100), the electronic device (100) can perform the operations of FIG. 11.

[0177] In operation 1110 of FIG. 11, according to one embodiment, the electronic device (100) can extract multiple regions of a plant from images acquired at multiple points in time through a camera (200).

[0178] In 1120 of FIG. 11, according to one embodiment, an electronic device (100) can obtain information about the state of a plant organ by inputting second regions (e.g., 750 of FIG. 7) into an artificial intelligence model. The artificial intelligence model may include a model learned by taking regions corresponding to the plant organ as input data and the state of the plant organ as output data.

[0179] For example, the electronic device (100) can identify the condition of plant organs included in third regions using an artificial intelligence model. For example, the electronic device (100) can identify the condition of plant organs by analyzing the color and texture of plant organs using an artificial intelligence model.

[0180] For example, the electronic device (100) can identify a leaf or stem in a good state if it is identified as having a green and uniform color using an artificial intelligence model, and a withered state if it is identified as having a yellow or brown discoloration using an artificial intelligence model. For example, the electronic device (100) can identify a flower in a good state if it is identified as having a vivid color using an artificial intelligence model, and a withered state if it is identified as having a faded color or discolored to brown.

[0181] For example, the electronic device (100) can use an artificial intelligence model to identify the surface of a leaf, stem, or flower as being in good condition if it is identified as smooth and glossy, and as being withered if it is identified as wrinkled or dry.

[0182] In operation 1130 of FIG. 11, according to one embodiment, the electronic device (100) can identify whether the state of a plant organ has been identified as a specific state (e.g., withered state).

[0183] In operations 1130-Y and 1140 of FIG. 11, according to one embodiment, when the state of a plant organ is identified as a specific state, the electronic device (100) can communicate with a server through a communication circuit (130) to transmit a notification about the state of the plant organ to a user device.

[0184] Meanwhile, the operation described above in FIG. 11 can be performed on a server (e.g., the server (10) of FIG. 1). According to one embodiment, the electronic device (100) can transmit a third region to the server via a communication circuit (130). The server can obtain information about the state of a plant organ based on the third region.

[0185] According to one embodiment, the server can transmit a notification about the state of the plant organ to the electronic device (100) based on the state of the plant organ. The electronic device (100) can display the notification about the state of the plant organ on a display.

[0186] FIG. 12a is a drawing illustrating an example of a notification of the condition of a plant organ according to one embodiment.

[0187] Referring to FIG. 12a, according to one embodiment, a server (e.g., server (10) of FIG. 1) can transmit a notification corresponding to the state of the plant organ to an electronic device (100) when the state of the plant organ is identified as a preset state.

[0188] For example, if the server identifies that the leaves of a plant are withered, it may cause the electronic device (100) to provide a notification regarding the type of plant (e.g., the first plant) and the condition of the plant organ. The electronic device (100) may display a notification on the display regarding the lack of sunlight.

[0189] FIG. 12b is a drawing illustrating an example of a notification regarding the condition of a plant organ according to one embodiment.

[0190] Referring to FIG. 12b, according to one embodiment, if the condition of a plant organ is identified as wilted, the electronic device (100) can transmit a notification (1210) about the condition of the plant organ to a user device (1200).

[0191] For example, if the electronic device (100) identifies that the leaves of a plant are withered, it may enable the user device (1200) to provide a notification (1210) regarding the type of plant (e.g., the first plant) and the condition of the plant organ. The user device may display the notification (1210) regarding the condition of the plant organ on a display.

[0192] FIG. 13 is a diagram illustrating an example of an operation to register a plant sensor to a user account according to one embodiment.

[0193] According to one embodiment, the electronic device (100) can transmit registration information of a plant sensor to a server. The server can register the plant sensor to an IoT platform based on the registration information of the plant sensor. When a user logs into a user account using an application installed on a user device, the user device can display the plant sensor registered to the user account on the display of the user device. The user can input input to the application to control or manage the plant sensor through the user device.

[0194] FIG. 14 is a diagram illustrating an example of an operation in which a user device provides information regarding the state of a plant to a user through an application, according to one embodiment.

[0195] According to one embodiment in 1401 of FIG. 14, a user device may receive user input for controlling or managing a plant sensor. According to one embodiment in 1402 of FIG. 14, when user input for controlling or managing a plant sensor is received, the user device may display a real-time image (1420) of a plant located at home and notification history information (1430) about the plant on a display. The user device may receive the real-time image (1420) of the plant from a server. The electronic device (100) may receive the real-time image of the plant from a camera (200) and transmit it to a server.

[0196] FIG. 15 is a diagram illustrating an example of an operation to generate a pet sensor based on an image according to one embodiment.

[0197] In 1501 of FIG. 15, according to one embodiment, an electronic device (100) can acquire an image through a camera (200). The electronic device (100) can identify objects (e.g., a pet's food bowl, a potty pad) from the image. According to one embodiment, when objects (e.g., a pet's food bowl, a potty pad) are identified, the electronic device (100) can transmit a signal to a server (e.g., the server (10) of FIG. 1) through a communication circuit (130) to register the pet sensor to an IoT platform.

[0198] According to one embodiment, the electronic device (100) can extract areas for objects (e.g., area for a pet's food bowl (1505), area for a potty pad (1510)) from images acquired at multiple points in time through a camera (200).

[0199] According to one embodiment, the electronic device (100) can receive images from the camera (200) at a plurality of points in time. For example, the electronic device (100) can receive images at preset time intervals (e.g., 30 minutes).

[0200] In 1502 of FIG. 15, according to one embodiment, an electronic device (100) can identify the state of an object based on an area (1520) of an object (e.g., a pet's food bowl) included in an image. For example, the electronic device (100) can input the object area (1520) into an artificial intelligence model to obtain information about the state of the object (e.g., the state where the food in the bowl is empty, the state where the food in the bowl is full).

[0201] In 1503 of FIG. 15, according to one embodiment, an electronic device (100) may transmit a notification (1530) related to an object to a user device (1500) based on information about the state of the object. For example, the electronic device (100) may cause an alarm (1530) corresponding to the first state (e.g., "The food is out of stock") to be displayed on the user device (1500) based on the fact that the object is identified as being in a first state (e.g., the food in the bowl is empty). For example, the electronic device (100) may cause an alarm (1530) corresponding to the second state (e.g., "The food is full") to be displayed on the user device (1500) based on the fact that the object is identified as being in a second state (e.g., the food in the bowl is full). Meanwhile, the state of an object and the corresponding alarm are not limited to the examples described above. In 1504 of FIG. 15, according to one embodiment, an electronic device (100) can identify the state of an object based on an object area (1540) included in an image (e.g., a pee pad). For example, the electronic device (100) can input the object area (1540) into an artificial intelligence model to obtain information about the state of the object (e.g., the pee pad is contaminated, the pee pad is not contaminated).

[0202] In 1505 of FIG. 15, according to one embodiment, an electronic device (100) may transmit a notification (1550) related to an object to a user device (1500) based on information about the state of the object. For example, the electronic device (100) may cause an alarm (1550) corresponding to the first state (e.g., "Please change the pee pad") to be displayed on the user device (1500) based on the fact that the object is identified as being in a first state (e.g., the pee pad is contaminated). For example, the electronic device (100) may cause an alarm (1550) corresponding to the second state (e.g., "The pee pad is not used") to be displayed on the user device (1500) based on the fact that the object is identified as being in a second state (e.g., the pee pad is not contaminated). Meanwhile, the state of the object and the alarm corresponding thereto are not limited to the examples described above.

[0203] FIG. 16 is a drawing for explaining an example of a pet sensor registered to a user account according to one embodiment.

[0204] In 1601 of FIG. 16, according to one embodiment, if objects corresponding to the pet sensor (1610) (e.g., a potty pad, a pet's food bowl) are identified in an image, the electronic device (100) may transmit registration information for registering the pet sensor (1610) to a server (e.g., the server (10) of FIG. 1). The server may register the pet sensor to an IoT platform based on the registration information of the pet sensor (1610). When a user logs into a user account connected to the IoT platform using an application installed on a user device (e.g., the user device (20) of FIG. 1), the user device may display the pet sensor (1610) registered to the user account on the display of the user device. The user may input input to the application to control or manage the pet sensor (1610) through the user device.

[0205] In operation 1602 of FIG. 16, according to one embodiment, when the electronic device (100) receives user input for controlling or managing the pet sensor, the user device may display on the display real-time images (1620) of objects located at home (e.g., potty pad, pet food bowl) and notification history information (1630) for the pet sensor (e.g., "The food is out of stock," "Please change the potty pad..."). The user device may receive real-time images (1620) of the objects from a server. The electronic device (100) may receive real-time images of the objects from a camera (200) and transmit them to a server.

[0206] FIG. 17 is a diagram illustrating an example of an operation to generate a temperature sensor based on an image according to one embodiment.

[0207] In 1701 of FIG. 17, according to one embodiment, an electronic device (100) can acquire an image through a camera (200). The electronic device (100) can identify an object (e.g., a thermometer) from the image. According to one embodiment, when an object (e.g., a thermometer) is identified, the electronic device (100) can transmit a signal to a server (e.g., the server (10) of FIG. 1) through a communication circuit (130) to register the temperature sensor to an IoT platform.

[0208] According to one embodiment, the electronic device (100) can extract areas of objects (e.g., areas including a thermometer (1710)) from images acquired at multiple points in time through a camera (200).

[0209] According to one embodiment, the electronic device (100) can receive images from the camera (200) at a plurality of points in time. For example, the electronic device (100) can receive images at preset time intervals (e.g., 30 minutes).

[0210] In 1702 of FIG. 17, according to one embodiment, an electronic device (100) can identify the state of an object (e.g., current temperature) based on an object region (1720) included in an image (e.g., thermometer). The electronic device (100) can input the object region (1720) into an artificial intelligence model to obtain information about the state of the object (e.g., the state of the food in the bowl running out, the state of the food in the bowl being full).

[0211] In 1703 of FIG. 17, according to one embodiment, an electronic device (100) may transmit a notification (1530) related to an object to a user device (1500) based on information about the state of the object. For example, the electronic device (100) may cause an alarm (1730) corresponding to the first state (e.g., "The current temperature is 5 degrees") to be displayed on the user device (1500) based on the fact that the object is identified as being in a first state (e.g., 5 degrees). Meanwhile, the state of the object and the alarm corresponding thereto are not limited to the examples described above.

[0212] In 1704 of FIG. 17, according to one embodiment, an electronic device (100) can identify the state of an object based on an object region (1740) included in an image (e.g., a thermometer). For example, the electronic device (100) can input the object region (1740) into an artificial intelligence model to obtain information about the state of the object (e.g., minus 7 degrees).

[0213] In 1705 of FIG. 17, according to one embodiment, an electronic device (100) may transmit a notification (1750) related to an object to a user device (1700) based on information about the state of the object. For example, the electronic device (100) may cause an alarm (1730) corresponding to the first state (e.g., "The current temperature is minus 7 degrees") to be displayed on the user device (1700) based on the fact that the object is identified as being in a first state (e.g., minus 7 degrees). Meanwhile, the state of the object and the alarm corresponding thereto are not limited to the examples described above.

[0214] FIG. 18 is a diagram illustrating an example of a temperature sensor registered to a user account according to one embodiment.

[0215] In 1801 of FIG. 18, according to one embodiment, if an object (e.g., a thermometer) corresponding to the temperature sensor (1810) is identified in an image, the electronic device (100) may transmit registration information for registering the temperature sensor (1810) to a server (e.g., the server (10) of FIG. 1). The server may register the temperature sensor to an IoT platform based on the registration information of the temperature sensor (1810). When a user logs into a user account connected to the IoT platform using an application installed on a user device (e.g., the user device (20) of FIG. 1), the user device may display the temperature sensor (1810) registered to the user account on the display of the user device. The user may input input to the application to control or manage the pet sensor (1810) through the user device.

[0216] In operation 1802 of FIG. 18, according to one embodiment, when the electronic device (100) receives user input for controlling or managing a temperature sensor, the user device may display a real-time image (1820) of an object located in the house (e.g., a thermometer) and notification history information (1830) for the temperature sensor (e.g., "15:30 the temperature is 5 degrees.", "21:30 the temperature is minus 7 degrees.") on a display. The user device may receive the real-time image (1820) of the object from a server. The electronic device (100) may receive the real-time image of the object from a camera (200) and transmit it to a server.

[0217] The technical problems to be solved in this disclosure are not limited to those mentioned above, and other technical problems not mentioned will be clearly understood by those skilled in the art to which this disclosure belongs.

[0218] According to one embodiment of the present disclosure, an electronic device may be provided. The electronic device may include at least one processor comprising a communication circuit, an input interface, a memory for storing instructions, and a processing circuitry.

[0219] For example, when the above instructions are executed individually or collectively by the at least one processor, the electronic device may acquire an image through a camera connected via the input interface, and if it is identified that the image contains a pre-configured object, transmit a signal to a server via the communication circuit to register a sensor for detecting the state of the object to an IoT platform, acquire information about the state of the object based on the image acquired via the camera, and communicate with the server via the communication circuit to transmit a notification related to the object to a user device connected to the IoT platform based on the information about the state of the object.

[0220] For example, the memory can store information about the object and the type of sensor corresponding to the object.

[0221]

[0222] For example, when the above instructions are executed individually or collectively by the at least one processor, the electronic device may identify the type of sensor corresponding to the object based on identifying the object from the image, and transmit a signal to the server for registering the sensor, including the type of the sensor and the sensor ID (identification), to an IoT platform.

[0223] For example, the above-mentioned configured object may include an object that can be registered on the IoT platform.

[0224] For example, when the above instructions are executed individually or collectively by the at least one processor, the electronic device may transmit a signal to a server via the communication circuit to register a sensor for the plant to an IoT platform when the object is identified as a plant, obtain information regarding the plant's daylight hours, watering cycle, and the condition of the plant organ based on an image obtained through the camera, and communicate with the server via the communication circuit to transmit a notification related to the plant to the user device based on the obtained information.

[0225] For example, when the above instructions are executed individually or collectively by the at least one processor, the electronic device may be able to extract multiple regions of the plant from images acquired at multiple points in time through the camera.

[0226] For example, the plurality of regions may include first regions corresponding to the plant in the images, second regions corresponding to the soil in which the plant is planted, and third regions corresponding to at least one of the flower, stem, and leaf of the plant.

[0227] For example, the memory can store information regarding the minimum sunlight hours and minimum watering cycles for each type of plant corresponding to a plurality of plant types.

[0228] For example, when the above instructions are executed individually or collectively by the at least one processor, the electronic device may input the first regions into an artificial intelligence model to obtain information regarding the sunlight hours of the plant, obtain a minimum sunlight hour corresponding to the type of the plant based on the information stored in the memory, and if the sunlight hours of the plant are identified as being less than the minimum sunlight hour, communicate with the server through the communication circuit to transmit a notification regarding the insufficient sunlight hours to the user device.

[0229] For example, when the above instructions are executed individually or collectively by the at least one processor, the electronic device may input the second regions into an artificial intelligence model to obtain information regarding the watering cycle of the plant, and if it is identified that the watering cycle of the plant is shorter than the minimum cycle time, communicate with the server through the communication circuit to transmit a notification regarding the water shortage status to the user device.

[0230] For example, when the above instructions are executed individually or collectively by the at least one processor, the electronic device may input the third regions into an artificial intelligence model to obtain information about the state of the plant organ, and if the state of the plant organ is identified as a first state, communicate with the server through the communication circuit to transmit a notification about the state of the plant organ to the user device.

[0231] For example, an interface screen displayed on the user device based on information provided by the server may include an image acquired through the camera and notification history information regarding the plant.

[0232] According to one embodiment of the present disclosure, a method for controlling an electronic device may be provided.

[0233] For example, the control method may include the steps of: acquiring an image; if the image is identified as containing a pre-set object, transmitting a signal to a server to register a sensor for detecting the state of the object to an IoT platform; acquiring information about the state of the object based on the image; and communicating with the server to transmit a notification related to the object to a user device connected to the IoT platform based on the information about the state of the object.

[0234] For example, the step of transmitting a signal to a server to register a sensor for detecting the state of the object to an IoT platform may include the step of identifying the type of sensor corresponding to the object based on identifying the object from the image, and the step of transmitting a signal to the server to register the sensor to an IoT platform, including the type of the sensor and the sensor ID (identification).

[0235] For example, the above-mentioned configured object may include an object that can be registered on the IoT platform.

[0236] For example, the control method may further include the steps of: transmitting a signal to a server to register a sensor for the plant to an IoT platform when the object is identified as a plant; obtaining information regarding the plant's sunlight hours, watering cycle, and the condition of the plant organ based on the image; and communicating with the server to transmit a notification related to the plant to the user device based on the obtained information.

[0237] For example, the control method may further include the step of extracting multiple regions of the plant from images acquired at multiple points in time.

[0238] For example, the plurality of regions may include first regions corresponding to the plant in the images, second regions corresponding to the soil in which the plant is planted, and third regions corresponding to at least one of the flower, stem, and leaf of the plant.

[0239] For example, information regarding the minimum sunlight hours and minimum watering cycles for each type of plant corresponding to a plurality of plant types can be stored in the memory included in the electronic device.

[0240] For example, the step of transmitting a notification related to the above-mentioned plant to a user device corresponding to the above-mentioned user account comprises: inputting the above-mentioned first regions into an artificial intelligence model to obtain information regarding the sunlight hours of the above-mentioned plant; obtaining a minimum sunlight hours corresponding to the type of the above-mentioned plant based on the information stored in the memory; and

[0241] If it is identified that the sunlight duration of the above plant is less than the minimum sunlight duration, the method may include the step of communicating with the server through the communication circuit to transmit a notification regarding the insufficient sunlight duration to the user device.

[0242] For example, the step of transmitting a notification related to the plant to a user device corresponding to the user account may include the step of inputting the second areas into an artificial intelligence model to obtain information regarding the watering cycle of the plant, and if the watering cycle of the plant is identified as being shorter than the minimum cycle time, communicating with the server through the communication circuit to transmit a notification regarding the water shortage status to the user device.

[0243] For example, the step of transmitting a notification related to the plant to a user device corresponding to the user account may include the step of inputting the third areas into an artificial intelligence model to obtain information about the state of the plant organ, and, if the state of the plant organ is identified as a first state, communicating with the server through the communication circuit to transmit a notification about the state of the plant organ to the user device.

[0244] For example, an interface screen displayed on the user device based on information provided by the server may include an image acquired through the camera and notification history information regarding the plant.

[0245] An electronic device according to the present disclosure comprises at least one processor including a communication circuit, a memory for storing instructions, and a processing circuitry, wherein when the instructions are executed individually or collectively by the at least one processor, the electronic device may acquire an image through a camera connected to the communication circuit, and if the acquired image contains a pre-set object, acquire information corresponding to the object based on the image, transmit information corresponding to the object and information corresponding to server registration of the object to the server through the communication circuit, and receive a notification related to information corresponding to the object registered on the server from the server through the communication circuit.

[0246] In this case, when the instructions are executed individually or collectively by the at least one processor, the electronic device may identify the type of sensor corresponding to the pre-set object when the acquired image contains the pre-set object, and transmit information including the type and ID (identification) of the sensor to the server through the communication circuit to register the information to the server.

[0247] Meanwhile, the above-mentioned configured object may include an object that can be registered as an IoT device to the server including the IoT server.

[0248] Meanwhile, when the above instructions are executed individually or collectively by the at least one processor, the electronic device may transmit information corresponding to the server registration of a sensor corresponding to the plant through the communication circuit to the server when a preset object included in the acquired image corresponds to a plant, transmit information corresponding to the plant, including at least one of the plant's sunlight hours, watering cycle, and the state of the plant organ, through the communication circuit to the server based on the image acquired through the camera, and receive a notification related to the plant based on the information corresponding to the plant from the server through the communication circuit.

[0249] In this case, when the instructions are executed individually or collectively by the at least one processor, the electronic device acquires multiple regions of the plant in images acquired at multiple points in time through the camera, and the multiple regions may include first regions corresponding to the plant in the images, second regions corresponding to the soil in which the plant is planted, and third regions corresponding to at least one of the flower, stem, and leaf of the plant.

[0250] In this case, when the instructions are executed individually or collectively by the at least one processor, the electronic device may transmit information corresponding to the acquired plurality of regions to the server through the communication circuit.

[0251] Meanwhile, when the above instructions are executed individually or collectively by the at least one processor, the electronic device may receive a notification from the server via the communication circuit that corresponds to the state of insufficient sunlight hours if the sunlight hours of the plant obtained through an artificial intelligence model based on the first regions are less than the minimum sunlight hours corresponding to the type of the plant.

[0252] Meanwhile, when the above instructions are executed individually or collectively by the at least one processor, the electronic device may receive a notification corresponding to the water shortage state from the server through the communication circuit if the watering cycle of the plant obtained through an artificial intelligence model based on the second regions is shorter than the minimum cycle time corresponding to the type of the plant.

[0253] Meanwhile, when the above instructions are executed individually or collectively by the at least one processor, the electronic device may receive a notification corresponding to the state of the plant organ from the server through the communication circuit if the state of the plant organ obtained through an artificial intelligence model based on the third regions corresponds to the first state.

[0254] In this case, when the instructions are executed individually or collectively by the at least one processor, the electronic device may receive, through the communication circuit, a notification related to the information corresponding to the object from the server that has registered information corresponding to the pre-set object included in the image based on the image acquired by the camera.

[0255] Although various embodiments have been described above, each embodiment is not necessarily implemented individually, and may be combined with at least one other embodiment, either wholly or partially, to be implemented together in a single product.

[0256] Meanwhile, embodiments of the present disclosure may also be implemented in the form of a recording medium containing computer-executable instructions, such as program modules executed by a computer. A computer-readable medium may be any available medium accessible by a computer and includes both volatile and non-volatile media, and both removable and non-removable media. Additionally, a computer-readable medium may include computer storage media and communication media. Computer storage media include both volatile and non-volatile, removable and non-removable media implemented by any method or technique for storing information, such as computer-readable instructions, data structures, program modules, or other data. Communication media may typically include other data of modulated data signals, such as computer-readable instructions, data structures, or program modules.

[0257] Additionally, computer-readable storage media may be provided in the form of non-transitory storage media. Here, 'non-transitory storage media' simply means that it is a tangible device and does not contain a signal (e.g., electromagnetic waves), and this term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily. For example, 'non-transitory storage media' may include a buffer in which data is stored temporarily.

[0258] According to one embodiment, the method according to the various embodiments disclosed herein may be provided by being included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or distributed online (e.g., download or upload) through an application store or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product (e.g., downloadable app) may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0259] The foregoing description of the present disclosure is for illustrative purposes only, and those skilled in the art will understand that other specific forms can be easily modified without altering the technical spirit or essential features of the present disclosure. Therefore, the embodiments described above should be understood as illustrative in all respects and not restrictive. For example, each component described as a single unit may be implemented in a distributed manner, and components described as distributed may likewise be implemented in a combined form.

[0260] The scope of the present disclosure is defined by the claims set forth below rather than by the detailed description above, and all modifications or variations derived from the meaning and scope of the claims and equivalent concepts thereof should be interpreted as being included within the scope of the present disclosure.

Claims

1. In an electronic device, Communication circuit; Memory for storing instructions; and at least one processor including processing circuitry; and When the above instructions are executed individually or collectively by the at least one processor, the electronic device, An image is acquired through a camera connected via the above communication circuit, and If the above-mentioned acquired image includes a pre-set object, information corresponding to the object is acquired based on the above-mentioned image, and Information corresponding to the above object and information corresponding to the server registration of the above object are transmitted to the server through the communication circuit, and An electronic device that receives notifications related to information corresponding to the object registered on the server through the communication circuit from the server.

2. In Paragraph 1, When the above instructions are executed individually or collectively by the at least one processor, the electronic device, If the above-mentioned acquired image includes a pre-configured object, the type of sensor corresponding to the pre-configured object is identified, and An electronic device that transmits information including the type and ID (identification) of the sensor to the server via the communication circuit in order to register it on the server.

3. In Paragraph 1, The above-mentioned configured object is an electronic device comprising an object that can be registered as an IoT device to the said server including an IoT server.

4. In Paragraph 1, When the above instructions are executed individually or collectively by the at least one processor, the electronic device, If a pre-configured object included in the above-mentioned acquired image corresponds to a plant, information corresponding to the server registration of the sensor corresponding to the plant is transmitted to the server through the communication circuit, and Based on an image acquired through the camera, information corresponding to the plant, including at least one of the plant's sunlight hours, watering cycle, and the state of the plant organ, is transmitted to the server through the communication circuit. An electronic device that receives notifications related to the plant based on information corresponding to the plant from the server through the communication circuit.

5. In Paragraph 4, When the above instructions are executed individually or collectively by the at least one processor, the electronic device, Multiple regions of the plant are obtained from images acquired at multiple viewpoints through the camera, and The above plurality of regions are, An electronic device comprising, in the above images, first regions corresponding to the plant, second regions corresponding to the soil in which the plant is planted, and third regions corresponding to at least one of the flower, stem, and leaf of the plant.

6. In Paragraph 5, When the above instructions are executed individually or collectively by the at least one processor, the electronic device, An electronic device that transmits information corresponding to the plurality of areas acquired above to the server through the communication circuit.

7. In Paragraph 5, When the above instructions are executed individually or collectively by the at least one processor, the electronic device, An electronic device that receives a notification from the server via the communication circuit, if the sunlight duration of the plant obtained through an artificial intelligence model based on the first regions above is less than the minimum sunlight duration corresponding to the type of the plant.

8. In Paragraph 5, When the above instructions are executed individually or collectively by the at least one processor, the electronic device, An electronic device that receives a notification corresponding to the water shortage state from the server through the communication circuit when the watering cycle of the plant obtained through an artificial intelligence model based on the second regions above is shorter than the minimum cycle time corresponding to the type of the plant.

9. In Paragraph 5, When the above instructions are executed individually or collectively by the at least one processor, the electronic device, An electronic device that receives a notification corresponding to the state of the plant organ from the server through the communication circuit when the state of the plant organ obtained through an artificial intelligence model based on the third regions above corresponds to the first state.

10. In Paragraph 1, When the above instructions are executed individually or collectively by the at least one processor, the electronic device, An electronic device that receives, through the communication circuit, a notification related to the information corresponding to the object from the server that has registered information corresponding to a preset object included in the image based on an image acquired by the camera.

11. In a method for controlling an electronic device, A step of acquiring an image through a camera connected via a communication circuit; If the acquired image includes a pre-set object, a step of acquiring information corresponding to the object based on the image; A step of transmitting information corresponding to the object and information corresponding to the server registration of the object to the server through the communication circuit; and A control method comprising the step of receiving from the server, through the communication circuit, a notification related to information corresponding to the object registered on the server.

12. In Paragraph 11, The step of transmitting information corresponding to the object and information corresponding to the server registration of the object to the server through the communication circuit is: If the acquired image includes a pre-set object, a step of identifying the type of sensor corresponding to the pre-set object; and A control method comprising the step of transmitting information including the type and ID (identification) of the sensor to the server through the communication circuit to register the information to the server.

13. In Paragraph 11, A control method wherein the object configured above includes an object that can be registered as an IoT device to the server including the IoT server.

14. In Paragraph 11, If a preset object included in the above-mentioned acquired image corresponds to a plant, a step of transmitting information corresponding to the server registration of a sensor corresponding to the plant to the server through the communication circuit; Based on an image acquired through the camera, the step of transmitting information corresponding to the plant, including at least one of the plant's sunlight duration, watering cycle, and the state of the plant organ, to the server through the communication circuit; and A control method further comprising the step of receiving a notification related to the plant based on information corresponding to the plant from the server through the communication circuit.

15. In Paragraph 14, The step of transmitting information corresponding to the above plant to the server through the communication circuit is: The method includes the step of acquiring multiple regions of the plant from images acquired at multiple viewpoints through the camera; The above plurality of regions are, A control method comprising, in the above images, first regions corresponding to the plant, second regions corresponding to the soil in which the plant is planted, and third regions corresponding to at least one of the flower, stem, and leaf of the plant.

Images