Electronic device for operating external device in low-power state by using usage pattern information, and control method therefor

Abstract

An electronic device is disclosed. The electronic device comprises: a communication interface including a communication circuit; a memory for storing usage pattern information corresponding to each of multiple users; and one or more processors each including a processing circuit, wherein the one or more processors are individually or collectively configured to: identify whether each of the multiple users is absent or present in a specific area on the basis of a specific condition; and control the communication interface to transmit, to a first external device among multiple external devices, a control command for operating the first external device in a low-power state on the basis of first usage pattern information corresponding to a first user identified as absent in the specific area among the multiple users.

Description

Electronic device for operating an external device in a low-power state using usage pattern information and a control method thereof

[0001] The present invention relates to an electronic device and a control method thereof, and as an embodiment, to an electronic device that operates in a low power state using usage pattern information and a control method thereof.

[0002] Recently, home appliances for various purposes have been developed, and the number of appliances installed in homes is also increasing. As the number of appliances in the home increases, so too does the demand for efficient methods to manage total power consumption.

[0003] Although there have been various power consumption management methods in the past, there was the inconvenience of having to manually activate the power consumption reduction state or input a command to activate the low power state for each home appliance.

[0004] A power consumption management method that activates a low power state when a specific condition is satisfied (for example, during a specific time) has a problem in that the low power state may be activated only by considering whether the specific condition is satisfied even while the user is using the home appliance.

[0005] In order to efficiently manage total power consumption in a home, there has been a demand for a method to selectively activate low power states among multiple home appliances installed in a home, taking into account the user's usage patterns of the appliances.

[0006] An electronic device according to an embodiment of the present disclosure comprises a communication interface including a communication circuit, a memory storing usage pattern information corresponding to each of a plurality of users, and at least one processor including a processing circuit, wherein individually or collectively, at least one processor is configured to control the communication interface to identify whether each of the plurality of users is absent from a specific area based on a specific condition, and to transmit a control command for operating a first external device among a plurality of external devices in a low power state to the first external device based on first usage pattern information corresponding to a first user among the plurality of users identified as being absent from the specific area.

[0007] A method for controlling an electronic device according to an embodiment of the present disclosure includes a step of identifying whether each of a plurality of users is absent from a specific area based on a specific condition, and a step of transmitting a control command for operating a first external device among a plurality of external devices in a low power state to the first external device based on first usage pattern information corresponding to a first user identified as being absent from the specific area among the plurality of users.

[0008] According to an embodiment of the present disclosure, a nonvolatile computer-readable recording medium having recorded thereon a program that, when executed by at least one processor of an electronic device, causes the electronic device to perform a method of controlling the electronic device, the method comprising: identifying whether each of a plurality of users is absent from a specific area based on a specific condition; and transmitting a control command for operating a first external device among a plurality of external devices in a low power state to the first external device based on first usage pattern information corresponding to a first user identified as being absent from the specific area among the plurality of users.

[0009] The above and other aspects, features and advantages of specific embodiments of the present disclosure will become more apparent with reference to the accompanying drawings together with the detailed description thereof:

[0010] FIG. 1 is a drawing illustrating a plurality of external devices located in a home according to various embodiments.

[0011] FIG. 2 is a block diagram illustrating an example configuration of an electronic device according to various embodiments.

[0012] FIG. 3 is a diagram illustrating multiple users according to various embodiments.

[0013] FIG. 4 is a drawing for explaining an external device that identifies a user using an external device according to various embodiments.

[0014] FIG. 5 is a drawing for explaining an external device that identifies a user using an external device according to various embodiments.

[0015] FIG. 6 is a diagram for explaining the absence of a first user and a first usage pattern corresponding to the first user according to various embodiments.

[0016] FIG. 7 is a diagram for explaining the absence of a second user and a second usage pattern corresponding to the second user according to various embodiments.

[0017] FIG. 8 is a drawing for explaining an exemplary operation of one of a plurality of external devices located in a home according to various embodiments.

[0018] FIG. 9 is a diagram illustrating an external device for identifying the absence of a user according to various embodiments.

[0019] Figure 10 is a drawing for explaining preset conditions according to various embodiments.

[0020] FIG. 11 is a flowchart illustrating an exemplary control method of an electronic device according to various embodiments.

[0021] Hereinafter, the present disclosure will be described in more detail with reference to the attached drawings.

[0022] The terms used in the various embodiments of this disclosure have been selected from widely used, current terms, taking into account the functions of this disclosure. However, these terms may vary depending on the intentions of those skilled in the art, precedents, the emergence of new technologies, etc. Furthermore, in certain cases, the applicant may arbitrarily select terms, and in such cases, their meanings will be described in detail in the description of the relevant disclosure. Therefore, the terms used in this disclosure should not be defined simply as names of terms, but rather based on the meanings of the terms and the overall content of this disclosure.

[0023] In this specification, expressions such as “has,” “can have,” “includes,” or “may include” indicate the presence of a feature (e.g., a number, function, operation, or component such as a part), and do not exclude the presence of additional features.

[0024] The expression "at least one of A and / or B" should be understood to mean either "A" or "B" or "A and B".

[0025] As used herein, the expressions “first,” “second,” “first,” or “second,” etc., may describe various components, regardless of order and / or importance, and are only used to distinguish one component from another, but do not limit the components.

[0026] When it is said that a component (e.g., a first component) is “(operatively or communicatively) coupled with / to” or “connected to” another component (e.g., a second component), it should be understood that the component may be directly coupled to the other component, or may be connected through another component (e.g., a third component).

[0027] Singular expressions include plural expressions unless the context clearly dictates otherwise. In this application, terms such as "comprise" or "consist of" are intended to indicate the presence of a feature, number, step, operation, component, part, or combination thereof described in the specification, but should be understood not to preclude the presence or addition of one or more other features, numbers, steps, operations, components, parts, or combinations thereof.

[0028] In the present disclosure, a "module" or "part" performs at least one function or operation and may be implemented in hardware or software, or a combination of hardware and software. Furthermore, multiple "modules" or multiple "parts" may be integrated into at least one module and implemented as at least one processor (not shown), excluding any "modules" or "parts" implemented in specific hardware.

[0029] In this specification, the term user may refer to a person using an electronic device or a device using an electronic device (e.g., an artificial intelligence electronic device).

[0030] Various embodiments of the present disclosure will be described in more detail with reference to the attached drawings below.

[0031] FIG. 1 is a drawing illustrating a plurality of external devices located in a home according to various embodiments.

[0032] Referring to FIG. 1, as various types of electronic devices are developed and popularized, multiple external devices (10, 20, ..., 60) may be provided in a home.

[0033] In particular, each of the plurality of external devices (10, 20, 30, 40, 50, 60) (hereinafter referred to as 10, 20, ..., 60) is implemented as an Internet of Things (IoT) device and can communicate with other external devices, user terminal devices, remote control devices, servers, etc. installed in the home, and can also transmit and receive IR signals by including an IR transmitter / receiver.

[0034] Each of the plurality of external devices (10, 20, ..., 60) illustrated in FIG. 1 is an example for convenience of explanation, and each of the plurality of electronic devices (10, 20, ..., 60) can be implemented as various types of home appliances, such as air conditioning equipment, kitchen / cooking equipment, wired / wireless cleaning equipment, image processing equipment, or clothing care equipment.

[0035] For example, each of the plurality of external devices (10, 20, ..., 60) includes, but is not limited to, at least one of a TV, a user terminal device, a tablet PC, a mobile phone, a video phone, an e-book reader, a desktop PC, a laptop PC, a netbook computer, a workstation, a server, a PDA, a portable multimedia player (PMP), an MP3 player, a medical device, a camera, a virtual reality (VR) implementation device, a wearable device, or the like. The wearable device includes, but is not limited to, at least one of an accessory type (e.g., a watch, a ring, a bracelet, an anklet, a necklace, glasses, a contact lens, or a head-mounted device (HMD)), a fabric or clothing-integrated type (e.g., an electronic garment), a body-attached type (e.g., a skin pad or a tattoo), a bio-implantable circuit, or the like. In various embodiments, each of the plurality of external devices (10, 20, ..., 60) includes, but is not limited to, a television, a digital video disk (DVD) player, an audio, a refrigerator, an air conditioner, a vacuum cleaner, an oven, a microwave oven, a washing machine, an air purifier, a source device (e.g., a set-top box, a cloud server, an over-the-top media service (OTT) server, etc.), a home automation control panel, a security control panel, a media box (e.g., Samsung HomeSync) TM , Apple TV TM , or Google TV TM ), game consoles (e.g. Xbox TM , PlayStation TM , Switch TM ), including but not limited to at least one of an electronic dictionary, an electronic key, a camcorder, an electronic picture frame or the like.

[0036] In an embodiment, each of the plurality of external devices (10, 20, ..., 60) may be, for example, various medical devices (e.g., various portable medical measuring devices (such as blood glucose meters, heart rate monitors, blood pressure monitors, or body temperature monitors), magnetic resonance angiography (MRA), magnetic resonance imaging (MRI), computed tomography (CT), cameras, or ultrasound machines), navigation devices, global navigation satellite systems (GNSS), event data recorders (EDR), flight data recorders (FDR), automotive infotainment devices, electronic equipment for ships (such as marine navigation devices, gyrocompasses, etc.), avionics, security devices, head units for vehicles, industrial or home robots, drones, ATMs of financial institutions, point of sales (POS) of stores, or Internet of Things devices (such as light bulbs, various sensors, sprinkler devices, fire alarms, thermostats, streetlights, toasters, exercise equipment, (including, but not limited to, a hot water tank, heater, boiler, etc.) or at least one of the following:

[0037] In order to reduce the total power consumption of a home according to the power consumption of each of a plurality of external devices (10, 20, ..., 60), each of the plurality of external devices (10, 20, ..., 60) may operate in a low power state (or low power mode). For example, when a low power state is activated through a user terminal device according to a user input, the server may transmit a control command to each of the plurality of external devices (10, 20, ..., 60) provided in the home to operate in a low power state.

[0038] For example, all of the multiple external devices (10, 20, ..., 60) may be operated in a low power state according to user input, or a first external device (10) among the multiple external devices (10, 20, ..., 60) may be operated in a low power state.

[0039] In the past, in order to operate each of a plurality of external devices (10, 20, ..., 60) in a low power state, there was an inconvenience in that user input was required to activate the low power state.

[0040] In addition, when the first external device (10) operates in a low-power state according to a setting to operate each of a plurality of external devices (10, 20, ..., 60) in a low-power state at a preset time, there was a problem that caused inconvenience because the first external device (10) used by the first user residing in the home operates in a low-power state at a preset (e.g., specific) time regardless of the first user's intention.

[0041] In order to solve the above-described problem, an electronic device according to an example of the present disclosure can identify a user's usage pattern for each of a plurality of external devices (10, 20, ..., 60) and operate each of the plurality of external devices (10, 20, ..., 60) in a low power state according to the usage pattern. For example, the electronic device can identify whether a user is absent within a space (e.g., a house) (or a preset area), and, when the user is absent, operate each of the plurality of external devices (10, 20, ..., 60) in a low power state according to the user's usage pattern.

[0042] In one example, the electronic device may be any one of a plurality of external devices (10, 20, ..., 60), and may be located outside a space (e.g., a home) and may include a server that communicates with each of the plurality of external devices (10, 20, ..., 60).

[0043] FIG. 2 is a block diagram illustrating an example configuration of an electronic device according to various embodiments.

[0044] Referring to FIG. 2, the electronic device (100) includes a communication interface (110) (e.g., including a communication circuit), a memory (120), and at least one processor (130) (e.g., including a processing circuit).

[0045] A communication interface (110) including various communication circuits according to an example may include, for example, wired or wireless input / output interfaces (or input / output terminals) according to various standards. For example, the communication interface (110) may include various interfaces such as HDMI (High Definition Multimedia Interface), MHL (Mobile High-Definition Link), USB (Universal Serial Bus), DP (Display Port), Thunderbolt, VGA (Video Graphics Array) port, RGB port, D-SUB (D-subminiature), DVI (Digital Visual Interface), AP-based Wi-Fi (Wireless LAN network), Bluetooth, Zigbee, wired / wireless LAN (Local Area Network), WAN (Wide Area Network), Ethernet, IEEE 1394, AES / EBU (Audio Engineering Society / European Broadcasting Union), optical, coaxial, etc.

[0046] A communication interface (110) according to an example of the present disclosure can transmit a control command to operate each of a plurality of external devices (10, 20, ..., 60) in a low power state under the control of at least one processor (130).

[0047] A memory (120) according to an example can store data for various embodiments of the present disclosure. Depending on the purpose of data storage, the memory (120) may be implemented as a memory embedded in the electronic device (100) or as a memory that can be attached or detached to the electronic device (100).

[0048] For example, data for driving an electronic device (100) may be stored in a memory embedded in the electronic device (100), and data for an extended function of the electronic device (100) may be stored in a memory that can be attached or detached to the electronic device (100). In the case of memory embedded in the electronic device (100), it may be implemented as at least one of volatile memory (e.g., dynamic RAM (DRAM), static RAM (SRAM), or synchronous dynamic RAM (SDRAM)), non-volatile memory (e.g., one time programmable ROM (OTPROM), programmable ROM (PROM), erasable and programmable ROM (EPROM), electrically erasable and programmable ROM (EEPROM), mask ROM, flash ROM, flash memory (e.g., NAND flash or NOR flash), hard drive, or solid state drive (SSD)). In addition, in the case of memory that can be attached or detached to the electronic device (100), it may be implemented as a memory card (e.g., compact flash (CF), secure digital (SD), micro secure digital (Micro-SD), mini secure digital (Mini-SD), extreme digital (xD), multi-media card (MMC), etc.), external memory that can be connected to a USB port (e.g., USB memory), etc. Can be.

[0049] As an example, the memory (120) may store a computer program including at least one instruction or instructions for controlling the electronic device (100).

[0050] According to an example, the memory (120) can store usage pattern information corresponding to each of a plurality of users.

[0051] According to an example, the memory (120) includes spatial information (or area information) corresponding to a space (or a preset area), and the spatial information may distinguish each of a plurality of sub-spaces included in the space into a public space or a private space. For example, the spatial information is a map corresponding to a space in a home, and each of the plurality of sub-spaces may include a work space defined by a user, an independent work space surrounded by obstacles (e.g., a wall, a threshold, etc.) (e.g., a living room, a kitchen, a closet, etc.). According to an example, a public space (e.g., a living room) may be a sub-space in which a relatively large number of users (e.g., 3 or more) are identified, and a private space (e.g., a bedroom) may be a sub-space in which a relatively small number of users (e.g., 1 to 2) are identified. According to an example, a space may be referred to as a preset area, but for the convenience of explanation, it will be collectively referred to as a space. In addition, spatial information may also be referred to as area information, but for the convenience of explanation, it will be collectively referred to as spatial information.

[0052] At least one processor (130) according to an example includes various processing circuits and can control the overall operation of the electronic device (100).

[0053] According to one embodiment of the present disclosure, at least one processor (130) may be implemented as a digital signal processor (DSP), a microprocessor, or a timing controller (TCON) for processing a digital signal. However, the present disclosure is not limited thereto, and may include one or more of a central processing unit (CPU), a micro controller unit (MCU), a micro processing unit (MPU), a controller, an application processor (AP), a communication processor (CP), an ARM processor, or an artificial intelligence (AI) processor, or may be defined by the corresponding term. In addition, at least one processor (130) may be implemented as a system on chip (SoC) having a built-in processing algorithm, a large scale integration (LSI), or may be implemented in the form of a field programmable gate array (FPGA). At least one processor (130) may perform various functions by executing computer executable instructions stored in a memory. At least one processor (130) may be implemented as a variety of The processing circuit may include a processor or may include multiple processors. For example, the term "processor" as used herein refers to various processing circuits, including at least one processor, and one or more processors may be individually configured to perform various functions described in the present disclosure or collectively in a distributed manner.Here, when "processor," "at least one processor," and "one or more processors" are described as being configured to perform various functions, these terms include instances where one processor performs some of the mentioned functions and other processor(s) perform the remaining functions, and instances where a single processor performs all of the mentioned functions. Furthermore, the at least one processor may include a combination of processors that perform multiple mentioned / disclosed functions. For example, processing may be performed in a distributed manner. At least one processor may execute program instructions to achieve or perform various functions.

[0054] At least one processor (130) according to an example of the present disclosure can identify whether each of a plurality of users is absent from a space based on preset conditions.

[0055] According to an example, at least one processor (130) may control the communication interface (110) to transmit a control command to operate a first external device (10) among a plurality of external devices (10, 20, ..., 60) in a low power state to the first external device (10) based on first usage pattern information corresponding to a first user identified as absent from a space among a plurality of users.

[0056] FIG. 3 is a diagram illustrating multiple users according to one embodiment of the present disclosure.

[0057] FIG. 3 is a diagram illustrating multiple users according to various embodiments.

[0058] For example, the electronic device (100) may obtain first usage pattern information corresponding to a first user (1) and second usage pattern information corresponding to a second user (2) and store them in a memory (120).

[0059] FIG. 4 is a drawing for explaining an external device that identifies a user using an external device according to various embodiments.

[0060] For convenience of explanation, in FIG. 4, the external device for identifying a user is assumed to be a first external device (10) implemented as a TV. However, it is to be understood that various embodiments are not limited thereto. For example, the external device for identifying a user could also be a sixth external device (60) implemented as a refrigerator.

[0061] The first external device (10) can receive a voice input from the first user (1) through a microphone (11) included in the first external device (10). The first external device (10) can perform an action corresponding to the voice input from the first user (1).

[0062] According to an example, a first external device (10) can analyze a voice input of a first user (1) to identify a first voice characteristic corresponding to the first user.

[0063] According to an example, a first external device (10) may receive a voice input of a first user (1) more than a threshold number of times, and when a first voice characteristic is identified more than a threshold number of times, the first external device (10) may transmit identification information of the first user (1) (e.g., User 1) and identification information of the first external device (10) (e.g., TV product name) to the electronic device (100).

[0064] According to an example, at least one processor (130) may, when identification information of a first user (1) and identification information of a first external device (10) are received, obtain usage pattern information corresponding to the first user (1). The usage pattern information may include usage time information (e.g., day of the week, time, etc.) and power consumption information of the first external device (10).

[0065] However, the above-described example is an example for the convenience of explanation, and it is obvious that the operation of the first external device (10) may be performed by the electronic device (100), and the operation of the electronic device (100) may be performed by the first external device (10).

[0066] For example, the first external device (10) can transmit the voice input of the first user (1) to the electronic device (100). At least one processor (130) can receive the voice input of the first user (1) from the first external device (10) a threshold number of times or more, and when the first voice characteristic is identified a threshold number of times or more, use pattern information corresponding to the first user (1) can be obtained based on the identification information of the first user (1) and the identification information of the first external device (10).

[0067] As an example, the first external device (10) can identify the first user (1) through a camera (12) included in the first external device (10).

[0068] According to an example, the first external device (10) can transmit identification information of the first user (1) and identification information of the first external device (10) to the electronic device (100) when the number of times the first user (1) is identified through the camera (12) is greater than or equal to a threshold number.

[0069] According to an example, at least one processor (130) can obtain usage pattern information corresponding to the first user (1) when identification information of the first user (1) and identification information of the first external device (10) are received.

[0070] However, the above-described example is an example for convenience of explanation, and the first external device (10) may also transmit a photographed image (e.g., Face ID) of the first user (1) to the electronic device (100). At least one processor (130) may receive a photographed image of the first user (1) from the first external device (10) a threshold number of times or more, and when the first user (1) is identified a threshold number of times or more, the processor may obtain usage pattern information corresponding to the first user (1) based on the identification information of the first user (1) and the identification information of the first external device (10).

[0071] FIG. 5 is a drawing for explaining an external device that identifies a user using an external device according to various embodiments.

[0072] Referring to FIG. 5, the first external device (10) can communicate with the first user terminal device (1000) corresponding to the first user (1) through a communication interface included in the first external device (10).

[0073] For example, the first user terminal device (1000) can transmit a BLE Advertisement Packet, and the communication interface included in the first external device (10) can perform a BLE Scan to receive the BLE Advertisement Packet transmitted by the first user terminal device (1000), and identify the first user terminal device (1000) based on the BLE Advertisement Packet.

[0074] For example, the first external device (10) can identify the first user terminal device (1000) by receiving a BLE Advertisement Packet transmitted by the first user terminal device (1000) located 20-30 m from the first external device (10).

[0075] According to an example, if the number of times the first external device (10) communicates with the first user terminal device (1000) through the communication interface is greater than or equal to a threshold number, the first external device (10) can transmit identification information of the first user (1) and identification information of the first external device (10) to the electronic device (100).

[0076] According to an example, at least one processor (130) can obtain usage pattern information corresponding to the first user (1) when identification information of the first user (1) and identification information of the first external device (10) are received.

[0077] FIG. 6 is a diagram for explaining the absence of a first user and a first usage pattern corresponding to the first user according to various embodiments.

[0078] According to an example, at least one processor (130) receives user identification information (e.g., User 1) and user usage time information (e.g., time, day of the week, etc.) from each of a plurality of external devices (10, 20, ..., 60) located in a home, and inputs the user identification information and usage time information received from each of the plurality of external devices (10, 20, ..., 60) into a neural network model to obtain usage pattern information corresponding to the user.

[0079] For example, at least one processor (130) may receive at least one of a voice input of a first user (1), a photographed image of the first user (1), or identification information of a first user terminal device (1000) corresponding to the first user (1) from a first external device (10), and usage time information of the first user (1) for the first external device (10).

[0080] According to an example, at least one processor (130) may input at least one of a voice input of a first user (1) received from a first external device (10), a photographed image of the first user (1), or identification information of a first user terminal device (1000) corresponding to the first user (1) into a neural network model to obtain identification information of the first user (1).

[0081] According to an example, at least one processor (130) receives usage time information for the first external device (10) when the first user (1) uses the first external device (10), and inputs the usage time information into a neural network model to obtain main usage time information (e.g., time, day of the week, etc.) for the first external device (10).

[0082] The usage pattern information output by the neural network model may include information on the external device that the user mainly (or frequently) uses among multiple external devices (10, 20, ..., 60) and the time at which the user mainly uses the external device.

[0083] Referring to FIG. 6, when the absence of the first user (1) among the first user (1) and the second user (2) is identified, at least one processor (130) can transmit a control command to the first external device (10) to operate the first external device (10) in a low power state, which is included in the first usage pattern information corresponding to the first user (1).

[0084] For example, the first usage pattern information corresponding to the first user (1) may include location information and usage time information within the space of each of the refrigerator (sixth external device (60)), the washing machine (fifth external device (50)), and the TV (first external device (10)) for which the first user (1) has been identified.

[0085] According to one example of the present disclosure, when the absence of the first user (1) is identified, at least one processor (130) may transmit a control command to operate each of the first external device (10), the fifth external device (50), and the sixth external device (60) in a low power state based on the first usage pattern information.

[0086] According to one example of the present disclosure, at least one processor (130) can compare the usage time information of the first external device (10) included in the first usage pattern information corresponding to the first user (1) with the current time information even if the absence of the first user (1) is not identified (for example, if the first user (1) is identified as present in the space).

[0087] According to an example, if the usage time information of the first external device (10) included in the first usage pattern information and the current time information are different, at least one processor (130) may transmit a control command to operate the first external device (10) in a low power state. For example, if the main usage time of the first user (1) for the first external device (10) is from 9:00 to 18:00 from Monday to Friday, at least one processor (130) may transmit a control command to operate the first external device (10) in a low power state on Saturday or Sunday according to the current time information, even if the first user (1) is identified as being present in the space.

[0088] The artificial intelligence-related function according to the present disclosure is operated through at least one processor (130) and memory (120) of an electronic device (100). At this time, the at least one processor (130) may include at least one of a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), and an NPU (Neural Processing Unit), but is not limited to the examples of the processors described above.

[0089] CPUs include general-purpose processors capable of performing not only general calculations but also artificial intelligence calculations, and their multi-layered cache structure allows for the efficient execution of complex programs. CPUs are advantageous for serial processing, enabling organic linking of previous and subsequent calculation results through sequential calculations. General-purpose processors are not limited to the examples described above, except where specifically designated as CPUs.

[0090] A GPU includes processors for large-scale calculations, such as floating-point operations used in graphics processing, and can perform large-scale calculations in parallel by integrating a large number of cores. For example, GPUs may be advantageous over CPUs in parallel processing methods, such as convolution operations. Furthermore, GPUs can be used as coprocessors to supplement the functions of CPUs. Processors for large-scale calculations are not limited to the examples described above, except in cases where they are specifically referred to as GPUs.

[0091] An NPU is a processor specialized for artificial intelligence operations using artificial neural networks, and each layer of the artificial neural network can be implemented in hardware (e.g., silicon). Since the NPU is designed specifically according to the company's specifications, it has less freedom than a CPU or GPU, but can efficiently process the artificial intelligence operations requested by the company. Meanwhile, as a processor specialized for artificial intelligence operations, an NPU can be implemented in various forms, such as a Tensor Processing Unit (TPU), an Intelligence Processing Unit (IPU), or a Vision Processing Unit (VPU). Except as specifically stated as an NPU, the artificial intelligence processor is not limited to the examples described above.

[0092] Additionally, at least one processor (130) may be implemented as a System on Chip (SoC). In addition to at least one processor (130), the SoC may further include a memory (120) and a network interface, such as a bus, for data communication between at least one processor (130) and the memory (120).

[0093] When a System on Chip (SoC) included in an electronic device (100) includes multiple processors, the electronic device (100) may perform operations related to artificial intelligence (e.g., operations related to learning or inference of an artificial intelligence model) by using some of the multiple processors. For example, the electronic device (100) may perform operations related to artificial intelligence by using at least one of a GPU, an NPU, a VPU, a TPU, and a hardware accelerator specialized in artificial intelligence operations such as convolution operations and matrix multiplication operations among the multiple processors. However, this is merely an example, and it is of course possible to process operations related to artificial intelligence by using a general-purpose processor such as a CPU.

[0094] In addition, the electronic device (100) can perform operations related to functions related to artificial intelligence using multiple cores (e.g., dual cores, quad cores, etc.) included in at least one processor (130). In particular, the electronic device (100) can perform artificial intelligence operations such as convolution operations, matrix multiplication operations, etc. in parallel using multiple cores included in at least one processor (130).

[0095] At least one processor (130) processes input data according to predefined operation rules or artificial intelligence models stored in the memory (120). The predefined operation rules or artificial intelligence models are characterized by being created through learning.

[0096] "Creating through learning" refers to, for example, the creation of predefined behavioral rules or artificial intelligence models with desired characteristics by applying a learning algorithm to a large number of training data sets. This learning may be performed on the device itself, where the artificial intelligence according to the present disclosure is implemented, or through a separate server / system.

[0097] An artificial intelligence model may be composed of multiple neural network layers. At least one layer has at least one weight value and performs its operation through the operation result of the previous layer and at least one defined operation. Examples of neural networks include a convolutional neural network (CNN), a deep neural network (DNN), a recurrent neural network (RNN), a restricted boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), deep Q-networks, and a transformer. The neural networks in the present disclosure are not limited to the above-described examples unless otherwise specified.

[0098] A learning algorithm includes a method for training a target device (e.g., a robot) using a plurality of learning data sets to enable the target device to make decisions or predictions on its own. Examples of learning algorithms include supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning. Unless otherwise specified, the learning algorithms in this disclosure are not limited to the aforementioned examples.

[0099] <Usage pattern information including power consumption information>

[0100] Additionally, usage pattern information corresponding to a user may include average power consumption information of an external device according to the user's use of the external device.

[0101] For example, when a first user (1) uses a first external device (10), the electronic device (100) receives power consumption information of the first external device (10) according to the use of the first external device (10), and at least one processor (130) can obtain average power consumption information of the first external device (10) based on the power consumption information.

[0102] Usage pattern information corresponding to a user can identify whether the external device is a device that requires transition to a low power state when executing a power consumption reduction state, based on average power consumption information of the external device.

[0103] For example, at least one processor (130) may identify the first external device (10) as a device requiring transition to a low power state to reduce power consumption in the home, if the average power consumption is greater than or equal to a threshold value based on average power consumption information of the first external device (10), since the first external device (10) has relatively high power consumption. Hereinafter, a device requiring transition to a low power state will be collectively referred to as a low power state target device.

[0104] According to an example, when the absence of a first user (1) is identified, at least one processor (130) may transmit a control command to operate a first external device (10), which is a low-power state target device, in a low-power state based on first usage pattern information corresponding to the first user (1).

[0105] FIG. 7 is a diagram for explaining the absence of a second user and a second usage pattern corresponding to the second user according to various embodiments.

[0106] A power consumption reduction state according to an example of the present disclosure may be a state for operating at least one of a plurality of external devices (10, 20, ..., 60) in a low power state in order to reduce the total power consumption of the home according to the power consumption of each of the plurality of external devices (10, 20, ..., 60).

[0107] For example, at least one processor (130) may execute a power consumption reduction state when a user input for executing a power consumption reduction state is received, or when a preset time has elapsed, when a preset condition is satisfied, or when a trigger has occurred, thereby executing the power consumption reduction state. For example, when a function corresponding to power consumption reduction is executed, at least one processor (130) may identify whether or not each of a plurality of users is absent from the space.

[0108] Referring to FIG. 7, when the absence of a second user (2) is identified, at least one processor (130) can transmit a control command to operate each of the notebook (fourth external device (40)), the light (fifth external device (50)), and the TV (first external device (10)) in a low power state based on second usage pattern information corresponding to the second user (2).

[0109] As described above, even if the second user (2) is identified as present in the space, the usage time information of each of the first external device (10), the fourth external device (40), and the fifth external device (50) included in the second usage pattern information may be compared with the current time information, and a control command may be transmitted to operate at least one of the first external device (10), the fourth external device (40), and the fifth external device (50) in a low power state based on the comparison result.

[0110] For example, if the current time is 23:00, the usage time information of each of the laptop (fourth external device (40)) and the TV (first external device (10)) excluding the light (fifth external device (50)) is different from the current time information, so the laptop and the TV can be operated in a low power state.

[0111] For example, at least one processor (130) may not operate an external device in a low power state if the external device included in the usage pattern information corresponding to a user identified as absent is also included in the usage pattern information corresponding to a user identified as present in the space.

[0112] For example, at least one processor (130) may operate the first external device (10) in a low power state based on usage pattern information corresponding to a second user (2) identified as absent. However, at least one processor (130) may not transmit a control command to operate the first external device (10) in a low power state if the usage pattern information corresponding to the first user (1) identified as present includes identification information of the first external device (10).

[0113] <Spatial Information>

[0114] In one example of the present disclosure, the memory (120) includes spatial information corresponding to a space, and the spatial information can divide each of a plurality of sub-spaces included in the space into a public space or a private space. For example, the spatial information is a map corresponding to a space within a home, and each of the plurality of sub-spaces can include a work space defined by a user, an independent work space surrounded by obstacles (e.g., a wall, a threshold, etc.) (e.g., a living room, a kitchen, a closet, etc.). According to one example, a public space (e.g., a living room) may be a sub-space in which a relatively large number of users (e.g., 3 or more) are identified, and a private space (e.g., a bedroom) may be a sub-space in which a relatively small number of users (e.g., 1 to 2) are identified.

[0115] For example, at least one processor (130) may switch to a low power state only an external device located in a personal space among the external devices included in the usage pattern information corresponding to a user identified as absent.

[0116] For example, at least one processor (130) may switch the fourth external device (40) and the fifth external device (50) located in the personal space to a low power state based on the location information of each of the notebook (fourth external device (40)), the light (fifth external device (50)), and the TV (first external device (10)) corresponding to the second user (2) identified as absent, and may not switch the first external device (10) to a low power state.

[0117] FIG. 8 is a drawing for explaining an exemplary operation of one of a plurality of external devices located in a home according to various embodiments.

[0118] In the above-described example, for the sake of convenience of explanation, the electronic device (100) is implemented as a server not located within the home. However, it is to be understood that the present invention is not limited thereto. For example, as illustrated in FIG. 8, any one of a plurality of external devices (10, 20, ..., 60) may perform the operation of the electronic device (100) according to the above-described embodiment.

[0119] For example, among a plurality of external devices (10, 20, ..., 60), a first external device (10) may transmit a control command to each of the remaining external devices (20, ..., 60) to operate in a low power state, and may also receive user identification information and usage time information from each of the remaining external devices (20, ..., 60) to obtain usage pattern information corresponding to the user. For example, the first external device (10) may operate as a home hub device capable of communicating with each of the remaining external devices (20, ..., 60).

[0120] <Obtain status information>

[0121] At least one processor (130) according to one embodiment of the present disclosure can receive status information of each of a plurality of external devices (10, 20, ..., 60).

[0122] For example, at least one processor (130) may transmit a control command to operate the first external device (10) in a low power state based on first usage pattern information corresponding to a first user (1) identified as absent, and if the first external device (10) is already operating in a low power state based on status information of the first external device (10), the control command may not be transmitted.

[0123] For example, at least one processor (130) may operate the first external device (10) in a normal state when an operation-related timer setting of the first external device (10) is identified based on the status information. For example, at least one processor (130) may switch the washing machine (the fifth external device (50)) to a low power state when the first user (1) is absent, but may not switch to the low power state according to the user's intention to operate the washing machine in a normal state for a period of time corresponding to the timer setting when an operation-related timer setting is identified based on the status information of the fifth external device (50).

[0124] For convenience of explanation, the general state may include states other than the low-power state (or standby state, off state), states corresponding to user operations, etc.

[0125] FIG. 9 is a diagram illustrating an external device for identifying the absence of a user according to various embodiments.

[0126] Each of the plurality of external devices (10, 20, ..., 60) according to an example of the present disclosure can identify a user through at least one sensor included in each of the plurality of external devices (10, 20, ..., 60).

[0127] For example, the first external device (10) can detect the user through at least one of a microphone (11), a camera (12), or a communication interface included in the first external device (10), regardless of whether the first external device (10) is used.

[0128] An electronic device (10) according to an example of the present disclosure can identify a first user (1) as present when the first user (1) is detected from any one of a plurality of external devices (10, 20, ..., 60), and can identify the first user (1) as absent when the first user (1) is not detected from at least one of the plurality of external devices (10, 20, ..., 60).

[0129] For example, at least one processor (130) can identify a user as absent if a user terminal device corresponding to the user is not connected to an access point (AP) in the home.

[0130] According to one example, at least one processor (130) may identify a user as present when a user terminal device corresponding to the user is connected to an AP. According to one example, at least one processor (130) may identify a user as absent when a user terminal device is connected to an AP in the home but the user terminal device does not move for a threshold period of time, as the user may go out without carrying the user terminal device.

[0131] Figure 10 is a drawing for explaining preset conditions according to various embodiments.

[0132] According to an example of the present disclosure, a user terminal device (1000) may provide a user UI for executing a power consumption reduction mode within a space.

[0133] For example, based on a user input that activates a power saving mode within a space, the electronic device (100) can identify whether each of the plurality of users is absent within the space.

[0134] A user UI according to an example may include a UI for operating at least one of a plurality of external devices (10, 20, ..., 60) in a low power mode, and may also display status information of each of the plurality of external devices (10, 20, ..., 60).

[0135] A user UI according to an example may provide restricted operations (e.g., Disable functions), expected power consumption, etc. when each of the multiple external devices (10, 20, ..., 60) is operating in low power mode.

[0136] For example, a user UI may provide the total power consumption in the current home and the expected power consumption reduction when an external device corresponding to a user identified as absent is switched into a low-power mode.

[0137] FIG. 11 is a flowchart illustrating an exemplary control method of an electronic device according to various embodiments.

[0138] Referring to FIG. 11, a control method of an electronic device detects a user within a preset area according to a preset condition (or trigger) (S1110).

[0139] Next, when the absence of the user is detected (S1120), it is identified whether an external device corresponding to the user is located in the personal area (S1130).

[0140] When an external device corresponding to a user is located in a personal area (e.g., personal area) (S1130: Y), a control command is transmitted to cause the external device to operate in a saving state (or, low power state) (S1140).

[0141] For example, if an external device corresponding to a user is not located in a private area (S1130: N) but is located in a public area (S1150), the absence of other users in the public area is identified (S1160).

[0142] For example, if another user is identified as absent in the public area where the external device is located (S1160: Y), a control command is transmitted to cause the external device to operate in a saving state (or low power state) (S1140). If another user is identified as present in the public area where the external device is located (S1160: N), the external device is controlled to operate in a normal state (S1170).

[0143] A method for controlling an electronic device according to an embodiment of the present disclosure includes a step of identifying whether each of a plurality of users is absent within a preset area based on preset conditions, and a step of transmitting a control command to a first external device among a plurality of external devices to operate in a low power state based on first usage pattern information corresponding to a first user identified as being absent within the preset area among the plurality of users.

[0144] A control method according to an example may further include a step of controlling a second external device among a plurality of external devices to operate in a normal state based on second usage pattern information corresponding to a second user identified as a user within a preset area among a plurality of users.

[0145] According to an example, the first usage pattern information may include at least one of identification information of a first external device corresponding to a first user among a plurality of external devices, location information of the first external device, or usage time information of the first external device, and the second usage pattern information may include at least one of identification information of a second external device corresponding to a second user among a plurality of external devices, location information of the second external device, or usage time information of the second external device.

[0146] A control method according to an example of the present disclosure may further include a step of transmitting a control command to the second external device to control the second external device to operate in a low power state if the usage time information of the second external device included in the second usage pattern information and the current time information are different.

[0147] The transmitting step according to an example of the present disclosure may include a step of controlling the first external device to operate in a normal state if the second usage pattern information includes identification information of the first external device.

[0148] The transmitting step according to an example of the present disclosure may include a step of controlling the first external device to operate in a normal state when a timer setting related to the operation of the first external device is identified in the first external device.

[0149] An electronic device according to an example of the present disclosure includes area information corresponding to a preset area, and the area information divides each of a plurality of sub-areas included in the preset area into a public area or a private area, and the transmitting step may include a step of controlling the first external device to operate in a normal state when the first external device is located within the public area, and a step of controlling the first external device to operate in a low-power state when the first external device is located within the private area, based on location information of the first external device included in the first usage pattern information.

[0150] The transmitting step according to an example of the present disclosure may include a step of identifying whether the first external device is a low-power state target device based on identification information of the first external device included in the first usage pattern information, and a step of controlling the first external device to operate in a low-power state if the first external device is identified as a low-power state target device.

[0151] According to an example of the present disclosure, a first external device identifies a first user using the first external device through a camera included in the first external device, and a control method can obtain first usage pattern information including identification information of the first external device when the number of times the first user is identified through the camera is greater than or equal to a threshold number.

[0152] According to an example of the present disclosure, a first external device receives a voice input of a first user using the first external device through a microphone included in the first external device, and a control method can obtain first usage pattern information including identification information of the first external device when the number of times the voice input of the first user is received through the microphone is greater than or equal to a threshold number.

[0153] According to an example of the present disclosure, a first external device communicates with a first user terminal device corresponding to a first user through a communication interface included in the first external device, and a control method can obtain first usage pattern information including identification information of the first external device when the number of communications with the first user terminal device through the communication interface is greater than or equal to a threshold number.

[0154] A preset condition according to an example of the present disclosure includes at least one of a user input for executing a power consumption reduction state within a preset time or preset area, and the step of identifying whether each of the plurality of users is absent may include a step of identifying whether each of the plurality of users is absent using a sensor included in at least one external device among the plurality of external devices.

[0155] However, it goes without saying that the various embodiments of the present disclosure can be applied not only to electronic devices but also to various types of electronic devices capable of communicating with external devices.

[0156] The various embodiments described above may be implemented in a computer-readable recording medium using software, hardware, or a combination thereof, or in a computer- or similar device. In some cases, the various embodiments described herein may be implemented in the processor itself. In a software implementation, embodiments, such as the procedures and functions described herein, may be implemented as separate software modules. Each of the software modules may perform at least one function and operation described herein.

[0157] Computer instructions for performing processing operations of the display device (100) according to various embodiments of the present disclosure described above may be stored in a non-transitory computer-readable medium. When the computer instructions stored in the non-transitory computer-readable medium are executed by a processor of a specific device, they cause the specific device to perform processing operations of the display device (100) according to various embodiments described above.

[0158] A non-transitory computer-readable medium is a medium that permanently stores data and can be read by a device. Specific examples of non-transitory computer-readable media include CDs, DVDs, hard disks, Blu-ray discs, USBs, memory cards, and ROMs.

[0159] The present disclosure has been described and illustrated with reference to various embodiments, and these various embodiments should be understood to be illustrative rather than limiting. Various modifications and variations may be made by those skilled in the art without departing from the spirit and scope of the present disclosure as claimed in the claims. Such modifications should not be construed individually from the technical spirit or scope of the present disclosure. Furthermore, it should be understood that any embodiment described herein can be used in conjunction with any other embodiment described herein.

Claims

1. In electronic devices, A communication interface including a communication circuit; A memory that stores usage pattern information corresponding to each of multiple users; and At least one processor comprising a processing circuit; At least one processor, either individually or collectively, Identifying whether each of said plurality of users is absent within a specific area based on specific conditions, An electronic device configured to control the communication interface to transmit a control command to operate a first external device among a plurality of external devices in a low power state based on first usage pattern information corresponding to a first user identified as absent within the specific area among the plurality of users.

2. In paragraph 1, Individually or collectively, at least one processor, An electronic device that controls a second external device among the plurality of external devices to operate in a normal state based on second usage pattern information corresponding to a second user identified as a user within the specific area among the plurality of users.

3. In paragraph 2, The above first usage pattern information is, Including at least one of identification information of the first external device corresponding to the first user among the plurality of external devices, location information of the first external device, or usage time information of the first external device, The above second usage pattern information is, An electronic device comprising at least one of identification information of a second external device corresponding to the second user among the plurality of external devices, location information of the second external device, or usage time information of the second external device.

4. In paragraph 3, Individually or collectively, at least one processor, An electronic device that controls the second external device to operate in the low power state when the usage time information and the current time information of the second external device included in the second usage pattern information are different.

5. In paragraph 2, Individually or collectively, at least one processor, An electronic device that controls the first external device to operate in the normal state when the second usage pattern information includes identification information of the first external device.

6. In paragraph 1, Individually or collectively, at least one processor, An electronic device that controls the first external device to operate in a normal state when a timer setting related to the operation of the first external device is identified in the first external device.

7. In paragraph 1, The above memory is, It includes area information corresponding to the specific area, and the area information divides each of the multiple sub-areas included in the specific area into a public area or a private area. Individually or collectively, at least one processor, An electronic device, based on location information of the first external device included in the first usage pattern information, controlling the first external device to operate in a normal state when the first external device is located within the public area, and controlling the first external device to operate in a low power state when the first external device is located within the private area.

8. In paragraph 1, Individually or collectively, at least one processor, Identifying whether the first external device is a low-power state target device based on the identification information of the first external device included in the first usage pattern information; An electronic device that controls the first external device to operate in the low power state when the first external device is identified as the low power state target device.

9. In paragraph 1, The above first external device is, Identifying the first user using the first external device through the camera included in the first external device, Individually or collectively, at least one processor, An electronic device that acquires the first usage pattern information including identification information of the first external device and stores it in the memory when the number of times the first user is identified through the camera is greater than or equal to a threshold number.

10. In paragraph 1, The above first external device is, Receive a voice input of the first user using the first external device through a microphone included in the first external device, Individually or collectively, at least one processor, An electronic device that acquires the first usage pattern information including identification information of the first external device and stores it in the memory when the number of times the first user's voice input is received through the microphone is greater than or equal to a threshold number.

11. In paragraph 1, The above first external device is, Control to communicate with a first user terminal device corresponding to the first user through a communication interface included in the first external device, Individually or collectively, at least one processor, An electronic device that acquires the first usage pattern information including identification information of the first external device and stores it in the memory when the number of communications with the first user terminal device through the communication interface is greater than or equal to a threshold number.

12. In paragraph 1, The above specific conditions are, At least one of the user inputs for executing a function corresponding to reducing power consumption at a specific time or within said specific area, Individually or collectively, at least one processor, An electronic device that identifies the absence of each of the plurality of users by using a sensor included in at least one external device among the plurality of external devices.

13. In a method for controlling an electronic device, A step of identifying whether each of a plurality of users is absent within a specific area based on a specific condition; and A control method comprising: a step of transmitting a control command to operate a first external device among a plurality of external devices in a low power state based on first usage pattern information corresponding to a first user identified as absent within the specific area among the plurality of users; 14. In paragraph 13, A control method further comprising: a step of controlling a second external device among the plurality of external devices to operate in a normal state based on second usage pattern information corresponding to a second user identified as a user within the specific area among the plurality of users.

15. In paragraph 14, The above first usage pattern information is, Including at least one of identification information of the first external device corresponding to the first user among the plurality of external devices, location information of the first external device, or usage time information of the first external device, The above second usage pattern information is, A control method comprising at least one of identification information of a second external device corresponding to the second user among the plurality of external devices, location information of the second external device, or usage time information of the second external device.

Images