Electronic device and method for controlling same

Abstract

An electronic device is disclosed. The electronic device comprises: a thermal image camera; a memory that stores at least one instruction; and one or more processors, wherein the one or more processors execute the at least one instruction to, when a thermal image capturing, using the thermal image camera, an induction cooktop having a container placed thereon is obtained, obtain noise information of a surrounding area excluding an area in which the container is placed, on the basis of the thermal image and a reference image. The one or more processors obtain temperature information of a handle portion of the container on the basis of a correction image having removed therefrom noise obtained on the basis of the thermal image and the noise information, and provide guide information for the obtained temperature information.

Description

Electronic device and method of controlling the same

[0001] The present disclosure relates to an electronic device and a method for controlling the same, and more particularly, to an electronic device providing a hood function around an induction cooktop and a method for controlling the same.

[0002] Advances in electronic technology have led to the development and widespread adoption of various types of electronic devices. In particular, induction cookers, used in a variety of settings, including homes and restaurants, have seen continuous advancements in recent years.

[0003] Previously, after cooking on an induction stove, users had to judge the temperature of the container based on their own judgment. This led to inconveniences such as burns or the need to wear gloves, as users were unable to gauge the temperature of the container's handle.

[0004] An electronic device according to one or more embodiments includes a thermal imaging camera, a memory storing at least one command, and at least one processor, wherein the at least one processor executes the at least one command to, when a thermal image is obtained by photographing an induction where a container is placed using the thermal imaging camera, acquire noise information of a surrounding area excluding an area where the container is placed based on the thermal image and a reference image, acquire temperature information of a handle portion of the container based on a noise-removed corrected image obtained based on the thermal image and the noise information, and provide guide information for the acquired temperature information.

[0005] The one or more processors according to one or more embodiments can obtain the noise information based on pixel difference information between the thermal image and the reference image by executing the at least one command.

[0006] According to one or more embodiments, the one or more processors can obtain the noise information by inputting the thermal image and the reference image into a learned artificial intelligence model by executing the at least one command.

[0007] According to one or more embodiments, the reference image may include a plurality of reference images corresponding to changes in temperature values ​​over time. The one or more processors may, by executing the at least one command, compare the plurality of thermal image images sequentially acquired over time through the thermal imaging camera with the plurality of reference images at corresponding points in time to obtain noise information over time.

[0008] The memory according to one or more embodiments may store a plurality of images corresponding to the handle portion of the container. The one or more processors may, by executing the at least one command, identify at least one of the plurality of images corresponding to the handle portion of the container in the corrected image, thereby identifying the handle portion of the container in the corrected image, and obtain temperature information of the handle portion of the container based on color information of the handle portion of the container.

[0009] An electronic device according to one or more embodiments may further include an output interface including a plurality of light-emitting elements. The one or more processors may, by executing the at least one command, adjust the light-emitting states of the plurality of light-emitting elements based on temperature information of a handle portion of the container to provide the guide information.

[0010] The one or more processors according to one or more embodiments can provide the guide information by adjusting at least one of the light-emitting color, light-emitting pattern, or light-emitting time of the plurality of light-emitting elements based on temperature information of the handle portion of the container by executing the at least one command.

[0011] The electronic device according to one or more embodiments may be implemented as a hood device. The plurality of light-emitting elements may be divided into a plurality of light-emitting groups arranged at different positions relative to an exhaust port of the hood device. The one or more processors may, by executing the at least one command, adjust the light-emitting state of at least one light-emitting group among the plurality of light-emitting groups based on temperature information of a handle portion of the container, thereby providing the guide information.

[0012] According to one or more embodiments, the one or more processors can, by executing the at least one command, turn on the thermal imaging camera to acquire the thermal image when a threshold time has elapsed after cooking is started on the induction or when cooking is finished on the induction.

[0013] A method for controlling an electronic device according to one or more embodiments may include the steps of: obtaining a thermal image of an induction where a container is placed using a thermal image camera; obtaining noise information of a surrounding area excluding an area where the container is placed based on the thermal image and a reference image; obtaining temperature information of a handle portion of the container based on a noise-removed corrected image obtained based on the thermal image and the noise information; and providing guide information for the obtained temperature information.

[0014] A non-transitory computer-readable medium storing computer instructions that, when executed by a processor of an electronic device according to one or more embodiments, cause the electronic device to perform an operation, the operation may include: a step of obtaining a thermal image by photographing an induction where a container is placed using a thermal image camera; a step of obtaining noise information of a surrounding area excluding an area where the container is placed based on the thermal image and a reference image; a step of obtaining temperature information of a handle portion of the container based on a noise-removed corrected image obtained based on the thermal image and the noise information; and a step of providing guide information for the obtained temperature information.

[0015] FIGS. 1A and 1B are drawings illustrating a cooking system according to one or more embodiments.

[0016] FIG. 2A is a block diagram illustrating a configuration of an electronic device according to one or more embodiments.

[0017] FIG. 2b is a block diagram illustrating a detailed configuration of an electronic device according to one or more embodiments.

[0018] FIG. 3 is a flowchart illustrating a method of controlling an electronic device according to one or more embodiments.

[0019] FIG. 4 is a drawing for explaining an induction shooting method according to one or more embodiments.

[0020] FIGS. 5A and 5B are drawings for explaining temperature value changes in a region surrounding a container according to one or more embodiments.

[0021] FIG. 6 is a diagram for explaining a method for obtaining noise information according to one or more embodiments.

[0022] FIG. 7 is a drawing for explaining a method for identifying a container handle portion according to one or more embodiments.

[0023] FIG. 8 is a drawing for explaining the arrangement of light-emitting elements according to one or more embodiments.

[0024] FIG. 9 is a drawing for explaining the light-emitting state of a light-emitting element according to one or more embodiments.

[0025] The terms used in this specification will be briefly explained, and the present disclosure will be described in detail.

[0026] The terms used in the embodiments of this disclosure have been selected from widely used, current terms, taking into account the functions of this disclosure. However, these terms may vary depending on the intentions or cases of those skilled in the art, the emergence of new technologies, etc. Furthermore, in certain cases, terms may be arbitrarily selected by the applicant, and in such cases, their meanings will be described in detail in the description of the relevant disclosure. Therefore, the terms used in this disclosure should not be defined simply as names of terms, but rather based on the meanings of the terms and the overall content of this disclosure.

[0027] In this specification, expressions such as “has,” “can have,” “includes,” or “may include” indicate the presence of a feature (e.g., a number, function, operation, or component such as a part), and do not exclude the presence of additional features.

[0028] In this disclosure, expressions such as “A or B,” “at least one of A and / or B,” or “one or more of A or / and B” can include all possible combinations of the listed items. For example, “A or B,” “at least one of A and B,” or “at least one of A or B” can all refer to cases where (1) only A is included, (2) only B is included, or (3) both A and B are included.

[0029] As used herein, the expressions “first,” “second,” “first,” or “second,” etc., may describe various components, regardless of order and / or importance, and are only used to distinguish one component from another, but do not limit the components.

[0030] When it is said that a component (e.g., a first component) is “operatively or communicatively coupled with / to” or “connected to” another component (e.g., a second component), it should be understood that the component may be directly coupled to the other component, or may be connected through another component (e.g., a third component).

[0031] The expression "configured to" as used in the present disclosure may be used interchangeably with, for example, "suitable for," "having the capacity to," "designed to," "adapted to," "made to," or "capable of." The term "configured to" may not necessarily mean only "specifically designed to" in terms of hardware.

[0032] In some contexts, the phrase "a device configured to" may mean that the device, in conjunction with other devices or components, is "capable of" performing A, B, and C. For example, the phrase "a processor configured (or set) to perform A, B, and C" may refer to a dedicated processor (e.g., an embedded processor) for performing those operations, or a general-purpose processor (e.g., a CPU or application processor) that can perform those operations by executing one or more software programs stored in a memory device.

[0033] Singular expressions include plural expressions unless the context clearly dictates otherwise. In this application, terms such as "comprise" or "consist of" are intended to indicate the presence of a feature, number, step, operation, component, part, or combination thereof described in the specification, but should be understood not to preclude the presence or addition of one or more other features, numbers, steps, operations, components, parts, or combinations thereof.

[0034] In the embodiments, a "module" or "part" performs at least one function or operation and may be implemented as hardware or software, or as a combination of hardware and software. Furthermore, a plurality of "modules" or "parts" may be integrated into at least one module and implemented as at least one processor (not shown), excluding any "module" or "part" that needs to be implemented as specific hardware.

[0035] Meanwhile, the various elements and areas in the drawings are schematically drawn. Therefore, the technical concept of the present invention is not limited by the relative sizes or spacing depicted in the attached drawings.

[0036] An embodiment of the present disclosure will be described in more detail with reference to the attached drawings below.

[0037] FIGS. 1A and 1B are drawings illustrating a cooking system according to one or more embodiments.

[0038] According to FIGS. 1A and 1B, the cooking system may include an induction device (10) and a hood device (20). According to one or more examples, the induction device (10) and the hood device (20) may be implemented as separate units as illustrated in FIG. 1A, or as integrated units as illustrated in FIG. 1B.

[0039] An induction device (10) is a cooking tool that generates heat by reacting a container made of an electrically conductive material with a magnetic field generated within the device, rather than generating heat on its own. It may also be called an induction plate or induction range. For example, the induction device (10) may be implemented so that an inductor generates and controls a magnetic field in a coil within a top plate covered with glass ceramic.

[0040] Induction devices (10) work on the principle that all metal and magnetic containers (excluding tempered glass, aluminum, and copper) placed on the top plate trap a magnetic field, which creates an induction current, heating the bottom of the container and its contents. At this time, the rest of the top plate is cold, and heating stops the moment the container is removed from the top plate. If a special interface disk made of ferromagnetic steel is placed on the top plate, it acts as a heat transfer device, allowing cooking with containers that cannot be used on an induction range.

[0041] However, the induction device (10) can also be implemented with other types of devices of a similar electric range type, such as a highlight.

[0042] A hood device (20) is a device that absorbs smoke generated during cooking and may also be referred to as a ventilation fan. As an example, the hood device (20) may be composed of an iron plate cover that absorbs rising gas, a grease filter, and a fan that provides ventilation.

[0043] The hood device (20) can be placed in various locations where smoke can be sucked in, such as the top, left, and right sides of the induction device (10).

[0044] Meanwhile, after cooking on an induction cooktop (10), the user determines the temperature of the container based on their own judgment. In this case, the user cannot discern the temperature of the container handle, so they must endure the inconvenience of getting burned or wearing gloves.

[0045] Accordingly, below, various embodiments of guiding the user to the temperature of the handle portion of a container after cooking is completed through an image captured using a thermal imaging camera will be described.

[0046] FIG. 2A is a block diagram illustrating a configuration of an electronic device according to one or more embodiments.

[0047] According to FIG. 2a, the electronic device (100) includes a thermal imaging camera (110), a memory (120), and one or more processors (130). According to one example, the electronic device (100) may be implemented as a hood device (20) as illustrated in FIGS. 1a and 1b.

[0048] A thermal imaging camera (110) is a device that tracks and detects heat and displays it at a glance on a screen. While the human eye or a regular camera detects visible light, a thermal imaging camera (110) detects the radiant heat emitted by a hot object to create an image. The thermal imaging camera (110) displays the temperature in different colors, allowing us to identify the temperature with our eyes. In other words, a thermal imaging camera (110) is a camera that detects thermal radiation emitted from an object and visualizes it in various colors.

[0049] The thermal imaging camera (110) may be installed at a location where it can capture images of the induction device (10). For example, the thermal imaging camera (110) may be installed at a location where it can capture images of the top surface of the induction device (10) from the front. Accordingly, the image acquired through the thermal imaging camera (110) may be a top-view image or an image captured at an angle close to a top-view image.

[0050] The memory (120) can store data required for various embodiments. The memory (120) may be implemented in the form of memory embedded in the electronic device (100') or in the form of memory that can be detachably attached to the electronic device (100) depending on the purpose of data storage. For example, data for driving the electronic device (100) may be stored in a memory embedded in the electronic device (100'), and data for expanding the functions of the electronic device (100) may be stored in a memory that can be detachably attached to the electronic device (100). Meanwhile, in the case of memory embedded in the electronic device (100), it may be implemented as at least one of volatile memory (e.g., dynamic RAM (DRAM), static RAM (SRAM), or synchronous dynamic RAM (SDRAM)), non-volatile memory (e.g., one time programmable ROM (OTPROM), programmable ROM (PROM), erasable and programmable ROM (EPROM), electrically erasable and programmable ROM (EEPROM), mask ROM, flash ROM, flash memory (e.g., NAND flash or NOR flash), hard drive, or solid state drive (SSD). In addition, in the case of memory that can be attached or detached to the electronic device (100'), it may be implemented as at least one of memory cards (e.g., compact flash (CF), secure digital (SD), micro secure digital (Micro-SD), mini secure digital (Mini-SD), extreme digital (xD), multi-media card (MMC), etc.), external memory that can be connected to a USB port (e.g., USB memory), etc. It can be implemented in the form of.

[0051] As an example, the memory (120) may store a computer program including at least one instruction or instructions for controlling the electronic device (100).

[0052] In another example, the memory (120) may store an image received from an external device (e.g., a source device), an external storage medium (e.g., USB), an external server (e.g., a web hard drive), or the like, i.e., an input image. Alternatively, the memory (120) may store an image acquired through a camera (not shown) provided in the electronic device (100). Here, the image may be a 2D video, but is not limited thereto.

[0053] As another example, the memory (120) may store various information required for image quality processing, such as information, algorithms, image quality parameters, etc. for performing at least one of Noise Reduction, Detail Enhancement, Tone Mapping, Contrast Enhancement, Color Enhancement, or Frame Rate Conversion. In addition, the memory (120) may also store an intermediate image generated by image processing and an image generated based on depth information.

[0054] According to one embodiment, the memory (120) may be implemented as a single memory that stores data generated from various operations according to the present disclosure. However, according to another embodiment, the memory (120) may be implemented to include multiple memories that each store different types of data or each store data generated at different stages.

[0055] In the above-described embodiment, it has been described that various data are stored in the external memory (120) of the processor (130), but at least some of the above-described data may be stored in the internal memory of the processor (130) according to an implementation example of at least one of the electronic device (100) or the processor (130).

[0056] One or more processors (130) control the overall operation of the electronic device (100). Specifically, one or more processors (130) may be connected to each component of the electronic device (100) to control the overall operation of the electronic device (100). For example, one or more processors (130) may be electrically connected to the display (110) and the memory (120) to control the overall operation of the electronic device (100). One or more processors (130) may be configured as one or more processors.

[0057] One or more processors (130) may perform operations of the electronic device (100) according to various embodiments by executing at least one instruction stored in the memory (120).

[0058] The artificial intelligence-related functions according to the present disclosure can be operated through the processor and memory of the electronic device.

[0059] One or more processors (130) may be composed of one or more processors. In this case, one or more processors may include at least one of a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), and an NPU (Neural Processing Unit), but are not limited to the examples of the processors described above.

[0060] CPUs are general-purpose processors capable of performing not only general calculations but also artificial intelligence calculations. Their multi-layered cache structure allows for the efficient execution of complex programs. CPUs are advantageous for serial processing, enabling organic linking of previous and subsequent calculation results through sequential calculations. General-purpose processors are not limited to the examples described above, except where specifically identified as CPUs.

[0061] A GPU is a processor designed for large-scale computations, such as floating-point operations used in graphics processing. It integrates a large number of cores to perform large-scale computations in parallel. In particular, GPUs may be advantageous over CPUs in parallel processing methods, such as convolution operations. Furthermore, GPUs can be used as coprocessors to supplement the functions of CPUs. Processors for large-scale computations are not limited to the examples described above, except in cases where they are specifically referred to as GPUs.

[0062] An NPU is a processor specialized in artificial intelligence computation using artificial neural networks, and each layer of the artificial neural network can be implemented in hardware (e.g., silicon). Since NPUs are designed specifically according to the company's specifications, they have less freedom than CPUs or GPUs, but can efficiently process the AI ​​computations requested by the company. Meanwhile, as a processor specialized in AI computation, an NPU can be implemented in various forms, such as a Tensor Processing Unit (TPU), an Intelligence Processing Unit (IPU), or a Vision Processing Unit (VPU). Except as specifically designated as an NPU, an AI processor is not limited to the examples described above.

[0063] Additionally, one or more processors (130) may be implemented as a System on Chip (SoC). In this case, the SoC may further include, in addition to one or more processors (130), a memory (110), and a network interface such as a bus for data communication between the processor (130) and the memory (110).

[0064] When a System on Chip (SoC) included in an electronic device (100) includes multiple processors, the electronic device (100) may perform operations related to artificial intelligence (e.g., operations related to learning or inference of an artificial intelligence model) by using some of the multiple processors. For example, the electronic device may perform operations related to artificial intelligence by using at least one of a GPU, an NPU, a VPU, a TPU, and a hardware accelerator specialized in artificial intelligence operations such as convolution operations and matrix multiplication operations among the multiple processors. However, this is only one or more embodiments, and it is of course possible to process operations related to artificial intelligence by using a CPU or a general-purpose processor.

[0065] Additionally, the electronic device (100) can perform operations related to functions related to artificial intelligence by utilizing multiple cores (e.g., dual cores, quad cores, etc.) included in a single processor. In particular, the electronic device can perform artificial intelligence operations, such as convolution operations and matrix multiplication operations, in parallel by utilizing multiple cores included in the processor.

[0066] One or more processors (130) are controlled to process input data according to predefined operation rules or artificial intelligence models stored in the memory (110). The predefined operation rules or artificial intelligence models are characterized by being created through learning.

[0067] Here, "created through learning" means that a predefined set of behavioral rules or an artificial intelligence model with desired characteristics is created by applying a learning algorithm to a large number of learning data. This learning may be performed on the device itself, where the artificial intelligence according to the present disclosure is implemented, or through a separate server / system.

[0068] An artificial intelligence model may be composed of multiple neural network layers. At least one layer has at least one weight value and performs its own operation through the operation result of the previous layer and at least one defined operation. Examples of neural networks include a convolutional neural network (CNN), a recurrent neural network (RNN), a deep neural network (DNN), a restricted boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), deep Q-networks, and a transformer. The neural networks in the present disclosure are not limited to the above-described examples unless otherwise specified.

[0069] A learning algorithm is a method for training a target device (e.g., a robot) using a plurality of learning data sets so that the target device can make decisions or predictions on its own. Examples of learning algorithms include supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning. The learning algorithms in the present disclosure are not limited to the aforementioned examples unless otherwise specified. For convenience of explanation, one or more processors (130) will be referred to as "processors (130)" below.

[0070] FIG. 2b is a block diagram illustrating a detailed configuration of an electronic device according to one or more embodiments.

[0071] According to FIG. 2a, the electronic device (100') includes a thermal imaging camera (110), a memory (120), one or more processors (130), an output interface (140), a communication interface (150), and a user interface (160). Among the configurations illustrated in FIG. 2b, a detailed description of configurations that overlap with those illustrated in FIG. 2a will be omitted.

[0072] The output interface (140) may include a plurality of light-emitting elements. For example, the plurality of light-emitting elements may be implemented as a plurality of LED elements, but is not limited thereto. For example, the plurality of light-emitting elements may be implemented as LED lamps.

[0073] A plurality of light-emitting elements may be arranged at preset intervals along at least one edge region of an outer region of an electronic device (100'), for example, a border frame region of an exhaust port. For example, the light-emitting elements may be arranged in at least one region among an upper frame region, a lower frame region, a left frame region, and a right frame region. For example, a transparent sheet may be arranged on an LED module so that the lights of the plurality of LEDs are displayed continuously without a border.

[0074] The plurality of light-emitting elements may be implemented to have the same color or different colors. For example, the plurality of light-emitting elements may have at least one of white and yellow, but this is not limited thereto. Furthermore, the plurality of light-emitting elements may be implemented to have different colors depending on their placement.

[0075] Additionally, in some cases, pairs of LEDs of different colors may be placed adjacent to each other. That is, at least two or more LEDs may be placed adjacent to each other at the same location to provide display patterns of two or more colors. For example, if multiple pairs of LEDs placed at the same location are composed of red LEDs and blue LEDs, only the red LEDs or only the blue LEDs may be used, or both the red LEDs and the blue LEDs may be used simultaneously to display a pink display pattern, depending on the UI screen.

[0076] The communication interface (150) includes a circuit and can communicate with an external device (server or user terminal). For example, the processor (130) can receive various data or information from an external device connected via the communication interface (150) and can also transmit various data or information to the external device.

[0077] The communication interface (150) may include at least one of a WiFi module, a Bluetooth module, a wireless communication module, an NFC module, and a UWB module (Ultra Wide Band). At this time, the wireless communication module may perform communication according to various communication standards such as IEEE, Zigbee, 3G (3rd Generation), 3GPP (3rd Generation Partnership Project), LTE (Long Term Evolution), 5G (5th Generation), etc.

[0078] The user interface (160) may be implemented as a device such as a button, a touch pad, or a touch screen capable of performing the above-described display function and operation input function. According to one embodiment, the user interface (150) may be implemented as a remote control transceiver to receive a remote control signal. The remote control transceiver may receive a remote control signal from an external remote control device or transmit a remote control signal through at least one of infrared communication, Bluetooth communication, and Wi-Fi communication.

[0079] In addition, the electronic device (100') may further include a speaker, a microphone, and a sensor.

[0080] The speaker can convert and amplify a digital audio signal processed by the processor (130) into an analog audio signal and output the same. For example, the speaker can include at least one speaker unit, a D / A converter, an audio amplifier, etc., which can output at least one channel. For example, the speaker can output various notifications, messages, information, etc. related to the guide information generated by the processor (130).

[0081] A microphone is a component that receives user voice or other sounds and converts them into audio data. In one example, the processor (130) may use audio received through the microphone as context data for the electronic device (100). However, in another embodiment, the electronic device (100) may receive user voice input from an external device through the communication interface (150).

[0082] The sensors may include various types of sensors, such as temperature sensors, light sensors, touch sensors, proximity sensors, humidity sensors, infrared sensors, biosensors, etc.

[0083] FIG. 3 is a flowchart illustrating a method of controlling an electronic device according to one or more embodiments.

[0084] According to FIG. 3, the electronic device (100) can obtain a thermal image of the induction where the container is placed using a thermal imaging camera (110) (S310).

[0085] According to the work, the electronic device (100) can turn on the thermal imaging camera (110) to acquire a thermal image when a critical time has elapsed after cooking has started on the induction stove or when cooking has ended on the induction stove. In this case, the electronic device (100) can receive a signal related to the start and / or end of cooking on the induction stove from the induction stove.

[0086] For example, the electronic device (100) can turn on the thermal imaging camera (110) according to a user command to acquire a thermal image.

[0087] The electronic device (100) can acquire noise information of a surrounding area excluding an area where a container is placed (hereinafter, referred to as the container area) based on a thermal image and a reference image (S320). For example, the reference image may be information about the surrounding area if there is no blur due to heat and / or moisture. For example, the surrounding area excluding the container area is only affected by normal radiant heat conduction and maintains a nearly constant state. In this case, the corresponding image may be the reference image. However, the reference image does not necessarily have to be in the form of an image and may be implemented in various forms that include data values ​​of the corresponding surrounding area. For example, it may be in the form of a lookup table that includes pixel values ​​of each pixel included in the surrounding area. The pixel values ​​may include at least one of a temperature value of each pixel area included in the surrounding area or a color value corresponding to the temperature.

[0088] For example, the reference image may include multiple reference images corresponding to changes in temperature values ​​over time. The electronic device (100) may obtain noise information over time by comparing multiple thermal image images sequentially acquired over time through the thermal imaging camera (110) with multiple reference images at corresponding points in time.

[0089] According to an example, the electronic device (100) may obtain noise information based on pixel difference information between a thermal image and a reference image. For example, the electronic device (100) may obtain a difference value by comparing first pixel values ​​of first pixels included in a peripheral area excluding a container area in a thermal image with second pixel values ​​of second pixels included in a peripheral area excluding a container area in a reference image, and may obtain the obtained difference value as noise information. For example, the electronic device (100) may identify second pixels corresponding to respective positions (or coordinates) of first pixels, compare pixel values ​​of the corresponding pixels, and obtain a difference value at each pixel position as noise information.

[0090] As an example, the electronic device (100) can obtain noise information by inputting a thermal image and a reference image into a learned artificial intelligence model.

[0091] The electronic device (100) can obtain a corrected image from which noise has been removed based on a thermal image and noise information (S340). That is, the electronic device (100) can obtain a corrected image by removing blur caused by heat and / or moisture from an image obtained through a thermal imaging camera (110).

[0092] The electronic device (100) can obtain temperature information of the handle portion of the container based on the obtained correction image (S350).

[0093] For example, the memory (120) may store multiple images corresponding to the handle portion of a container. For example, the memory (120) may store multiple images corresponding to the handle shapes of various types of containers. The electronic device (100) may identify at least one of the multiple images corresponding to the handle portion of the container in the corrected image, thereby identifying the handle portion of the container in the corrected image.

[0094] For example, the electronic device (100) can obtain temperature information of the handle portion of the container based on color information of the handle portion of the container in the corrected image.

[0095] The electronic device (100) can provide guide information on the acquired temperature information (S360).

[0096] For example, the electronic device (100) can provide guide information by adjusting the light-emitting state of a plurality of light-emitting elements included in the output interface (140) based on temperature information of the handle portion of the container.

[0097] According to an example, the electronic device (100) can provide guide information by adjusting at least one of the light-emitting color, light-emitting pattern, or light-emitting time of a plurality of light-emitting elements based on temperature information of the handle portion of the container.

[0098] According to an example, a plurality of light-emitting elements may be divided into a plurality of light-emitting groups arranged at different positions based on the exhaust port of the electronic device (100). The electronic device (100) may provide guide information by adjusting the light-emitting state of at least one light-emitting group among the plurality of light-emitting groups based on temperature information of the handle portion of the container.

[0099] FIG. 4 is a drawing for explaining an induction shooting method according to one or more embodiments.

[0100] According to FIG. 4, the electronic device (100) can capture an image of the induction device (10) using a thermal imaging camera (110). For example, the image (410) acquired through the thermal imaging camera (110) may be a top-view image or an image captured at an angle close to a top-view image, as illustrated in FIG. 4. The image (410) acquired through the thermal imaging camera (110) may be an image expressed in different colors depending on the temperature, as illustrated in FIG. 4.

[0101] FIGS. 5A and 5B are drawings for explaining temperature value changes in a region surrounding a container according to one or more embodiments.

[0102] As illustrated in Fig. 5a, when the induction device (10) is in operation, the surrounding area, excluding the container area, is only affected by normal radiant heat conduction and remains in a nearly constant state (510). The electronic device (100) can store temperature information of the surrounding area of ​​the container under normal conditions as reference information (or reference image) in the memory (120).

[0103] As shown in Fig. 5b, when the induction device (10) is in operation, the surrounding area excluding the container area experiences a temperature increase due to blur caused by heat and / or moisture (520).

[0104] Accordingly, the electronic device (100) can obtain noise information based on difference information between the reference information (or reference image) (510) stored in the memory (120) and the data of the image acquired through the thermal imaging camera (110). That is, the electronic device (100) can calibrate the data of the image acquired through the thermal imaging camera (110) based on the reference information (or reference image) (510) stored in the memory (120) to obtain correction data (or correction image).

[0105] FIG. 6 is a diagram for explaining a method for obtaining noise information according to one or more embodiments.

[0106] For example, the electronic device (100) can input the thermal image (610) and the reference image (620) into a learned artificial intelligence model to obtain noise information. In FIG. 6, the temperature information of the container area is also expressed in the thermal image (610) and the reference image (620), but the temperature of the container area is not related to obtaining noise information, so it can be ignored. For example, the thermal image (610) is an image that includes only temperature information of the surrounding area excluding the container area, and the reference image can also be implemented as an image that includes only temperature information of the surrounding area excluding the container area.

[0107] In this case, the artificial intelligence model may be a model trained to acquire noise information in the surrounding area excluding the container area based on a thermal image and a reference image. For example, the artificial intelligence model may be trained using the thermal image and reference image acquired from multiple training images, and the noise information of each of the multiple training images, as input / output training data pairs.

[0108] In another embodiment, the processor (110) may input a portion of a thermal image and a reference image into an artificial intelligence model to obtain noise information. In this case, the artificial intelligence model may include only pixel information of a peripheral area excluding the container area, where the portion of the thermal image is located. In this case, the reference image may also include only pixel information of a peripheral area excluding the container area.

[0109] Here, the learning of an artificial intelligence model means that a basic artificial intelligence model (e.g., an artificial intelligence model including any random parameters) is trained using a learning algorithm using a plurality of training data, thereby creating a predefined set of operation rules or an artificial intelligence model set to perform a desired characteristic (or purpose). This learning may be performed through a separate server and / or system, but is not limited thereto, and may also be performed on an electronic device. Examples of learning algorithms include, but are not limited to, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning.

[0110] Here, the artificial intelligence model can be implemented as, for example, a Convolutional Neural Network (CNN), a Recurrent Neural Network (RNN), a Restricted Boltzmann Machine (RBM), a Deep Belief Network (DBN), a Bidirectional Recurrent Deep Neural Network (BRDNN), or a Deep Q-Network, but is not limited thereto.

[0111] FIG. 7 is a drawing for explaining a method for identifying a container handle portion according to one or more embodiments.

[0112] According to an example, the memory (120) may store a plurality of images corresponding to a handle portion of a container. For example, the memory (120) may store a plurality of images corresponding to handle shapes of various types of containers. As illustrated in FIG. 7, the electronic device (100) may identify at least one of the plurality of images corresponding to the handle portion of a container in the corrected image (710) to identify the handle portion (711) of the container in the corrected image. For example, the electronic device (100) may identify the handle portion included in the input image through at least one of object recognition, object detection, object tracking, or image segmentation. For example, the electronic device (100) can identify a handle portion by using techniques such as semantic segmentation, which extracts objects included in an input image by classifying them by type as needed, instance segmentation, which recognizes objects by classifying them by object even if they are the same type, and a bounding box in the shape of a rectangle that includes the detected object when detecting an object included in an image.

[0113] FIG. 8 is a drawing for explaining the arrangement of light-emitting elements according to one or more embodiments.

[0114] According to FIG. 8, temperature information for a container handle portion can be guided using lamps positioned in a plurality of directions based on an exhaust port of an electronic device (100) implemented as a hood device. For example, the electronic device (100) can adjust the positions of lamps that light up among a plurality of lamps differently based on the temperature of the handle portion when a user's hand approaches the handle or when cooking is finished, or control the light-emitting state and / or light-emitting color differently. For example, the electronic device (100) can light up lamps in different positions depending on the temperature of the handle portion. For example, the electronic device (100) can control the light-emitting pattern of the lamps differently depending on the temperature of the handle portion. For example, the electronic device (100) can control the light-emitting of the lamps to light up in different colors (e.g., red / yellow / green) depending on the temperature of the handle portion.

[0115] FIG. 9 is a drawing for explaining the light-emitting state of a light-emitting element according to one or more embodiments.

[0116] For example, as illustrated in FIG. 9, the electronic device (100) can guide the user through temperature information of the temperature handle portion using a downlight lamp. For example, the temperature of the handle portion can be intuitively guided to the user by emitting light in different colors in the handle portion depending on the temperature of the handle portion.

[0117] As described above, according to various embodiments, a thermal imaging camera can be mounted on the hood device to acquire temperature values ​​for an induction region of interest, thereby providing temperature information for that region. Specifically, noise caused by heat and / or moisture can be removed from the thermal image, and the handle portion of the container can be extracted using an AI model, thereby obtaining accurate temperature information for the handle portion of the container. Furthermore, by informing the user of the temperature of the handle portion using a lamp on the hood, safety and convenience can be enhanced.

[0118] Meanwhile, the methods according to the various embodiments of the present disclosure described above can be implemented only with a software upgrade or a hardware upgrade for an existing electronic device.

[0119] Additionally, the various embodiments of the present disclosure described above can also be performed through an embedded server provided in an electronic device, or an external server of the electronic device.

[0120] Meanwhile, according to a temporary example of the present disclosure, the various embodiments described above can be implemented as software including instructions stored in a machine-readable storage medium that can be read by a machine (e.g., a computer). The device is a device that can call instructions stored from the storage medium and operate according to the called instructions, and may include an electronic device (e.g., electronic device (A)) according to the disclosed embodiments. When an instruction is executed by a processor, the processor can perform a function corresponding to the instruction directly or by using other components under the control of the processor. The instruction may include code generated or executed by a compiler or interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' means that the storage medium does not contain a signal and is tangible, but does not distinguish between data being stored semi-permanently or temporarily in the storage medium.

[0121] Furthermore, according to one embodiment of the present disclosure, the method according to the various embodiments described above may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or online through an application store (e.g., Play Store™). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0122] In addition, each of the components (e.g., modules or programs) according to the various embodiments described above may be composed of a single or multiple entities, and some of the corresponding sub-components described above may be omitted, or other sub-components may be further included in various embodiments. Alternatively or additionally, some components (e.g., modules or programs) may be integrated into a single entity, which may perform the same or similar functions as those performed by each of the corresponding components prior to integration. Operations performed by modules, programs or other components according to various embodiments may be executed sequentially, in parallel, iteratively or heuristically, or at least some operations may be executed in a different order, omitted, or other operations may be added.

[0123] Although the preferred embodiments of the present disclosure have been illustrated and described above, the present disclosure is not limited to the specific embodiments described above, and various modifications may be made by a person having ordinary skill in the art to which the present disclosure pertains without departing from the gist of the present disclosure as claimed in the claims, and such modifications should not be understood individually from the technical idea or prospect of the present disclosure.

Claims

1. In electronic devices, thermal imaging camera; a memory storing at least one instruction; and comprising one or more processors; The one or more processors, by executing the at least one instruction, When a thermal image of the induction where the container is placed is acquired using the thermal image camera, noise information of the surrounding area excluding the area where the container is placed is acquired based on the thermal image and the reference image. Obtaining temperature information of the handle portion of the container based on a noise-removed corrected image obtained based on the thermal image and the noise information, An electronic device providing guide information for the above acquired temperature information.

2. In paragraph 1, The one or more processors, by executing the at least one instruction, An electronic device that obtains the noise information based on pixel difference information between the thermal image and the reference image.

3. In paragraph 1, The one or more processors, by executing the at least one instruction, An electronic device that obtains the noise information by inputting the thermal image and the reference image into a learned artificial intelligence model.

4. In paragraph 1, The above reference image is, Contains multiple reference images corresponding to changes in temperature values ​​over time, The one or more processors, by executing the at least one instruction, An electronic device that obtains noise information over time by comparing a plurality of thermal images sequentially acquired over time through the thermal imaging camera with a plurality of reference images at corresponding points in time.

5. In paragraph 1, The above memory is, Store multiple images corresponding to the handle part of the container, The one or more processors, by executing the at least one instruction, Identifying at least one of a plurality of images corresponding to the handle portion of the container in the above-mentioned correction image, thereby identifying the handle portion of the container in the above-mentioned correction image, An electronic device that obtains temperature information of a handle portion of the container based on color information of the handle portion of the container.

6. In paragraph 1, further comprising an output interface including a plurality of light-emitting elements; The one or more processors, by executing the at least one instruction, An electronic device that provides the guide information by adjusting the light-emitting state of the plurality of light-emitting elements based on temperature information of the handle portion of the container.

7. In paragraph 1, The one or more processors, by executing the at least one instruction, An electronic device that provides the guide information by adjusting at least one of the light-emitting color, light-emitting pattern, or light-emitting time of the plurality of light-emitting elements based on temperature information of the handle portion of the container.

8. In paragraph 1, The above electronic device is implemented as a hood device, The above plurality of light-emitting elements are, It is divided into multiple light-emitting groups arranged at different positions based on the exhaust port of the above hood device, The one or more processors, by executing the at least one instruction, An electronic device that provides the guide information by adjusting the light-emitting state of at least one light-emitting group among the plurality of light-emitting groups based on temperature information of the handle portion of the container.

9. In paragraph 1, The one or more processors, by executing the at least one instruction, An electronic device that turns on the thermal imaging camera to acquire the thermal image when a critical time has elapsed after cooking has started on the induction or when cooking has ended on the induction.

10. In a method for controlling an electronic device, A step of obtaining a thermal image of an induction where a container is placed using a thermal imaging camera; A step of acquiring noise information of a surrounding area excluding an area where the container is placed based on the thermal image and the reference image; A step of obtaining temperature information of a handle portion of the container based on a noise-removed corrected image obtained based on the thermal image and the noise information; and A control method comprising: a step of providing guide information for the acquired temperature information; 11. In paragraph 10, The step of obtaining the above noise information is: A control method for obtaining the noise information based on pixel difference information between the thermal image and the reference image.

12. In paragraph 10, The step of obtaining the above noise information is: A control method for obtaining the noise information by inputting the thermal image and the reference image into a learned artificial intelligence model.

13. In paragraph 10, The above reference image is, Contains multiple reference images corresponding to changes in temperature values ​​over time, The step of obtaining the above noise information is: A control method for obtaining noise information over time by comparing a plurality of thermal images sequentially acquired over time through the thermal imaging camera with a plurality of reference images at corresponding points in time.

14. In paragraph 11, The above electronic device, Store multiple images corresponding to the handle part of the container, The step of obtaining temperature information of the handle portion of the above container is: A step of identifying the handle portion of the container in the correction image by identifying at least one of a plurality of images corresponding to the handle portion of the container in the correction image; and A control method, comprising: a step of obtaining temperature information of a handle portion of the container based on color information of the handle portion of the container.

15. A non-transitory computer-readable medium storing computer instructions that, when executed by a processor of an electronic device, cause the electronic device to perform an operation, The above actions are, A step of obtaining a thermal image of an induction where a container is placed using a thermal imaging camera; A step of acquiring noise information of a surrounding area excluding an area where the container is placed based on the thermal image and the reference image; A step of obtaining temperature information of a handle portion of the container based on a noise-removed corrected image obtained based on the thermal image and the noise information; and A non-transitory computer-readable medium comprising: a step of providing guide information for the acquired temperature information;

Images