Refrigerator and control method thereof

Abstract

A refrigerator includes: a user interface; the temperature sensor detects the temperature outside the refrigerator; a cooling unit that controls the temperature inside the refrigerator; a memory storing one or more instructions; the one or more processors are used for executing one or more instructions, and the one or more instructions comprise the steps that type information related to an object in the refrigerator and current temperature information related to the object are obtained; comparing the current temperature with a first temperature based on the type information and the current temperature information of the object, when the current temperature of the object is identified to be higher than the first temperature, identifying a first time required for the temperature of the object in the refrigerator to reach the first temperature based on a first set temperature in the refrigerator, and when the current temperature of the object is identified to be lower than the first temperature, identifying a second time required for the temperature of the object in the refrigerator to reach the first temperature. A second time required for the temperature of the object to reach the first temperature after the object is taken out of the refrigerator is identified based on the temperature outside the refrigerator, and a notification is provided when at least one of the first time and the second time has been identified to have elapsed.

Description

Technical Field

[0001] The present disclosure relates to a refrigerator and a control method thereof, and more particularly, to a refrigerator for providing an object stored in the refrigerator at an optimal temperature at a target time set by a user and a control method thereof. Background Art

[0002] A refrigerator is used to store food or beverages in a fresh state. The refrigerator may include a cooling unit, which includes a compressor, a condenser, an expander, and an evaporator, which circulate a refrigerant and form a cooling cycle. The refrigerator maintains the temperature of a storage space inside the refrigerator at a temperature lower than room temperature through the cooling unit, so that food or beverages can be stored in a fresh state for a long time.

[0003] The food or beverage stored in the refrigerator has a temperature that best suits the taste of the food or beverage for each characteristic. The temperature that best suits the taste of the food or beverage is usually different from the room temperature outside the refrigerator or the set temperature inside the refrigerator.

[0004] In order to provide the user with food or beverages at a temperature most suitable for the taste of the food or beverage as described above, the prior art refrigerator may adjust the temperature to a desired set temperature or set a storage environment corresponding to the characteristics of the food or beverage.

[0005] Therefore, it is necessary to determine the time required to reach the temperature that best suits the taste of the food or beverage based on the characteristics of the food or beverage stored in the refrigerator and the current temperature information, and to provide food or beverages at the temperature that best suits the taste of the food or beverage within the expected time set by the user. Summary of the invention

[0006] Technical Solutions

[0007] According to one aspect of the present disclosure, a refrigerator includes: a user interface; a temperature sensor configured to sense the temperature outside the refrigerator; a cooler configured to adjust the temperature inside the refrigerator; a memory configured to store at least one instruction; and one or more processors configured to execute at least one instruction to: obtain type information of an object in the refrigerator and current temperature information of the object, compare the current temperature of the object with a first temperature of the object based on the type information and the current temperature information, identify a first time when the temperature of the object inside the refrigerator reaches the first temperature based on a first set temperature inside the refrigerator based on identifying that the current temperature of the object is higher than the first temperature, identify a second time when the temperature of the object reaches the first temperature after the object is taken out of the refrigerator based on external temperature information of the refrigerator based on identifying that the current temperature of the object is lower than the first temperature, and provide a notification based on identifying that at least one of the first time or the second time has passed.

[0008] The one or more processors are further configured to execute at least one instruction to provide a notification to remove the object from the refrigerator based on identifying that the current temperature of the object is below the first temperature.

[0009] The one or more processors are also configured to execute at least one instruction to: obtain current temperature information of the object based on information related to at least one of the temperature outside the refrigerator or the first set temperature inside the refrigerator.

[0010] One or more processors are also configured to execute at least one instruction to: identify a target time set via the user interface; based on the identified first time not exceeding the target time, identify a third time to store the object in the refrigerator based on the first set temperature inside the refrigerator and the external temperature information of the refrigerator, and identify a fourth time when the object reaches the first temperature after the third time has passed; and based on the identification that the third time has passed, output a notification to remove the object from the refrigerator; and based on the identification that the fourth time has passed, provide a notification that the fourth time has passed.

[0011] The one or more processors are also configured to execute at least one instruction to: identify a target time set using a user interface, based on an identified first time exceeding the target time, identify a fifth time for an object located inside the refrigerator to reach a first temperature based on a second set temperature inside the refrigerator, and based on the fifth time not exceeding the target time, identify a sixth time for storing the object in the refrigerator based on the second set temperature inside the refrigerator and external temperature information of the refrigerator and a seventh time required for the object located outside the refrigerator to reach the first temperature after the sixth time has passed, based on identifying that the sixth time has passed, provide a notification to remove the object from the refrigerator, and based on identifying that the seventh time has passed, provide a notification that the seventh time has passed.

[0012] The one or more processors are further configured to execute at least one instruction to: provide a notification that the first temperature cannot be reached within the target time based on the fifth time exceeding the target time.

[0013] The one or more processors are further configured to execute at least one instruction to: provide a notification of changing the storage location of the object to a storage location corresponding to the second set temperature based on the fifth time not exceeding the target time.

[0014] The one or more processors are further configured to execute at least one instruction to: provide a notification to change the set temperature inside the refrigerator to a second set temperature based on the fifth time not exceeding the target time.

[0015] The one or more processors are also configured to execute at least one instruction to: identify a target time set using a user interface, based on identifying that a second time does not exceed the target time, identify an eighth time corresponding to a difference between the target time and the second time, based on identifying that the eighth time has passed, provide a notification to remove the object from the refrigerator, and based on identifying that the target time has passed, provide a notification that the target time has passed.

[0016] The one or more processors are also configured to execute at least one instruction to: identify a target time set using a user interface, provide a notification to remove an object from the refrigerator and information that the second time exceeds the target time based on identifying that a second time exceeds the target time, and provide a notification that the second time has passed based on identifying that the second time has passed.

[0017] The one or more processors are further configured to execute at least one instruction to: provide a notification to remove the object from the refrigerator based on identifying that the current temperature of the object is the same as the first temperature.

[0018] The first temperature of the object may be higher than a first set temperature inside the refrigerator and lower than a temperature outside the refrigerator.

[0019] According to one aspect of the present disclosure, a method for controlling a refrigerator includes: acquiring type information of an object in the refrigerator and current temperature information of the object; comparing the current temperature of the object with a first temperature of the object based on the type information and the current temperature information; identifying a first time when the temperature of the object inside the refrigerator reaches the first temperature based on a first set temperature inside the refrigerator based on identifying that the current temperature of the object is higher than the first temperature; identifying a second time when the temperature of the object reaches the first temperature after the object is taken out of the refrigerator based on external temperature information of the refrigerator based on identifying that the current temperature of the object is lower than the first temperature; and providing a notification based on identifying that at least one of the first time or the second time has passed.

[0020] Identifying the second time may include providing a notification to remove the object from the refrigerator based on identifying that the current temperature of the object is lower than the first temperature.

[0021] Acquiring the current temperature information of the object may include acquiring the current temperature information of the object based on information related to at least one of a temperature outside the refrigerator or a first set temperature inside the refrigerator.

[0022] According to one aspect of the present disclosure, a refrigeration device includes: a cooler configured to adjust the temperature inside the refrigeration device; a memory configured to store at least one instruction; and at least one processor configured to execute the at least one instruction to: obtain type information of an object in the refrigeration device and current temperature information of the object, compare the current temperature of the object with a first temperature of the object based on the type information and the current temperature information, identify a first time when the temperature of the object inside the refrigeration device reaches the first temperature based on a first set temperature inside the refrigeration device based on identification that the current temperature of the object is higher than the first temperature, identify a second time when the temperature of the object reaches the first temperature after the object is taken out of the refrigeration device based on external temperature information of the refrigeration device based on identification that the current temperature of the object is lower than the first temperature, and provide a notification based on identification that at least one of the first time or the second time has passed.

[0023] The at least one processor may be further configured to execute at least one instruction to: provide a notification to remove the object from the refrigeration device based on identifying that the current temperature of the object is below the first temperature.

[0024] The at least one processor may also be configured to execute at least one instruction to: obtain current temperature information of the object based on information related to a temperature outside the refrigeration device or a first set temperature inside the refrigeration device.

[0025] At least one processor may also be configured to execute at least one instruction to: identify a target time; based on the identified first time not exceeding the target time, identify a third time to store the object in the refrigeration device based on a first set temperature inside the refrigeration device and external temperature information of the refrigeration device, and identify a fourth time when the object reaches the first temperature after the third time has passed; and based on identifying that the third time has passed, provide a notification to remove the object from the refrigeration device; and based on identifying that the fourth time has passed, provide a notification that the fourth time has passed.

[0026] The target time may be set by user input. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] The above and other aspects and advantages of some embodiments of the present disclosure will become more apparent from the following detailed description taken in conjunction with the accompanying drawings, in which:

[0028] Figure 1 is a diagram showing a refrigerator according to one or more embodiments of the present disclosure;

[0029] Figure 2 is a block diagram showing a configuration of a refrigerator according to one or more embodiments of the present disclosure;

[0030] Figure 3is a flowchart illustrating the operation of a refrigerator according to one or more embodiments of the present disclosure;

[0031] Figure 4 is a diagram illustrating a first time required for the temperature of an object stored in a refrigerator to reach an optimal temperature when a current temperature of the object stored in the refrigerator is the same as a temperature outside the refrigerator according to one or more embodiments of the present disclosure;

[0032] Figure 5 is a diagram showing a second time required for the temperature of an object stored in a refrigerator to reach an optimal temperature when the current temperature of the object is the same as the set temperature inside the refrigerator according to one or more embodiments of the present disclosure;

[0033] Figure 6 is a diagram illustrating an operation of providing information on taking out an object from a refrigerator to a user according to one or more embodiments of the present disclosure;

[0034] Figure 7 is a diagram illustrating an operation of a refrigerator when a user sets a target time and a current temperature of an object stored in the refrigerator is the same as a temperature outside the refrigerator according to one or more embodiments of the present disclosure;

[0035] Figure 8 is a diagram illustrating an operation of a processor identifying a third time and a fourth time when a first time does not exceed a target time according to one or more embodiments of the present disclosure;

[0036] Fig. 9 is a diagram illustrating an operation of a processor identifying a fifth time when a first time exceeds a target time according to one or more embodiments of the present disclosure;

[0037] Fig.10 is a diagram illustrating an operation of a processor identifying a sixth time and a seventh time when a fifth time does not exceed a target time according to one or more embodiments of the present disclosure;

[0038] Fig.11 is a diagram illustrating an operation of a processor identifying a fifth time exceeding a target time when a first time exceeds a target time according to one or more embodiments of the present disclosure;

[0039] Fig.12 is a diagram illustrating an operation of providing a user with information that a refrigerator cannot reach an optimal temperature within a target time according to one or more embodiments of the present disclosure;

[0040] Fig.13 is a diagram illustrating an operation of the refrigerator providing information to a user to change a storage location of an object to a storage location corresponding to a second set temperature when a fifth time does not exceed a target time according to one or more embodiments of the present disclosure;

[0041] Fig.14 is a diagram showing storage locations inside a refrigerator according to one or more embodiments of the present disclosure;

[0042] Fig.15 is a diagram illustrating an operation of providing information instructing a refrigerator to change a set temperature inside the refrigerator to a second set temperature to a user when a fifth time does not exceed a target time according to one or more embodiments of the present disclosure;

[0043] Fig.16 is a diagram illustrating an operation of a refrigerator when a user sets a target time and a current temperature of an object stored in the refrigerator is the same as a set temperature inside the refrigerator according to one or more embodiments of the present disclosure;

[0044] Fig.17 is a diagram illustrating an operation of a processor identifying an eighth time when the second time does not exceed the target time according to one or more embodiments of the present disclosure;

[0045] Fig.18 is a diagram illustrating an operation of a refrigerator when a second time exceeds a target time according to one or more embodiments of the present disclosure;

[0046] Fig.19 is a diagram showing a method in which a refrigerator according to one or more embodiments of the present disclosure performs operations according to the present disclosure by communicating with a server or a user terminal device;

[0047] Fig. 20 is a block diagram showing a configuration of a refrigerator according to one or more embodiments of the present disclosure; and

[0048] Fig.21 is a flowchart illustrating the operation of a refrigerator according to one or more embodiments of the present disclosure. DETAILED DESCRIPTION

[0049] The present disclosure describes various embodiments, some of which are shown in the accompanying drawings and described in detail in the detailed description. However, the present disclosure is not intended to limit the embodiments described herein, but includes various modifications, equivalents and / or alternatives. In the context of the description of the accompanying drawings, similar reference numerals may be used for similar elements.

[0050] In describing the present disclosure, a detailed description of known functions or configurations incorporated herein will be omitted as it may make the subject matter of the present disclosure unclear.

[0051] In addition, the embodiments described below can be modified in various forms, and the scope of the technical concept of the present disclosure is not limited to the following embodiments. Rather, these embodiments are provided so that the present disclosure will be comprehensive and complete, and the scope of the present disclosure will be fully conveyed to those skilled in the art.

[0052] The terms used in the present disclosure are only used to describe specific embodiments and are not intended to limit the scope of the present disclosure. Unless the context clearly indicates otherwise, an expression in the singular includes an expression in the plural.

[0053] In this document, the expressions “have”, “may have”, “include” or “may include” may be used to indicate the existence of features (eg, components such as values, functions, operations, parts, etc.) and do not exclude the existence of additional features.

[0054] Expressions such as “A or B,” “at least one of A and / or B,” or “one or more of A and / or B” include all possible combinations of the listed items. For example, “A or B,” “at least one of A and B,” or “at least one of A or B” includes (1) at least one A, (2) at least one B, and / or (3) both A and B.

[0055] The expressions “first”, “second”, etc. used in the present disclosure may indicate various components regardless of the order and / or importance of the components, and are merely used to distinguish one component from another component, and do not limit the corresponding components.

[0056] It should be understood that an element (e.g., a first element) being “operably or communicatively coupled to” / “operably or communicatively coupled to” another element (e.g., a second element) means that any such element may be directly connected to another element, or may be connected via yet another element (e.g., a third element).

[0057] When one element (for example, a first element) is “directly connected to” or “directly accesses” another element (for example, a second element), it can be understood that there are no other elements (for example, a third element) between the elements.

[0058] In this document, the expression "configured to" may be used interchangeably with, for example, "suitable for," "capable of," "designed to," "suitable for," "manufactured to," or "capable of." The expression "configured to" does not necessarily mean "specifically designed to" in hardware.

[0059] In some cases, "a device configured to..." may indicate that such a device can perform operations together with another device or component. For example, the expression "a processor configured to perform A, B, and C" may indicate a dedicated processor (e.g., an embedded processor) that performs the corresponding actions, or a general-purpose processor (e.g., a central processing unit (CPU) or an application processor (AP)) that can perform the corresponding actions by executing one or more software programs stored in a storage device.

[0060] Terms such as "module", "unit", "component", etc. are used to refer to elements that perform at least one function or operation, and such elements can be implemented as hardware or software, or a combination of hardware and software. In addition, except when each of multiple "modules", "units", "components", etc. needs to be implemented in separate hardware, these components can be integrated in at least one module or chip and can be implemented in at least one processor.

[0061] The various elements and regions in the drawings are schematically drawn. Therefore, the technical spirit of the present disclosure is not limited by the relative sizes or intervals drawn in the drawings.

[0062] Hereinafter, embodiments will be described in detail with reference to the accompanying drawings so that those skilled in the art to which the present disclosure pertains can easily make and use the embodiments.

[0063] Figure 1 is a diagram illustrating a refrigerator 100 according to one or more embodiments of the present disclosure.

[0064] refer to Figure 1 The present disclosure may relate to a refrigerator 100, but is not limited thereto, and may relate to various cooling devices, storage devices having a storage space for storing food or beverages therein, for example, a wine storage device, a wine refrigerator 100, a kimchi refrigerator 100, a refrigeration device, a refrigeration container, a freezing device, a freezing container, a freezer, etc.

[0065] Figure 2 is a block diagram illustrating a configuration of a refrigerator 100 according to one or more embodiments of the present disclosure.

[0066] refer to Figure 2 , wherein a refrigerator 100 having at least one storage space may include a user interface 110, a temperature sensor 120, a cooling unit (or cooler) 130, a memory 140 and at least one processor 150, but is not limited thereto and may also include various configurations required for the operation of the refrigerator 100 or omit some configurations.

[0067] The user interface 110 may include buttons, levers, switches, a touch interface, etc. The touch interface may be implemented by receiving a user's touch input via a touch panel on a screen of a display 170 disposed in an area of ​​the refrigerator 100 .

[0068] The touch panel may include a capacitive touch panel that detects changes in electrical signals, a pressure-sensitive touch panel that senses physical pressure, an infrared touch panel that forms an infrared grid to detect changes in the infrared grid, and a surface ultrasonic touch panel that forms an ultrasonic grid to detect changes in the ultrasonic grid.

[0069] The processor 150 may receive an input for selecting or adding an object (eg, food, beverage, alcohol, food ingredients, etc.) stored in the refrigerator 100 through the user interface 110 .

[0070] The processor 150 may receive an input for setting an alarm through the user interface 110 when a time required for the temperature of the object to reach the optimal temperature has elapsed.

[0071] The temperature sensor 120 may be a contact temperature sensor or a non-contact temperature sensor. The temperature sensor 120 may be a thermocouple temperature sensor, a resistance temperature sensor, an infrared temperature sensor, a bimetallic temperature sensor, a liquid expansion temperature sensor, and / or a state change temperature sensor.

[0072] The processor 150 may sense the temperature outside the refrigerator 100 through the temperature sensor 120 , thereby acquiring the temperature outside the refrigerator 100 .

[0073] In addition, the processor 150 can sense the temperature inside the refrigerator 100 through the temperature sensor 120, thereby acquiring temperature information inside the refrigerator 100. When the sensed temperature inside the refrigerator 100 is different from the set temperature inside the refrigerator 100, the processor 150 can control the cooling unit 130 so that the sensed temperature inside the refrigerator 100 is equal to the set temperature inside the refrigerator 100.

[0074] The cooling unit (or cooler) 130 may include a compressor, a condenser, an expander, and an evaporator, through which the refrigerant circulates, but is not limited thereto. The refrigerant undergoes compression, condensation, expansion, and evaporation processes to achieve a cooling cycle.

[0075] The processor 150 may control the cooling unit 130 to adjust the temperature inside the refrigerator 100. The processor 150 may control the cooling unit 130 so that the temperature inside the refrigerator corresponds to the set temperature inside the refrigerator 100.

[0076] The memory 140 temporarily or non-temporarily stores various programs or data, and transmits the stored information to the processor 150 according to the call of the processor 150. The memory 140 may store various types of information required for the operation, processing, and control operation of the processor 150 in an electronic format.

[0077] The memory 140 may include, for example, at least one of a main storage device and an auxiliary storage device. The main storage device may be implemented using a semiconductor storage medium such as a ROM and / or a RAM. The ROM may include, for example, a conventional ROM, an EPROM, an EEPROM, and / or a MASK-ROM. The RAM may include, for example, a DRAM and / or an SRAM. The auxiliary storage device may be implemented using at least one storage medium that can be permanently or semi-permanently stored, for example, an optical medium such as a flash memory, a secure digital (SD) card, a solid-state drive (SSD), a hard disk drive (HDD), a magnetic drum, a compact disk (CD), a DVD or a laser disk, a magnetic tape, a magneto-optical disk, and / or a floppy disk.

[0078] The memory 140 may store type information of objects stored in the refrigerator 100. The type information of the objects may be information such as the capacity of the objects, the type of the objects, the physical properties of the objects, and the optimal temperature of the objects.

[0079] The memory 140 may store the current temperature information of the object. The current temperature information of the object may correspond to the temperature outside the refrigerator or the set temperature inside the refrigerator 100. In addition, the current temperature information of the object may be acquired based on the type of the object, the physical properties of the object, the refrigeration time of the object, etc.

[0080] The memory 140 may store information about a set temperature inside the refrigerator 100 , information about a temperature outside the refrigerator 100 , and the like.

[0081] The memory 140 may store information of a time required for a current temperature of an object to reach an optimal temperature based on a capacity of the object, a type of the object, and a property of the object.

[0082] Likewise, the memory 140 may store a neural network model for calculating the time required for the current temperature of the object to reach the optimal temperature. The memory 140 may store information such as layers, nodes, weights, learning data, output data, etc. constituting the neural network model.

[0083] The memory 140 may store notification information notifying that the temperature of the subject has reached the optimal temperature. The memory 140 may store information about a target time input by a user.

[0084] The memory 140 can store information provided to the user, such as information indicating that an object needs to be taken out of the refrigerator 100, information indicating that the temperature of the object cannot reach the optimal temperature within the target time, information for changing the storage location of the object, information for changing the set temperature inside the refrigerator 100, etc.

[0085] The memory 140 may store various information used for the operation of the processor 150 or information acquired through the operation of the processor 150 .

[0086] One or more processors 150 control the overall operation of the electronic device. Specifically, the processor 150 is connected to the configuration of the electronic device including the above-mentioned memory 140, and executes at least one instruction stored in the above-mentioned memory 140, thereby controlling the operation of the electronic device as a whole. Specifically, the processor 150 can be implemented as multiple processors 150 or a single processor 150.

[0087] The processor 150 may be implemented in various ways, for example, as at least one of an application specific integrated circuit (ASIC), an embedded processor, a microprocessor, hardware control logic, a hardware finite state machine (FSM), a digital signal processor (DSP), and the like.

[0088] The processor 150 may include one or more of a central processing unit (CPU), a microcontroller unit (MCU), a microprocessor (MPU), a controller, an application processor (AP), a communication processor (CP), an advanced reduced instruction set computing (RISC) machine (ARM) processor, a dedicated processor, or may be defined as a corresponding term. The processor 150 may be implemented as a system on chip (SoC) type or a large-scale integration (LSI) type with a built-in processing algorithm, an application-specific integrated circuit (ASIC), or a field programmable gate array (FPGA) type. The processor 150 may perform various functions by executing computer-executable instructions stored in the memory 140. In addition, the processor 150 may include at least one of a graphics processing unit (GPU), a neural processing unit (NPU), and a visual processing unit (VPU), which is a separate AI-specific processor to perform artificial intelligence functions.

[0089] The one or more processors 150 may include one or more of a central processing unit (CPU), a graphics processing unit (GPU), an accelerated processing unit (APU), a multi-integrated core (MIC), a digital signal processor (DSP), a neural processing unit (NPU), a hardware accelerator, or a machine learning accelerator. The one or more processors 150 may control any combination of one or other components of the electronic device and may perform operations related to communication or data processing. The one or more processors 150 may execute one or more programs or instructions stored in the memory 140. For example, the one or more processors 150 may execute the method according to one or more embodiments of the present disclosure by executing one or more instructions stored in the memory 140.

[0090] When the method according to one or more embodiments of the present disclosure includes multiple operations, the multiple operations may be performed by one processor, or may be performed by multiple processors. For example, when the method according to one or more embodiments performs a first operation, a second operation, and a third operation, the first operation, the second operation, and the third operation may all be performed by a first processor, the first operation and the second operation may be performed by a first processor (e.g., a general-purpose processor), and the third operation may be performed by a second processor (e.g., an artificial intelligence-specific processor).

[0091] One or more processors 150 may be implemented as a single-core processor including one core, or may be implemented as one or more multi-core processors including multiple cores (e.g., homogeneous multi-cores or heterogeneous multi-cores). When one or more processors 150 are implemented as a multi-core processor, each of the multiple cores included in the multi-core processor may include an internal memory of the processor (e.g., on-chip memory), and the multi-core processor may include a common cache shared by the multiple cores. In addition, each of the multiple cores (or a portion of the multiple cores) included in the multi-core processor may independently read and execute program commands for implementing the method according to one or more embodiments of the present disclosure, and may read and execute program commands for implementing the method according to one or more embodiments of the present disclosure together with the entire core (or a portion) of the multiple cores.

[0092] When the method according to one or more embodiments of the present disclosure includes multiple operations, the multiple operations may be performed by one of the multiple cores included in the multi-core processor, or may be performed by multiple cores. For example, when the method according to one or more embodiments performs the first operation, the second operation, and the third operation, the first operation, the second operation, and the third operation may all be performed by the first core included in the multi-core processor, and the first operation and the second operation may be performed by the first core included in the multi-core processor, and the third operation may be performed by the second core included in the multi-core processor.

[0093] According to an embodiment of the present disclosure, a processor may represent a system on chip (SoC) that integrates one or more processors 150 and other electronic components, a single-core processor, a multi-core processor, or a core included in a single-core processor or a multi-core processor, wherein the core may be implemented as a CPU, a GPU, an APU, a MIC, a DSP, an NPU, a hardware accelerator, or a machine learning accelerator, but the embodiments of the present disclosure are not limited thereto.

[0094] The processor 150 may acquire type information of an object stored in the refrigerator 100 and current temperature information of the object. The object may be alcohol, including wine, but not limited thereto, and may include various foods, beverages, alcoholic beverages, food ingredients, and the like.

[0095] The processor 150 may compare the current temperature of the object with the optimal temperature of the object based on the type information of the object and the current temperature information of the object. The optimal temperature of the object may represent the most suitable temperature for tasting the object by eating or drinking (hereinafter referred to as tasting).

[0096] Based on recognizing that the current temperature of the object is higher than the optimal temperature, the processor 150 may identify a first time required for the temperature of the object located inside the refrigerator 100 to reach the optimal temperature based on first set temperature information inside the refrigerator 100 .

[0097] Based on recognizing that the current temperature of the object is lower than the optimal temperature, the processor 150 may identify a second time required for the temperature of the object located outside the refrigerator to reach the optimal temperature based on temperature information outside the refrigerator.

[0098] Based on recognizing that the current temperature of the object is low, the processor 150 may provide the user with information to take the object out of the refrigerator 100 .

[0099] If it is recognized that the first time or the second time has passed, the processor 150 may provide a notification to the user.

[0100] Will combine Figures 3 to 18 A more specific control operation of the processor 150 on the refrigerator 100 is described.

[0101] Reference Figures 3 to 6 Description When a target time (ie, a time required from a current time point to a time point when a user wants to taste an object) is not set, the processor 150 controls the operation of the refrigerator 100 .

[0102] Figure 3 is a flowchart illustrating the operation of the refrigerator 100 according to one or more embodiments of the present disclosure.

[0103] refer to Figure 3 In operation S305 , the processor 150 may acquire object type information and current temperature information of an object stored in the refrigerator 100 .

[0104] The type information of the object may include the type of the object (e.g., food, beverage, alcoholic beverage, food ingredient, etc.), physical properties of the object (e.g., viscosity, thermal conductivity, etc.), capacity of the object, optimal temperature of the object, etc. The optimal temperature of the object may refer to a temperature that is most suitable for tasting the object, but is not limited thereto.

[0105] For example, when the object entering the refrigerator 100 is wine, the processor 150 may receive type information of the wine (eg, type of wine, thermal conductivity of wine, capacity of wine, optimal temperature of wine, etc.) through the user interface 110 .

[0106] According to another embodiment of the present disclosure, when the processor 150 receives an input through the user interface 110 indicating that the type of object entering the refrigerator 100 is wine, the processor 150 can communicate with the server through the communication interface 160 to obtain type information of the wine to be entered (for example, the type of wine, the thermal conductivity of the wine, the capacity of the wine, the optimal temperature of the wine, etc.).

[0107] According to another embodiment, the processor 150 may obtain type information of the object by recognizing what the object entering the refrigerator 100 is through a camera provided in the refrigerator 100. The processor 150 may use a first neural network model (e.g., an image classification model) capable of classifying images to recognize the object entering the refrigerator 100 based on the image acquired through the camera and acquire the type information of the object.

[0108] The processor 150 may recognize that the current temperature of the object is the same as the temperature outside the refrigerator or the set temperature inside the refrigerator 100 based on the current temperature information of the object. That is, when the object located outside the refrigerator 100 is stored in the refrigerator 100, the current temperature of the object may be the same as the temperature outside the refrigerator, and when the current temperature of the object stored inside the refrigerator 100 for a predetermined time or more may be recognized as the same as the set temperature inside the refrigerator 100.

[0109] According to another embodiment, based on temperature information outside the refrigerator, set temperature information inside the refrigerator 100, the capacity of the object stored in the refrigerator 100, type information of the object, and the time the object is stored in the refrigerator 100, the processor 150 can obtain current temperature information of the object.

[0110] That is, when it is not the time for the object to enter the refrigerator 100 and the object has not been stored in the refrigerator 100 for a predetermined time or longer, the current temperature of the object may be lower than the temperature outside the refrigerator 100 and higher than the set temperature inside the refrigerator 100.

[0111] The processor 150 may identify the current temperature of the object based on temperature information outside the refrigerator 100 , set temperature information inside the refrigerator 100 , the capacity of the object stored in the refrigerator 100 , type information of the object, and the time the object is stored in the refrigerator 100 .

[0112] The processor 150 can obtain the current temperature information of the object from the temperature information outside the refrigerator 100, the set temperature information of the refrigerator 100, the capacity of the object stored in the refrigerator 100, the type information of the object, and the current temperature of the object corresponding to the storage time of the object in the refrigerator 100.

[0113] The processor 150 may compare the current temperature of the object with the optimal temperature of the object based on the type information of the object and the current temperature information of the object, as described in operation S310.

[0114] The processor 150 may identify whether the current temperature of the object is higher than, lower than, or equal to the optimal temperature of the object based on the type information of the object and the current temperature information of the object.

[0115] In operation S315 , the processor 150 may identify whether the current temperature of the object is higher than the optimal temperature of the object.

[0116] Based on the identification in operation S315 that the current temperature of the object is higher than the optimal temperature of the object, in operation S320, the processor 150 can identify the first time required for the temperature of the object located inside the refrigerator 100 to reach the optimal temperature based on the first set temperature information inside the refrigerator 100.

[0117] Figure 4 is a diagram illustrating a first time required for the temperature of an object stored in the refrigerator 100 to reach an optimal temperature when the current temperature of the object is the same as the temperature outside the refrigerator 100 according to one or more embodiments of the present disclosure.

[0118] refer to Figure 4 , the temperature outside the refrigerator 100 may be higher than the set temperature inside the refrigerator 100, and the optimal temperature of the object stored in the refrigerator 100 may be lower than the temperature outside the refrigerator 100 and higher than the set temperature of the refrigerator 100, but is not limited thereto.

[0119] Assuming a point in time when an object at room temperature outside the refrigerator begins to be stored in the refrigerator 100 , the current temperature of the object may be the same as the temperature outside the refrigerator 100 .

[0120] Based on identifying that the current temperature of the object is higher than the optimal temperature of the object, the processor 150 can identify the first time required for the temperature of the object inside the refrigerator 100 to reach the optimal temperature based on type information of the object (e.g., the capacity of the object, the type of the object, etc.) and first set temperature information inside the refrigerator 100.

[0121] In addition, the processor 150 can identify the first time by using a second neural network model (e.g., a time calculation model). By inputting the type information of the object (e.g., the capacity of the object, the type of the object, etc.), the temperature outside the refrigerator 100, and the set temperature inside the refrigerator 100 into the second neural network model, the processor 150 can obtain a vector value corresponding to the time required for the current temperature of the object to reach the optimal temperature as output data. The processor 150 can train the second neural network model based on the input data and the output data.

[0122] In operation S325, based on recognizing that the first time has passed, the processor 150 can provide a notification to the user. Specifically, based on recognizing that the first time has passed, the processor 150 can control the speaker 180 to output a voice to notify the user that the object has reached the optimal temperature, or control the display 170 to display a GUI to notify that the object has reached the optimal temperature.

[0123] If it is identified in operation S315-No that the current temperature of the object is not higher than the optimal temperature of the object, the processor 150 may identify whether the current temperature of the object is lower than the optimal temperature of the object in operation S330.

[0124] In operation S330-Yes, when the processor 150 recognizes that the current temperature of the object is lower than the optimal temperature of the object, the processor 150 can provide information to the user indicating that the object needs to be removed from the refrigerator 100, and identify a second time required for the temperature of the object outside the refrigerator 100 to reach the optimal temperature based on the temperature information outside the refrigerator 100.

[0125] Figure 5 is a graph illustrating a second time required for the temperature of an object stored in the refrigerator 100 to reach an optimal temperature when the current temperature of the object is the same as the set temperature inside the refrigerator 100 according to one or more embodiments of the present disclosure.

[0126] refer to Figure 5 , assuming that the object has been stored in the refrigerator 100 for a sufficiently long time (a preset time or longer), the current temperature of the object may be the same as the first set temperature inside the refrigerator 100 .

[0127] If it is identified that the current temperature of the object is lower than the optimal temperature of the object, the processor 150 may identify a second time required for the temperature of the object outside the refrigerator 100 to reach the optimal temperature based on temperature information outside the refrigerator 100 .

[0128] In addition, the processor 150 may use the aforementioned second neural network model (eg, a time calculation model) to identify the second time.

[0129] Meanwhile, if it is recognized that the current temperature of the object is lower than the optimal temperature of the object, the processor 150 may provide the user with information to take the object out of the refrigerator 100. The processor 150 may control the speaker 180 to output a voice to take the object out of the refrigerator 100, or control the display 170 to display a GUI to take the object out of the refrigerator 100.

[0130] In operation S340, if it is recognized that the second time has passed, the processor 150 can provide a notification to the user. Specifically, based on the recognition that the second time has passed, the processor 150 can control the speaker 180 to output a voice notifying the user that the object has reached the optimal temperature, or can control the display 170 to display a GUI notifying that the object has reached the optimal temperature.

[0131] If it is identified in operation S330-No that the current temperature of the object is not lower than the optimal temperature of the object, the processor 150 may provide information to take out the object from the refrigerator 100 to the user in operation S345.

[0132] Figure 6 is a diagram illustrating an operation of providing information related to taking out an object from the refrigerator 100 to a user according to one or more embodiments of the present disclosure.

[0133] refer to Figure 6 , the processor 150 may control the speaker 180 to output a voice for taking out an object from the refrigerator 100 , or control the display 170 to display a GUI for taking out an object from the refrigerator 100 .

[0134] Combination Figures 7 to 18 It is described that the processor 150 controls the operation of the refrigerator 100 when a target time is set, the target time being the time required from the current time point to the time point when the user wants to taste food or drink.

[0135] Figure 7 is a diagram illustrating an operation of the refrigerator 100 when a user sets a target time and a current temperature of an object stored in the refrigerator 100 is the same as a temperature outside the refrigerator 100 according to one or more embodiments of the present disclosure.

[0136] refer to Figure 7 In operation S705, based on identifying that the current temperature of the object is higher than the optimal temperature, the processor 150 may identify a first time required for the temperature of the object located in the refrigerator 100 to reach the optimal temperature based on the first set temperature information in the refrigerator 100.

[0137] The processor 150 may receive an input for setting a target time, which is a time required from a current time point to a desired time point for tasting food or drink, through the user interface 110 , thereby identifying the target time set by the user in operation S710 .

[0138] In operation S715, the processor 150 may identify whether the first time exceeds the target time.

[0139] Based on the fact that the first time identified in operation S715-No does not exceed the target time, in operation S720, the processor 150 can identify a third time to store the object in the refrigerator 100 based on the first set temperature information inside the refrigerator 100 and the temperature information outside the refrigerator 100 and a fourth time required for the object to reach the optimal temperature after the third time has passed.

[0140] Figure 8 is a diagram illustrating an operation of the processor 150 identifying a third time and a fourth time when the first time does not exceed the target time according to one or more embodiments of the present disclosure.

[0141] refer to Figure 8 , the current temperature of the object may be the same as the temperature outside the refrigerator 100, and the optimal temperature of the object may be lower than the temperature outside the refrigerator 100 and higher than the set temperature inside the refrigerator 100, but is not limited thereto.

[0142] When the first time required for the temperature of the object to reach the optimal temperature does not exceed the target time, the temperature of the object can reach the optimal temperature before the target time passes. When the object is stored in the refrigerator 100 after the first time has passed, the temperature of the object reaches a temperature lower than the optimal temperature, and reaches a temperature lower than the optimal temperature when the target time has passed.

[0143] Accordingly, according to an embodiment, the processor 150 can identify a third time to store an object in the refrigerator 100 so that the object can be provided at an optimal temperature at a point in time when the target time has passed, and a fourth time required for the object located outside the refrigerator 100 to reach the optimal temperature after the third time has passed.

[0144] The processor 150 may use the second neural network model (eg, time calculation model) to identify the third time and the fourth time.

[0145] In operation S725, the processor 150 may provide the user with information to take out the object from the refrigerator 100 based on recognizing that the third time has passed, and may provide the user with a notification based on recognizing that the fourth time has passed.

[0146] If the first time exceeds the target time S715-YES, the processor 150 may identify a fifth time required for the temperature of the object located in the refrigerator 100 to reach the optimal temperature based on the second set temperature information in the refrigerator 100 in operation S730.

[0147] Fig. 9 is a diagram illustrating an operation of the processor 150 identifying a fifth time when the first time exceeds the target time according to one or more embodiments of the present disclosure.

[0148] refer to Fig. 9,When the first time exceeds the target time, the temperature of the object may not reach the optimal temperature if the target time passes.

[0149] According to an embodiment, the processor may identify a fifth time required for the temperature of the object located in the refrigerator 100 to reach the optimal temperature based on the second set temperature information lower than the first set temperature inside the refrigerator 100. Since the fifth time is a time identified based on the second set temperature lower than the first set temperature, the value of the fifth time is smaller than the first time, and the object located inside the refrigerator 100 can reach the optimal temperature within the target time.

[0150] The processor 150 may identify a second neural network model (eg, a time calculation model).

[0151] In operation S735, the processor 150 may identify whether the fifth time exceeds the target time.

[0152] If it is identified in operation S735-No that the fifth time does not exceed the target time, then in operation S740, the processor 150 can identify the sixth time to store the object in the refrigerator 100 and the seventh time required for the object to reach the optimal temperature after the sixth time has passed based on the second set temperature information in the refrigerator 100 and the temperature information outside the refrigerator 100.

[0153] Based on the identification in operation S735-No that the fifth time does not exceed the target time, the processor 150 can provide the user with information to change the storage location of the object to a storage location corresponding to the second set temperature, or provide the user with information to change the set temperature in the refrigerator 100 to the second set temperature.

[0154] Fig.10 is a diagram illustrating an operation of the processor 150 identifying a sixth time and a seventh time when a fifth time does not exceed a target time according to one or more embodiments of the present disclosure.

[0155] refer to Fig.10 , when the fifth time required for the temperature of the object to reach the optimal temperature does not exceed the target time, the temperature of the object can reach the optimal temperature before the target time passes. When the object is stored in the refrigerator 100 after the fifth time has passed, the temperature of the object reaches a temperature lower than the optimal temperature, and reaches a temperature lower than the optimal temperature when the target time has passed.

[0156] Accordingly, the processor 150 may identify a sixth time to store the object in the refrigerator 100 so that the object can be provided at an optimal temperature when the target time has passed, and a seventh time required for the object to reach the optimal temperature after the sixth time has passed.

[0157] The processor 150 may use the second neural network model (eg, a time calculation model) to identify the sixth time and the seventh time.

[0158] In operation S745, the processor 150 may control the speaker 180 or the display 170 to provide the user with information to remove the object from the refrigerator 100 based on recognizing that the sixth time has passed, and provide the user with a notification based on recognizing that the seventh time has passed.

[0159] If it is identified in operation S735-YES that the fifth time exceeds the target time, in operation S750, the processor 150 may control the speaker 180 or the display 170 to provide the user with information indicating that the optimal temperature cannot be reached within the target time.

[0160] Fig.11 is a diagram illustrating an operation of the processor 150 identifying a fifth time exceeding the target time when the first time exceeds the target time according to one or more embodiments of the present disclosure.

[0161] refer to Fig.11 , even if the object is stored in the refrigerator 100 at the second set temperature, the optimal temperature may not be reached within the target time. The processor 150 may provide the user with information indicating that the optimal temperature cannot be reached within the target time.

[0162] Fig.12 is a diagram illustrating an operation of providing a user with information indicating that the refrigerator 100 cannot reach an optimal temperature within a target time according to one or more embodiments of the present disclosure.

[0163] refer to Fig.12 , the processor 150 may control the speaker 180 to output a voice indicating that the optimal temperature cannot be reached within the target time, or control the display 170 to display a GUI 1210 indicating that the optimal temperature cannot be reached within the target time.

[0164] Reference Figures 13 to 15 The operation of the processor 150 is described in detail when the fifth time required for the temperature of the object located in the refrigerator 100 to reach the optimal temperature does not exceed the target time based on the second set temperature information lower than the first set temperature inside the refrigerator 100.

[0165] Fig.13 It is shown that based on the fifth time not exceeding the target time, the refrigerator 100 can provide the user with information to change the storage location of the object to a storage location corresponding to the second set temperature.

[0166] refer to Fig.13, based on the fifth time not exceeding the target time in operation S1305-No, in operation S1310, the processor 150 can identify the sixth time to store the object in the refrigerator 100 based on the second set temperature information inside the refrigerator 100 and the temperature information outside the refrigerator 100, and the seventh time required for the object outside the refrigerator 100 to reach the optimal temperature after the sixth time has passed.

[0167] In operation S1315, the processor 150 may control the speaker 180 or the display 170 to provide the user with information that the storage location of the object is changed to a storage location corresponding to the second set temperature.

[0168] Fig.14 is a diagram illustrating storage locations inside the refrigerator 100 according to one or more embodiments of the present disclosure.

[0169] refer to Fig.14 , the refrigerator 100 may include at least one storage space (or storage location) (1410, 1420, 1430). The processor 150 may assign a different set temperature to each storage location. The processor 150 may control the cooling unit 130 based on the temperature information set for each storage location.

[0170] For example, the temperature corresponding to the first storage position 1410 may be a first set temperature, and the temperature corresponding to the second storage position 1420 may be a second set temperature lower than the first set temperature.

[0171] Accordingly, the processor 150 may provide information to the user to change the storage location of the object to a storage location corresponding to the second set temperature. When the user changes the storage location of the object to a second storage location corresponding to the second set temperature, the object may reach the optimal temperature within the target time.

[0172] In operation S1320, the processor 150 may provide the user with information to take the object out of the refrigerator 100 based on recognizing that the sixth time has passed, and may provide the user with a notification based on recognizing that the seventh time has passed.

[0173] Based on the fifth time exceeding the target time in operation S1305-Yes, in operation S1325, the processor 150 may provide the user with information that the optimal temperature cannot be reached within the target time.

[0174] Fig.15 is a diagram illustrating an operation of providing information instructing the refrigerator 100 to change the set temperature inside the refrigerator 100 to a second set temperature to a user when a fifth time does not exceed a target time according to one or more embodiments of the present disclosure.

[0175] refer to Fig.15 , based on the fifth time not exceeding the target time in operation S1505-No, in operation S1510, the processor 150 can identify a sixth time to store the object in the refrigerator 100 based on the second set temperature information inside the refrigerator 100 and the temperature information outside the refrigerator 100, and a seventh time required for the object outside the refrigerator 100 to reach the optimal temperature after the sixth time has passed.

[0176] In operation S1515, the processor 150 may control the speaker 180 or the display 170 to provide information to the user to change the set temperature in the refrigerator 100 to the second set temperature.

[0177] When the set temperature inside the refrigerator 100 is changed to a second set temperature lower than the first set temperature, the object can reach the optimal temperature within the target time.

[0178] In operation S1520, the processor 150 may provide information to the user to take the object out of the refrigerator 100 based on recognizing that the sixth time has passed, and may provide a notification to the user based on recognizing that the seventh time has passed.

[0179] Based on the fifth time exceeding the target time in operation S1505-Yes, in operation S1525, the processor 150 may provide the user with information that the optimal temperature cannot be reached within the target time.

[0180] The target time is set, that is, the time from the current time point to the time point when the user wants to taste the object, and when the object is stored in the refrigerator 100 for a predetermined time or longer and the current temperature of the object is recognized to be lower than the optimal temperature, the object is stored in the refrigerator 100 for a predetermined time or longer. Figures 16 to 18 The control operation of the processor 150 on the refrigerator 100 is described.

[0181] Fig.16 is a diagram illustrating an operation of the refrigerator 100 when a user sets a target time and a current temperature of an object stored in the refrigerator 100 is the same as a set temperature inside the refrigerator 100 according to one or more embodiments of the present disclosure.

[0182] refer to Fig.16 In operation S1605, based on recognizing that the current temperature of the object is lower than the optimal temperature, the processor 150 may identify a second time required for the temperature of the object outside the refrigerator to reach the optimal temperature based on the temperature information outside the refrigerator. The current temperature of the object may be the same as the set temperature inside the refrigerator 100, but is not limited thereto.

[0183] In operation S1610, the processor 150 may identify a target time set by a user. In operation S1615, the processor 150 may identify whether the second time exceeds the target time.

[0184] Based on identifying that the second time does not exceed the target time in operation S1615-No, in operation S1620, the processor 150 may identify an eighth time corresponding to a difference between the target time and the second time.

[0185] Fig.17 is a diagram illustrating an operation of the processor 150 identifying an eighth time when the second time does not exceed the target time according to one or more embodiments of the present disclosure.

[0186] refer to Fig.17 , based on the identified second time not exceeding the target time, the processor 150 may identify an eighth time corresponding to the difference between the target time and the second time.

[0187] In operation S1625 , based on recognizing that the eighth time has passed, the processor 150 may control the display 170 or the speaker 180 to provide information on taking out the object from the refrigerator 100 to the user.

[0188] In operation S1630, the processor 150 may control the display 170 or the speaker 180 to provide a notification to the user based on recognizing that the target time has passed.

[0189] If it is identified in operation S1615-YES that the second time exceeds the target time, in operation S1635, the processor 150 may control the display 170 or the speaker 180 to provide the user with information that the object is taken out of the refrigerator 100 and information that the second time exceeds the target time.

[0190] Fig.18 is a diagram illustrating an operation of the refrigerator 100 when the second time exceeds the target time according to one or more embodiments of the present disclosure.

[0191] refer to Fig.18 When the time required to reach the optimal temperature is greater than the target time, even when the object is immediately taken out of the refrigerator 100, the processor 150 can control the display 170 or the speaker 180 to provide the user with information indicating that the object needs to be taken out of the refrigerator 100 and information indicating that the second time has exceeded the target time.

[0192] In operation S1640, based on recognizing that the second time has passed, the processor 150 may control the display 170 or the speaker 180 to provide a notification to the user.

[0193] Fig.19 is a diagram illustrating a method in which the refrigerator 100 according to one or more embodiments of the present disclosure performs operations according to the present disclosure by being communicatively connected with a server or a user terminal device.

[0194] refer to Fig.19 The processor 150 can communicate with the server 200 or the user terminal device 300 through the communication interface 160 to send or receive various information. The server 200 can be a cloud-type server and can establish a network with multiple home appliances by communicating with the multiple home appliances.

[0195] The processor 150 may be communicatively connected to the server 200 or the user terminal device 300 through the communication interface 160 to receive an input signal for providing a notification when the time required for the object to reach the optimal temperature has elapsed.

[0196] The processor 150 may be communicatively connected to the server 200 or the user terminal device 300 through the communication interface 160 to receive type information of the object (eg, type of the object, physical properties of the object, capacity of the object, optimal temperature of the object, etc.).

[0197] The processor 150 may be communicatively connected to the server 200 or the user terminal device 300 through the communication interface 160 and may receive input information about a target time from a current time point to a time point when the object reaches a temperature most suitable for tasting the object.

[0198] The processor 150 may be communicatively connected to the server 200 or the user terminal device 300 through the communication interface 160 to send information to remove an object from the refrigerator 100. The processor 150 may be communicatively connected to the server 200 or the user terminal device 300 through the communication interface 160 to send information to change the storage location of the object or to change the internal set temperature of the refrigerator 100 from the first set temperature to the second set temperature.

[0199] The processor 150 may be communicatively connected to the server 200 or the user terminal device 300 via the communication interface 160 to send a signal notifying that the time taken for the object to reach the optimal temperature has elapsed.

[0200] The processor 150 may be communicatively connected to the server 200 or the user terminal device 300 via the communication interface 160 to send a signal notifying that the object cannot reach the optimal temperature within the target time.

[0201] Fig. 20 is a block diagram illustrating a configuration of a refrigerator 100 according to one or more embodiments of the present disclosure.

[0202] refer to Fig. 20 , the refrigerator 100 includes reference Figure 2In addition to the user interface 110 , temperature sensor 120 , cooling unit 130 , memory 140 , and processor 150 described above, a communication interface 160 , a display 170 , and a speaker 180 may also be included.

[0203] The communication interface 160 may include a wireless communication interface, a wired communication interface, and / or an input interface. The wireless communication interface may communicate with various external devices by using wireless communication technology or mobile communication technology. Wireless communication technology may include, for example, Bluetooth, low-power Bluetooth, CAN communication, Wi-Fi, Wi-Fi direct, ultra-wideband (UWB), ZigBee, infrared data association (IrDA), or near field communication (NFC), and mobile communication technology may include 3GPP, Wi-Max, long-term evolution (LTE), 5G, etc.

[0204] The wireless communication interface may be implemented by using an antenna, a communication chip, and / or a substrate capable of transmitting electromagnetic waves to the outside or receiving electromagnetic waves transmitted from the outside.

[0205] The wired communication interface can communicate with various external devices based on a wired communication network. The wired communication network can be implemented using physical cables such as twisted pair cables, coaxial cables, optical fiber cables, or Ethernet cables.

[0206] According to one or more embodiments, any one of the wireless communication interface and the wired communication interface can be omitted. Accordingly, the refrigerator 100 can include only the wireless communication interface, or can include only the wired communication interface. In addition, the refrigerator 100 can include an integrated communication interface that supports both wireless connection through the wireless communication interface and wired connection through the wired communication interface.

[0207] The refrigerator 100 is not limited to the case where one communication interface is included to perform one communication connection, and may include a plurality of communication interfaces to perform various modes of communication connection.

[0208] The processor 150 may be communicatively connected to the server 200 or the user terminal device 300 through the communication interface 160 to receive an input signal for providing a notification when the time required for the object to reach the optimal temperature has elapsed.

[0209] The processor 150 may be communicatively connected to the server 200 or the user terminal device 300 through the communication interface 160 to receive type information of the object (eg, type of the object, physical properties of the object, capacity of the object, optimal temperature of the object, etc.).

[0210] The processor 150 may be communicatively connected to the server 200 or the user terminal device 300 through the communication interface 160 and may receive input information about a target time from a current time point to a time point when the object reaches a temperature most suitable for tasting the object.

[0211] The processor 150 may be communicatively connected to the server 200 or the user terminal device 300 through the communication interface 160 to send information for taking out an object from the refrigerator 100. The processor 150 may be communicatively connected to the server 200 or the user terminal device 300 through the communication interface 160 to send information for changing the storage location of the object, or send information for changing the internal set temperature of the refrigerator 100 from the first set temperature to the second set temperature.

[0212] The processor 150 may be communicatively connected to the server 200 or the user terminal device 300 via the communication interface 160 to send a signal notifying that the time taken for the object to reach the optimal temperature has elapsed.

[0213] The processor 150 is connected to the server 200 or the user terminal device 300 through the communication interface 160 to send a signal notifying that the object cannot reach the optimal temperature within the target time.

[0214] The display 170 may include various types of display panels, such as a liquid crystal display panel (LCD) panel, an organic light emitting diode (OLED) display panel, an active matrix organic light emitting diode (AM-OLED), a liquid crystal on silicon (LcoS), a quantum dot light emitting diode (QLED), a digital light processing (DLP), a plasma display panel (PDP) panel, an inorganic LED panel, and a micro LED panel, but is not limited thereto.

[0215] The display 170 may constitute a touch screen together with a touch panel, or may be made of a flexible panel.

[0216] The display 170 may have various shapes, such as a circular shape, an elliptical shape, and a polygonal shape, and may be located in one area of ​​the surface of the refrigerator 100. The surface of the refrigerator 100 may refer to an outer surface of the refrigerator 100, but is not limited thereto.

[0217] The processor 150 may control the display 170 to display a GUI on information about objects taken out of the refrigerator 100 .

[0218] The processor 150 may control the display 170 to transmit information for changing the storage location of the object or a GUI for displaying information related to changing the internal set temperature of the refrigerator 100 from the first set temperature to the second set temperature.

[0219] The processor 150 may control the display 170 to display a GUI indicating that a time taken for the object to reach the optimal temperature has elapsed.

[0220] The processor 150 may control the display 170 to display a GUI indicating that the object may not reach the optimal temperature within a target time.

[0221] The speaker 180 may include a tweeter for playing high-pitched vocal sounds; a mid-range speaker for playing medium-pitched vocal sounds; a woofer for playing low-pitched vocal sounds; a subwoofer for playing very low-pitched vocal sounds; a housing for controlling resonance; a crossover network for dividing the frequency of an electrical signal input to the speaker 180 into various frequency bands, etc.

[0222] The speaker 180 can output sound signals to the outside of the electronic device. The speaker 180 can output multimedia playback, recording playback, various notification sounds, voice messages, etc. The electronic device may include an audio output device such as the speaker 180, but may also include an output device such as an audio output terminal. Specifically, the speaker 180 can provide acquired information, information processed / generated based on the acquired information, response results or operation results for user voice, etc. in the form of voice.

[0223] The processor 150 may control the speaker 180 to output voice regarding information on taking out an object from the refrigerator 100 .

[0224] The processor 150 may control the speaker 180 to transmit information on changing the storage location of the object or output a voice related to information on changing the internal set temperature of the refrigerator 100 from the first set temperature to the second set temperature.

[0225] The processor 150 may control the speaker 180 to output a voice indicating that a time taken for the object to reach the optimal temperature has elapsed.

[0226] The processor 150 may control the speaker 180 to output a voice indicating that the object may not reach the optimal temperature within the target time.

[0227] The refrigerator 100 may further include a camera (not shown) and a microphone (not shown).

[0228] The camera may refer to a module capable of capturing still images and videos. According to one or more embodiments, the camera module may include one or more lenses, an image sensor, an image signal processor 150, or a flash.

[0229] The processor 150 may acquire an image of an object entering the refrigerator 100 through a camera. The processor 150 may acquire type information of the object based on the acquired image. The processor 150 may acquire type information of the object contained in the image by inputting the acquired image into a first neural network model (e.g., an image classification model).

[0230] A microphone may refer to a module for acquiring sound and converting the sound into an electrical signal, and may be a condenser microphone, a ribbon microphone, a dynamic microphone, a piezoelectric element microphone, a carbon microphone, a micro-electromechanical system (MEMS) microphone. In addition, it may be implemented in an omnidirectional, bidirectional, unidirectional, subcardioid, supercardioid, or hypercardioid manner.

[0231] The processor 150 may obtain the user's voice command information through the microphone. Specifically, the processor 150 may recognize the user's voice by using a speech-to-text (STT) module on the user's voice sensed by the microphone, and recognize the command and meaning contained in the user's voice. Based on the command and meaning contained in the recognized user's voice, the processor 150 may provide a notification when the time required for the temperature of the object to reach the optimal temperature has passed.

[0232] In addition, based on the user voice command information acquired through the microphone, the processor 150 may acquire type information of objects stored in the refrigerator 100 .

[0233] Fig.21 is a flowchart illustrating the operation of the refrigerator 100 according to one or more embodiments of the present disclosure.

[0234] In operation S2110 , the refrigerator 100 may acquire type information of an object and current temperature information of an object stored in the refrigerator 100 .

[0235] The object may be alcoholic beverages including wine, but is not limited thereto, and may include various foods, beverages, alcoholic beverages, ingredients, and the like.

[0236] Based on the temperature information outside the refrigerator 100 and the first set temperature information inside the refrigerator 100, the refrigerator 100 may acquire current temperature information of the object.

[0237] In operation S2120, based on the type information and the current temperature information, the refrigerator 100 may compare the current temperature of the object with the optimal temperature of the object. The optimal temperature of the object may mean a temperature that is most suitable for tasting the object.

[0238] In operation S2130 , based on recognizing that the current temperature of the object is higher than the optimal temperature, the refrigerator 100 may identify a first time required for the temperature of the object located inside the refrigerator 100 to reach the optimal temperature based on first set temperature information inside the refrigerator 100 .

[0239] In operation S2140, based on recognizing that the current temperature of the object is lower than the optimal temperature, the refrigerator 100 may identify a second time required for the temperature of the object outside the refrigerator 100 to reach the optimal temperature based on temperature information outside the refrigerator 100.

[0240] Based on the recognition that the current temperature of the object is lower than the optimal temperature, the refrigerator 100 may provide the user with information to take the object out of the refrigerator 100 .

[0241] In operation S2150, based on recognizing that the first time or the second time has passed, the refrigerator 100 may control the display 170 or the speaker 180 to provide a notification to the user.

[0242] Functions related to AI may be operated by the processor 150 and the memory 140 of the electronic device.

[0243] The processor 150 may be configured with one or more processors 150. The one or more processors 150 may include at least one of a central processing unit (CPU), a graphics processing unit (GPU), and a neural processing unit (NPU), but is not limited to the above processors 150.

[0244] The CPU is a general-purpose processor that can perform artificial intelligence operations as well as general operations, and can efficiently execute complex programs through a multi-layer cache structure. The advantage of the CPU lies in the serial processing method, which realizes the organic connection between the previous calculation result and the next calculation result through sequential calculation. In addition to the above-mentioned CPU, general-purpose processors are not limited to the above examples.

[0245] The GPU is a processor for mass calculations such as floating point operations for graphics processing, and through a large number of integrated cores, large-scale operations can be performed in parallel. Specifically, compared with the CPU, the GPU has advantages in parallel processing schemes such as convolution operations. In addition, the GPU can be used as a coprocessor to supplement the CPU function. The processor 150 for mass calculations is not limited to the above example except for the case where the above GPU is specified.

[0246] NPU is a dedicated processor that uses artificial neural networks for AI calculations, and can implement the various layers that make up the artificial neural network as hardware (such as silicon). Since NPU is specially designed according to the company's requirements, it has less freedom than CPU or GPU, but can efficiently process the AI ​​operations required by the company. As a processor dedicated to AI operations, NPU can be implemented in various forms, such as tensor processing unit (TPU), intelligent processing unit (IPU), and visual processing unit (VPU). Except for the case where the above-mentioned NPU is specified, the AI ​​processor is not limited to the above examples.

[0247] Likewise, one or more processors 150 may be implemented using a system on chip (SoC). In addition to including one or more processors 150 , the SoC may also include a network interface (eg, a bus) for data communication between the processor 150 and the memory 140 .

[0248] When a system on chip (SoC) included in an electronic device includes multiple processors 150, the electronic device can use some of the multiple processors 150 to perform operations related to artificial intelligence (e.g., operations related to learning or reasoning of an artificial intelligence model). For example, by using at least one of the GPU, NPU, VPU, TPU, and hardware accelerators dedicated to artificial intelligence operations such as convolution operations and matrix multiplication operations in the multiple processors 150, the electronic device can perform operations related to artificial intelligence. However, this is only an embodiment, and a general-purpose processor such as a CPU can be used to process operations related to artificial intelligence.

[0249] Likewise, the electronic device can perform operations related to artificial intelligence functions by using multiple cores (e.g., dual cores, quad cores, etc.) included in one processor 150. Specifically, by using multiple cores included in the processor 150, the electronic device can perform artificial intelligence operations in parallel, such as convolution operations and matrix multiplication operations.

[0250] The one or more processors 150 control the input data to be processed according to the predefined operating rules or artificial intelligence models stored in the memory 140. The predefined operating rules or artificial intelligence models are implemented by learning.

[0251] By applying the learning algorithm to multiple learning data, a predefined operating rule or AI model with desired characteristics can be formed. The learning can be performed in the device itself that performs AI according to one or more embodiments, and / or can be implemented by a separate server / system.

[0252] The AI ​​model may include multiple neural network layers. Each layer has multiple weight values, and the layer operation is performed by calculating the previous layer and at least one defined operation. Examples of neural networks include convolutional neural networks (CNNs), deep neural networks (DNNs), recurrent neural networks (RNNs), restricted Boltzmann machines (RBMs), deep belief networks (DBNs), bidirectional recurrent deep neural networks (BRDNNs), deep Q networks, and transformers, and are not limited thereto unless otherwise specified.

[0253] A learning algorithm is a method of training a predetermined target device (e.g., a robot) using multiple learning data to enable, allow, or control the target device to make a determination or prediction. Examples of learning algorithms include, but are not limited to, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, and unless otherwise specified, the learning algorithm in the present disclosure is not limited thereto.

[0254] Furthermore, according to one or more embodiments, a method according to one or more embodiments including a computer program product may be provided. The computer program product may be exchanged between a seller and a buyer as a commodity. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., a compact disk read-only memory (CD-ROM)), or distributed online through an application store (e.g., PLAYSTORE™). In the case of online distribution, at least a portion of the computer program product (e.g., a downloadable application) may be at least temporarily stored in a storage medium such as a memory of a manufacturer's server, an application store's server, or a relay server, or may be temporarily generated.

[0255] Although embodiments of the present disclosure have been shown and described, the present disclosure is not limited to the specific embodiments described above, and it is apparent that various modifications may be made by one of ordinary skill in the art without departing from the spirit of the present disclosure as claimed in the appended claims.

Claims

1. A refrigerator, comprising: user interface; a temperature sensor configured to sense a temperature outside the refrigerator; a cooler configured to adjust the temperature inside the refrigerator; a memory configured to store at least one instruction; as well as One or more processors configured to execute the at least one instruction to: Acquire type information of objects in the refrigerator and current temperature information of the objects; comparing the current temperature of the object with a first temperature of the object based on the type information and the current temperature information; Based on recognizing that the current temperature of the object is higher than the first temperature, identifying a first time when the temperature of the object inside the refrigerator reaches the first temperature based on a first set temperature inside the refrigerator; Based on recognizing that the current temperature of the object is lower than the first temperature, identifying a second time at which the temperature of the object reaches the first temperature after the object is taken out of the refrigerator based on external temperature information of the refrigerator; as well as Based on identifying that at least one of the first time or the second time has passed, a notification is provided.

2. The refrigerator according to claim 1, wherein: The one or more processors are further configured to execute the at least one instruction to: Based on recognizing that the current temperature of the object is lower than the first temperature, a notification is provided to remove the object from the refrigerator.

3. The refrigerator according to claim 1, wherein: The one or more processors are also configured to execute the at least one instruction to: obtain the current temperature information of the object based on information related to at least one of the temperature outside the refrigerator or the first set temperature inside the refrigerator.

4. The refrigerator according to claim 1, wherein: The one or more processors are further configured to execute the at least one instruction to: identifying a target time set via the user interface; identifying a third time for storing the object in the refrigerator based on the first set temperature inside the refrigerator and the external temperature information of the refrigerator based on the identified first time not exceeding the target time, and identifying a fourth time for the object to reach the first temperature after the third time has passed; and outputting a notification to remove the object from the refrigerator based on recognizing that the third time has passed; as well as Based on recognizing that the fourth time has passed, providing a notification that the fourth time has passed.

5. The refrigerator according to claim 1, wherein: The one or more processors are further configured to execute the at least one instruction to: identifying a target time set using the user interface, identifying a fifth time at which the object inside the refrigerator reaches the first temperature based on a second set temperature inside the refrigerator based on the identified first time exceeding the target time, and identifying, based on the fifth time not exceeding the target time, a sixth time for storing the object in the refrigerator based on the second set temperature inside the refrigerator and the external temperature information of the refrigerator, and a seventh time required for the object outside the refrigerator to reach the first temperature after the sixth time has passed, providing a notification to remove the object from the refrigerator based on recognizing that the sixth time has passed, and Based on recognizing that the seventh time has passed, a notification is provided that the seventh time has passed.

6. The refrigerator according to claim 5, wherein: The one or more processors are further configured to execute the at least one instruction to: provide a notification that the first temperature cannot be reached within the target time based on the fifth time exceeding the target time.

7. The refrigerator according to claim 5, wherein: The one or more processors are further configured to execute the at least one instruction to provide a notification of changing the storage location of the object to a storage location corresponding to the second set temperature based on the fifth time not exceeding the target time.

8. The refrigerator according to claim 5, wherein: The one or more processors are further configured to execute the at least one instruction to: provide a notification to change the set temperature inside the refrigerator to the second set temperature based on the fifth time not exceeding the target time.

9. The refrigerator according to claim 1, wherein: The one or more processors are further configured to execute the at least one instruction to: identifying a target time set using the user interface, identifying, based on the identified second time not exceeding the target time, an eighth time corresponding to a difference between the target time and the second time, providing a notification to remove the object from the refrigerator based on recognizing that the eighth time has passed, and Based on identifying that the target time has passed, a notification is provided that the target time has passed.

10. The refrigerator according to claim 1, wherein: The one or more processors are further configured to execute the at least one instruction to: identifying a target time set using the user interface, providing a notification of taking out the object from the refrigerator and information that the second time exceeds the target time based on the identification that the second time exceeds the target time, and Based on identifying that the second time has passed, providing a notification that the second time has passed.

11. The refrigerator according to claim 1, wherein: The one or more processors are further configured to execute the at least one instruction to provide a notification to remove the object from the refrigerator based on identifying that the current temperature of the object is the same as the first temperature.

12. The refrigerator according to claim 1, wherein: The first temperature of the object is higher than the first set temperature inside the refrigerator and lower than a temperature outside the refrigerator.

13. A method for controlling a refrigerator, the method comprising: Acquire type information of objects in the refrigerator and current temperature information of the objects; comparing the current temperature of the object with a first temperature of the object based on the type information and the current temperature information; Based on recognizing that the current temperature of the object is higher than the first temperature, identifying a first time when the temperature of the object inside the refrigerator reaches the first temperature based on a first set temperature inside the refrigerator; Based on recognizing that the current temperature of the object is lower than the first temperature, identifying a second time at which the temperature of the object reaches the first temperature after the object is taken out of the refrigerator based on external temperature information of the refrigerator; as well as Based on identifying that at least one of the first time or the second time has passed, a notification is provided.

14. The method according to claim 13, wherein: Identifying the second time includes providing a notification to remove the object from the refrigerator based on identifying that the current temperature of the object is lower than the first temperature.

15. The method according to claim 13, wherein: Acquiring the current temperature information of the object includes acquiring the current temperature information of the object based on information related to at least one of a temperature outside the refrigerator or the first set temperature inside the refrigerator.

Images