Method for determining and notifying of cooking state, and apparatus therefor

Abstract

This method for providing a notification according to a cooking state determined while performing cooking control may comprise: a first step of acquiring the current cooking state by filtering a preset number of most recently acquired pieces of image data acquired periodically; a second step of determining a change in the cooking state on the basis of the current cooking state and a reference cooking state; a third step of determining the progress of the cooking state on the basis of the reference cooking state and an average cooking state of a queue in which the current cooking state is stored, when it is determined that the cooking state has changed; and a fourth step of providing a cooking state notification according to the average cooking state being a cooking state that has progressed more than the reference cooking state.

Description

Method for judging and notifying the cooking status and device therefor

[0001] The present invention relates to a method and device for determining and notifying the cooking status. More specifically, the present invention relates to a method and device for accurately determining the progress or change in the cooking status and detecting missed cooking status to provide notification.

[0002] An oven is a home appliance that heats and cooks food by placing it in a cooking chamber formed within a cavity. To heat the food, the oven includes at least one heating source. Depending on the heating method, heating sources can be categorized into high-frequency heating sources, radiant heating sources, and convection heating sources. The operation of the heating source is controlled according to the type of food being cooked and, in essence, the cooking method. Recently released ovens offer multiple cooking methods, increasing accessibility even for those unfamiliar with oven operation.

[0003] Recent ovens are increasingly incorporating smart features. Smart ovens connect to smartphones or tablets via Wi-Fi and Bluetooth, allowing remote control. Furthermore, smart ovens can download recipes and monitor the cooking process through dedicated apps. Furthermore, smart ovens integrate with voice assistants, allowing you to control the oven with voice commands.

[0004] In addition, attempts are being made to provide more diverse services using images acquired using image sensors, such as cameras that capture the cooking area inside an oven, to provide user convenience.

[0005] The present invention proposes a method for judging and notifying the cooking status and a device therefor.

[0006] In addition, the present invention proposes a method and a device for accurately determining changes or progress in the cooking state and detecting a missing cooking state.

[0007] In addition, the present invention proposes a method and a device therefor for adjusting the cycle of image data acquisition for cooking control or cooking state judgment when a detected cooking state is missing.

[0008] The problems to be solved by the present invention are not limited to the problems to be solved above, and other problems not mentioned can be clearly understood by a person having ordinary skill in the technical field to which the present invention belongs from the description below.

[0009] A method for providing a notification according to a cooking state determined while performing cooking control, the method may include a first step of filtering a preset number of the latest acquired image data periodically acquired to acquire a current cooking state; a second step of determining a change in the cooking state based on the current cooking state and a reference cooking state; a third step of determining the progress of the cooking state based on an average cooking state of a queue in which the current cooking state is stored and the reference cooking state when it is determined that the cooking state has changed; and a fourth step of providing a cooking state notification when the average cooking state is a cooking state that has progressed further than the reference cooking state.

[0010] A cooking appliance control device configured to provide a notification according to a cooking state determined while performing cooking control is proposed, the device including a processor and a user interface, wherein the processor: filters a preset number of the latest acquired image data acquired periodically to obtain a current cooking state, determines a change in the cooking state based on the current cooking state and a reference cooking state, and determines the progress of the cooking state based on an average cooking state of a queue in which the current cooking state is stored and the reference cooking state when the cooking state is determined to have changed, and provides a cooking state notification when the average cooking state is a cooking state that is more advanced than the reference cooking state.

[0011] The above problem solving methods are only some of the embodiments of the present invention, and various embodiments reflecting the technical features of the present invention can be derived and understood by a person having ordinary knowledge in the relevant technical field based on the detailed description of the present invention described below.

[0012] The present invention has the following technical effects.

[0013] The present invention can determine the cooking status and provide notification about the determined cooking status.

[0014] In addition, the present invention can accurately determine the progress or change in the cooking state and detect a missed cooking state.

[0015] In addition, the present invention can prevent the cooking state from being missed by controlling the cycle of image data acquisition for cooking control or cooking state judgment when the cooking state is missed.

[0016] The effects according to the present invention are not limited to the effects mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art to which the present invention pertains from the detailed description of the invention below.

[0017] The accompanying drawings, which are included as part of the detailed description to aid in understanding the present invention, provide embodiments of the present invention and, together with the detailed description, explain the technical idea of ​​the present invention.

[0018] Figure 1 is a perspective view of a cooking appliance according to the present invention.

[0019] Figure 2 illustrates a procedure for providing a cooking notification according to the present invention.

[0020] Figure 3 shows examples of multiple cooking states.

[0021] Figure 4 illustrates a procedure for obtaining a cooking state according to the present invention.

[0022] Figure 5 illustrates a procedure for determining a change in cooking status according to the present invention.

[0023] Figure 6 illustrates a procedure for progressing changes in cooking status according to the present invention.

[0024] Figure 7 illustrates a procedure for controlling the image data acquisition cycle or cooking temperature according to the present invention.

[0025] Figure 8 illustrates a flowchart of automatic cooking control and provision of cooking status notification according to the present invention.

[0026] Figure 9 illustrates a block diagram of a cooking appliance control device according to the present invention.

[0027] Hereinafter, embodiments disclosed in this specification will be described in detail with reference to the attached drawings. Regardless of the drawing numbers, identical or similar components will be given the same reference numbers and redundant descriptions thereof will be omitted. The suffixes "module" and "part" used for components in the following description are assigned or used interchangeably only for the convenience of writing the specification, and do not in themselves have distinct meanings or roles. In addition, when describing the embodiments disclosed in this specification, if it is determined that a specific description of a related known technology may obscure the gist of the embodiments disclosed in this specification, a detailed description thereof will be omitted. In addition, the attached drawings are only intended to facilitate easy understanding of the embodiments disclosed in this specification, and the technical ideas disclosed in this specification are not limited by the attached drawings, and should be understood to include all modifications, equivalents, and substitutes included in the spirit and technical scope of the present invention.

[0028] Terms that include ordinal numbers, such as first, second, etc., may be used to describe various components, but the components are not limited by these terms. These terms are used solely to distinguish one component from another.

[0029] When a component is referred to as being "connected" or "connected" to another component, it should be understood that it may be directly connected or connected to that other component, but that there may be other components intervening. Conversely, when a component is referred to as being "directly connected" or "connected" to another component, it should be understood that there are no other components intervening.

[0030] Singular expressions include plural expressions unless the context clearly indicates otherwise.

[0031] In this application, terms such as “include” or “have” are intended to specify the presence of a feature, number, step, operation, component, part or combination thereof described in the specification, but should be understood not to exclude in advance the possibility of the presence or addition of one or more other features, numbers, steps, operations, components, parts or combinations thereof.

[0032]

[0033] Figure 1 is a perspective view of a cooking appliance according to the present invention.

[0034] The case (10) is provided in a shape having an internal space and is open at the front. For example, the case (10) may be formed in a predetermined box shape.

[0035] A cooking chamber (11) in which food is cooked is formed inside the case (10). A grill (not shown) for placing food on the inside of the cooking chamber (11) is provided.

[0036] A plurality of heating sources (or heaters) are installed inside the case (10) and outside the cooking chamber (11) to provide heat for cooking food.

[0037] An input unit (12) and a display unit (13) are provided on the outside of the case (10). The input unit (12) may be formed as a dial-type button so that the user can select various operation modes, set temperatures, and operation times. Here, the set temperature is the temperature input by the user for cooking food.

[0038] The display unit (13) displays certain information so that the user can determine the status of the cooking appliance (1).

[0039] The door (20) is installed on the open front of the case (10) and is arranged to open and close the cooking chamber (11). That is, the cooking chamber (11) can be opened and closed by the door (20). For convenience of explanation, the installation structure and locking device of the door (20) are omitted and illustrated.

[0040] The door (20) is installed on the front of the case (10) so as to be rotatable forward. In addition, the door (20) may be provided with a handle (21) that a user can grasp and rotate.

[0041] Meanwhile, although not shown, a temperature sensor (not shown) may be additionally installed inside the cooking chamber (11). The temperature sensor measures the internal temperature of the cooking chamber (11), i.e., the temperature inside the oven. The measured temperature inside the oven is transmitted to the control unit, which will be described later. For example, the temperature sensor may be a thermostat.

[0042] Additionally, an image sensor (17), such as a camera, for capturing images by photographing the inside of the cooking room (11) may be installed inside the cooking room.

[0043]

[0044] Figure 2 illustrates a procedure for providing a cooking notification according to the present invention.

[0045] The provision of cooking notifications illustrated in FIG. 2 may be performed by a cooking appliance (1) or a control device (100, see FIG. 9) of the cooking appliance, or by a processor of the cooking appliance (1) or a control device (100) of the cooking appliance. Hereinafter, it will be described as being performed by a processor.

[0046] The cooking appliance (1) according to the present invention may include a combination oven that combines a conventional microwave oven function and an oven function, but the present invention is not limited thereto.

[0047] The procedure for providing cooking notifications according to FIG. 2 can be performed while automatic cooking control is in progress. While this specification does not explicitly address the functions or operations of automatic cooking control, it is important to note that automatic cooking control is essentially performed. This automatic cooking control allows for changes in cooking status, progress, and provision of cooking notifications.

[0048] The processor can obtain the cooking status based on image data of an object brought into the cooking room (11) (S10). Here, the object may include a plate or bowl, or ingredients placed on a plate or bowl.

[0049] To obtain the cooking status (or information thereon), the processor can periodically obtain image data of an object placed in the cooking chamber (11). The cycle for obtaining the image data can be preset and can also be changed according to the settings. The processor can obtain a preset number of the latest image data. For example, if it is set to obtain one image frame per cycle, the processor can perform a procedure for obtaining the cooking status when n image frames are obtained. The processor can filter the preset number of image data to obtain the current cooking status.

[0050] Meanwhile, a turntable for placing an object is provided inside the cooking chamber (11), and image data of the object can be acquired as the object rotates on the turntable. This enables acquisition of image data for the object from various angles, thereby enabling acquisition of more accurate image data for the object.

[0051] Then, the processor can determine changes in the cooking status (S20). Changes in the cooking status can be determined by comparing the cooking status acquired at or before S10 with the reference cooking status. The reference cooking status is information updated based on previously acquired cooking statuses. As described below, if it is determined that the cooking status has progressed, the reference cooking status is updated with the average (value) of the cooking statuses stored in the queue.

[0052] The processor may determine that a change in the cooking state has occurred if the cooking state acquired from a preset number of the latest image data is the same as the reference cooking state or has progressed beyond the reference cooking state. Alternatively, the processor may determine that a change in the cooking state has occurred if the cooking state acquired from a preset number of the latest image data has not deteriorated beyond the reference cooking state.

[0053] In this specification, the progress of the cooking state means, in terms of the cooking state or the cooking state value described with reference to FIG. 3, that the cooking state acquired from the latest image data (i.e., the current cooking state) is subsequent to the reference cooking state (i.e., the past cooking state) in terms of the cooking procedure. For example, in FIG. 3, T3 can be expressed as a cooking state that is more advanced than T2. ​​Correspondingly, when the cooking state is quantified, if a larger cooking state value indicates a more subsequent cooking state in terms of the cooking procedure, a cooking state with a larger cooking state value can be expressed as a more advanced cooking state than a cooking state with a smaller cooking state value.

[0054] Meanwhile, if it is determined that no change in the cooking state has occurred, the procedure can return to S10.

[0055] The processor can determine the progress of the cooking state (S30).

[0056] While changes in the cooking state represent the maintenance or progression of the instantaneous cooking state, the progression of the cooking state is based on the cumulative changes in the cooking state. To this end, the average of the cooking states (values) stored in a queue of preset sizes is compared to the reference cooking state.

[0057] Meanwhile, if it is determined that no progress has been made in the cooking state, the procedure can return to S10.

[0058] The processor can provide a cooking status notification (S40). If it determines that the cooking status has progressed, the processor can provide a cooking status notification. That is, if a certain level of change in the cooking status is detected based on image data periodically acquired over time, the processor can provide a cooking status notification.

[0059] Changes in the cooking state can be detected or judged based on color information detected from the acquired image data.

[0060] Meanwhile, in addition to color changes, changes in volume and shape can be used to determine the cooking status.

[0061] The cooking state can be expressed as a numerical value as described later, but the present invention is not limited thereto.

[0062] Additionally, the present invention can be performed until a set cooking state, i.e., a target cooking state, is reached, and cooking state notifications can be sequentially provided until the target cooking state is reached. When the target cooking state is reached, a cooking state notification is provided, and an audible or visual notification, such as a guidance sound or message, can be provided to indicate that automatic cooking control is complete or that cooking is complete.

[0063]

[0064] Figure 3 shows examples of multiple cooking states.

[0065] Figure 3 illustrates examples of cooking states for bakery products such as bread. While Figure 3 illustrates a total of eight cooking states, the present invention is not limited thereto. More or fewer cooking states may be utilized. Furthermore, neither the number of cooking states nor the specific cooking states (e.g., browning levels 1, 2, 3, etc.) limit the present invention.

[0066] Additionally, although not shown, the cooking device (1) or the user interface of the cooking device (1) may display a plurality of cooking states that can be set by the user and may receive an input for selecting one of the plurality of cooking states. That is, through the user's selection of the cooking state, a cooking state for automatic cooking control (i.e., a target cooking state) may be set.

[0067] Additionally, the cooking state can be quantified as a cooking state value. The eight cooking states illustrated in Fig. 3 can be set to have respective cooking state values ​​as follows.

[0068] Cooking Status Cooking Status ValueT11.0T22.0T33.0T44.0T55.0T66.0T77.0T88.0

[0069] Accordingly, the cooking state according to the present invention can be set to have one of a plurality of state values ​​having a certain interval. In addition, a cooking state notification is provided for each of the plurality of state values, and can be provided sequentially according to the sequential increase (or decrease) of the state values. For example, a cooking state notification can be provided whenever the cooking state is determined to be T1, T2, …, T8 (or the cooking state values ​​are 1.0, 2.0, …, 8.0).

[0070] As an example, assume that the cooking state for any one of T3, T4, and T5 can be set by the user.

[0071] As another example, settings can be performed not only for cooking conditions but also for preset recipes. Alternatively, preset cooking conditions can be set for each preset recipe.

[0072] A preset recipe is a preset cooking method or cooking control method provided by a cooking device (1), which provides cooking for multiple dishes. Each preset recipe may be composed of a combination of set (heating) temperatures and times. Additionally, a preset recipe may include a combination of water injection and water injection times.

[0073]

[0074] Figure 4 illustrates a procedure for obtaining a cooking state according to the present invention.

[0075] The acquisition of the cooking state illustrated in FIG. 4 may be performed by the cooking appliance (1) or the control device (100, see FIG. 9) of the cooking appliance, or by the processor of the cooking appliance (1) or the control device (100) of the cooking appliance. Hereinafter, it will be described as being performed by the processor.

[0076] The cooking appliance (1) according to the present invention may include a combination oven that combines a conventional microwave oven function and an oven function, but the present invention is not limited thereto.

[0077] The procedure for acquiring the cooking status according to Fig. 4 can be performed while automatic cooking control is being performed. That is, although this specification does not explicitly mention the functions or operations of automatic cooking control, it is noted that automatic cooking control is essentially performed. Acquiring the cooking status is accomplished according to this automatic cooking control.

[0078] The processor can set the acquisition cycle of image data (S11).

[0079] The processor can acquire image data according to a set cycle (S12).

[0080] The processor can determine whether a preset number of the latest image data has been acquired (S13). The acquisition of image data (S12) can be repeated until a preset number of the latest image data has been acquired.

[0081] Acquisition of the cooking state may be based on a preset number of recent image data. For example, image frames may be acquired every 10 seconds, and cooking states (x1, x2, …, xn) may be acquired from each of the n image frames thus acquired. This specification does not describe a method for acquiring cooking states or cooking state values ​​from image data.

[0082] Thereafter, the processor can perform filtering on the acquired image data (S14). The processor can perform filtering on the cooking states acquired from each image frame to obtain a single valid cooking state (y). A denoise filter can be used for filtering. The denoise filter will be briefly described below.

[0083] The input of the denoise filter is the cooked state (value) of the n image data mentioned above, as follows.

[0084]

[0085] After passing through the denoise filter, one valid cooking state is obtained.

[0086] The denoise filter can be either a mean filter, a median filter, or a weight filter.

[0087]

[0088] Figure 5 illustrates a procedure for determining a change in cooking status according to the present invention.

[0089] The acquisition of the cooking state illustrated in FIG. 5 may be performed by the cooking appliance (1) or the control device (100, see FIG. 9) of the cooking appliance, or by the processor of the cooking appliance (1) or the control device (100) of the cooking appliance. Hereinafter, it will be described as being performed by the processor.

[0090] The cooking appliance (1) according to the present invention may include a combination oven that combines a conventional microwave oven function and an oven function, but the present invention is not limited thereto.

[0091] The procedure for determining changes in cooking status according to Fig. 5 can be performed while automatic cooking control is being performed. That is, while this specification does not explicitly mention the functions or operations of automatic cooking control, it is noted that automatic cooking control is essentially performed. Determination of changes in cooking status is performed according to this automatic cooking control.

[0092] The cooking state change judgment in Fig. 5 is performed when the cooking state is acquired from the acquired image data.

[0093] The processor can determine whether the cooking state obtained from the acquired image data has changed compared to the previous state (S21). A reference cooking state can be used to determine the change in the cooking state. If it is determined that the cooking state obtained from the acquired image data has not changed compared to the reference cooking state, the processor can return to step S12 of FIG. 4 to acquire the image data. Thereafter, the processor can filter a preset number of the latest image data again to obtain a valid cooking state (value).

[0094] Regarding the criteria for determining a change in cooking status, if the acquired cooking status is the same as or more advanced than the reference cooking status, the cooking status can be determined to have changed. However, this criterion may vary depending on the embodiment. For example, the cooking status can be determined to have changed only if the cooking status acquired from image data is more advanced than the reference cooking status.

[0095] If it is determined that the acquired cooking state has changed compared to the reference cooking state, the processor may add or store the acquired cooking state information in the queue (S22). The queue may be set to have a preset size.

[0096] Until the queue is full, the processor repeats acquisition of image data (S12 to S14 of FIG. 4, etc.) and can determine whether the cooking state has changed from the acquired image data (S21).

[0097] When the queue becomes full, the cooking state change procedure can be terminated.

[0098]

[0099] Figure 6 illustrates a procedure for judging the progress of cooking status according to the present invention.

[0100] The determination of the progress of the cooking state change illustrated in FIG. 6 may be performed by the cooking appliance (1) or the control device (100, see FIG. 9) of the cooking appliance, or by the processor of the cooking appliance (1) or the control device (100) of the cooking appliance. Hereinafter, it will be described as being performed by the processor.

[0101] The cooking appliance (1) according to the present invention may include a combination oven that combines a conventional microwave oven function and an oven function, but the present invention is not limited thereto.

[0102] The procedure for judging the cooking status according to Fig. 6 can be performed while automatic cooking control is being performed. That is, while this specification does not explicitly mention the functions or operations of automatic cooking control, it is noted that automatic cooking control is essentially performed. Judging the cooking status is performed according to this automatic cooking control.

[0103] The cooking status progress judgment of Fig. 6 is performed when a change in the cooking status is detected from the acquired image data and the change in the cooking status is acquired to a certain extent (i.e., until the queue is filled with cooking status (values) according to the change in the cooking status).

[0104] The processor can determine whether the cooking state has progressed (S31). The progress of the cooking state can be determined by comparing the average of the cooking states stored in the queue with the reference cooking state. If the average of the cooking states stored in the queue is a cooking state that has progressed by a preset degree compared to the reference cooking state, the cooking state can be determined to have progressed.

[0105] For example, referring to Table 1, if the standard cooking state is T7, the cooking state value is 7.0, and the preset degree for the progress of the cooking state is 1.0 as the state and 1.0 as the cooking state value, then if the average of the cooking states stored in the queue is 8.0 or higher, it can be determined that the cooking state has progressed.

[0106] If it is determined that the cooking state has not progressed, the processor may repeat the process of repeatedly acquiring image data (S12 to S14 of FIG. 4, etc.), determining whether the cooking state has changed from the acquired image data (S21 of FIG. 5), and storing the cooking state in the queue accordingly.

[0107] When the cooking state is determined to have progressed, the processor can update the reference cooking state to an average of the cooking states stored in the queue.

[0108] On the other hand, if it is determined that the average of the cooking states stored in the queue has progressed beyond a preset range compared to the reference cooking state, more than one cooking state notification may need to be provided, i.e., there may be cases where cooking state notifications are missed before the final cooking state notification.

[0109] For example, referring to Table 1, consider a case where the reference cooking state is T5, the cooking state value is 5.0, and the preset range, which is the reference for the progress of the cooking state, is assumed to be state 1.0 and cooking state value 1.0. Since cooking state notifications should be provided for each state (i.e., state values ​​1.0, 2.0, …, 8.0), if the average of the cooking states stored in the queue is 7.0, cooking state notifications corresponding to cooking states 5.0 and 7.0 should be provided. Therefore, in addition to the cooking state notification corresponding to the average of the cooking states stored in the queue (i.e., corresponding to the cooking state value 7.0), cooking state notifications corresponding to cooking states between the reference cooking state and the average cooking state (i.e., corresponding to the cooking state value 6.0) should be provided.

[0110] Accordingly, the processor can determine whether there is a missing cooking state or a cooking state notification (S32). That is, the processor can determine whether the average of the cooking states stored in the queue is an advanced cooking state that exceeds a preset range.

[0111] If there is a missing cooking state or cooking state notification, the processor can provide a missing cooking state notification (S33). If there are two or more missing cooking states, the processor can sequentially provide cooking state notifications for the missing cooking states. For example, in the example described above, if the average cooking state is 8.0, cooking state notifications for 6.0 and 7.0 should be provided in addition to the cooking state notification for 8.0. Accordingly, the processor can provide a cooking state notification for 6.0, and then provide a cooking state notification for 7.0.

[0112] At this time, the processor can update the reference cooking state to the missing cooking state. If there are two or more missing cooking states or cooking state notifications, the processor can update the reference cooking state to each cooking state after providing the corresponding cooking state notifications.

[0113] Then, the processor can provide a cooking status notification corresponding to the average of the cooking statuses stored in the queue (S34). Thereafter, the processor can update the reference cooking status to the average of the cooking statuses stored in the queue.

[0114] In this way, according to the present invention, as the cooking control progresses, all cooking status notifications can be sequentially provided to the user without any cooking status notifications being missed, which allows the user to continuously know the speed or degree of change in the cooking status.

[0115]

[0116] Figure 7 illustrates a procedure for controlling the image data acquisition cycle or cooking temperature according to the present invention.

[0117] The acquisition of the cooking state illustrated in FIG. 7 may be performed by the cooking appliance (1) or the control device (100, see FIG. 9) of the cooking appliance, or by the processor of the cooking appliance (1) or the control device (100) of the cooking appliance. Hereinafter, it will be described as being performed by the processor.

[0118] The cooking appliance (1) according to the present invention may include a combination oven that combines a conventional microwave oven function and an oven function, but the present invention is not limited thereto.

[0119] The procedure for controlling the image data acquisition cycle or cooking temperature according to FIG. 7 can be performed while automatic cooking control is being performed. That is, although this specification does not explicitly mention the functions or operations of automatic cooking control, it is noted that automatic cooking control is essentially performed. The image data acquisition cycle or cooking temperature is controlled according to this automatic cooking control.

[0120] The procedure of FIG. 7 may be performed after the processor provides a cooking status notification (e.g., after S40 of FIG. 2 and before S10 is performed again).

[0121] The processor can determine whether the cooking status notification is provided earlier than a reference time (S41). Here, the reference time may include an expected cooking status notification time based on a user-selected cooking method, such as a preset recipe. The expected cooking status notification time may include paired information about the cooking status and the expected notification time. For example, the expected cooking status notification time may include information about the cooking status and the cooking (control) elapsed time, such as "Cooking status T3: 4 minutes."

[0122] If the cooking status notification is provided earlier than the standard, the processor can adjust the cycle for acquiring image data or adjust the cooking temperature (S42). That is, since the cooking status changes and progresses faster than expected, the processor can accelerate the timing of monitoring the cooking status (i.e., acquiring image data) or lower the cooking temperature to control the cooking speed.

[0123] If the cooking status notification is provided not earlier than the standard, the procedure for adjusting the video data acquisition cycle or adjusting the cooking temperature may be terminated.

[0124]

[0125] Figure 8 illustrates a flowchart of automatic cooking control and provision of cooking status notification according to the present invention.

[0126] The flow chart of automatic cooking control and provision of cooking status notification of Fig. 8 shows an embodiment in which a cooking device (1) or a cooking device control device (100) acquires and transmits an internal image of a cooking chamber (11), operates a heater or fan according to a cooking control command, and provides cooking status notification according to the progress of the cooking status, and a server (200) performs the previously described cooking status acquisition, cooking status change determination, and cooking status progress determination (S10, S20, S30).

[0127] In the following description, the invention is described as being implemented by a cooking appliance (1) or a cooking appliance control device (100) and a server (200), but it is obvious that the invention can be implemented by a processor of the cooking appliance (1) or the cooking appliance control device (100) instead of the cooking appliance (1) or the cooking appliance control device (100).

[0128] The cooking appliance (1) or the cooking appliance control device (100) can receive a preset recipe for an object brought into the cooking room (11) and / or a target cooking state therefor (S81).

[0129] The cooking appliance (1) or the cooking appliance control device (100) can confirm the input preset recipe based on the input preset recipe and the acquired image data (S82). This corresponds to a procedure for confirming whether the input preset recipe is valid or has been entered correctly. The cooking appliance (1) or the cooking appliance control device (100) can use the acquired image data to confirm whether the preset recipe entered by the user corresponds to, is suitable for, or is valid for the object entered.

[0130] The cooking appliance (1) or the cooking appliance control device (100) can transmit the confirmed preset recipe to the server (200) via the network. Meanwhile, if the preset recipe input by the user is not confirmed (i.e., if the preset recipe input by the user does not correspond to, fit, or is not valid for the received object), the cooking appliance (1) or the cooking appliance control device (100) can output a warning or notification and stop the procedure.

[0131] The cooking device (1) or the cooking device control device (100) can periodically transmit acquired image data regarding an object brought into the cooking room (11) to the server (200) via a network (S84).

[0132] Cooking control commands may include a combination of set (heating or cooking) temperature and time. Furthermore, cooking control commands may include a combination of water injection and water injection time. Furthermore, cooking control commands may include a command to terminate or stop cooking control.

[0133] The server (200) can periodically determine changes in the cooking status and progress of the cooking status while cooking control is in progress (S85). In addition, when the server determines progress of the cooking status, it can transmit a cooking status notification command to the cooking appliance (1) or the cooking appliance control device (100) (S86).

[0134] The cooking appliance (1) or the cooking appliance control device (100) can provide a cooking status notification according to a cooking status notification command (S87). For example, the cooking appliance (1) or the cooking appliance control device (100) can output the cooking status notification through an output means such as a speaker, display, etc.

[0135] As mentioned above, S84, S85, etc. of FIG. 8 may be repeated periodically. In addition, the cooking status notification command or the provision of cooking status notification may be repeated (e.g., until the target cooking status is reached).

[0136] The contents described with reference to FIGS. 2 to 7, which are not described with reference to FIG. 8, may be performed by the cooking appliance (1) or the cooking appliance control device (100), or the server (200).

[0137]

[0138] Figure 9 illustrates a block diagram of a cooking appliance control device according to the present invention.

[0139] The cooking appliance control device (100) may include a transmitter / receiver (31), a processor (32), a memory (33), and a user interface or HMI (34). The cooking appliance control device (100) may be included in the cooking appliance (1).

[0140] The transceiver (31) can periodically transmit acquired image data inside the cooking chamber (11) to the server (200). In addition, the transceiver (31) can receive a cooking control command for controlling the heater / fan of the cooking appliance and / or a cooking status notification command for providing cooking status notification from the server (200).

[0141] The processor (32) can perform the operations according to the present invention described with reference to FIGS. 2 to 8. For example, the processor (32) can periodically acquire image data of an object placed in the cooking chamber, acquire a cooking status from the acquired data, determine changes in the cooking status, and determine the progress of the cooking status. In addition, the processor (32) can provide a cooking status notification when the progress of the cooking status is determined.

[0142] The processor (32) can compare the cooking state based on the acquired image data with the reference cooking state to determine a change in the cooking state. If it is determined that the cooking state based on the acquired image data is equal to or more advanced than the reference cooking state, the processor (32) can determine that the cooking state has changed. In this case, the processor (32) can store the corresponding cooking state (value) in a queue of a preset size. The processor (32) can acquire image data and determine a change in the cooking state based on the acquired image data until the queue of the preset size is full.

[0143] The processor (32) can determine the progress of the cooking state by comparing the average of the cooking states stored in the queue (i.e., the average cooking state) with the reference cooking state. The processor (32) can determine the progress of the cooking state when the queue of a preset size becomes full.

[0144] The processor (32) may determine that the cooking state has progressed since the average cooking state is a preset degree of progress compared to the reference cooking state. In this case, the processor (32) may update the reference cooking state to the average cooking state.

[0145] When the average cooking state is a cooking state that is a preset degree of progress compared to the reference cooking state, the processor (32) may provide a cooking state notification. However, when the average cooking state is a cooking state that is a preset range of progress compared to the reference cooking state, i.e., when there is a missing cooking state, the processor may provide a cooking state notification for one or more cooking states between the average cooking state and the reference cooking state. In this case, the missing cooking state notification may be provided before the cooking state notification corresponding to the average cooking state. Furthermore, when there are multiple missing cooking state notifications, the cooking state notification corresponding to a low or early cooking state may be provided before the cooking state notifications that are not the same.

[0146]

[0147] Even if not described with reference to FIG. 9, the cooking appliance control device (100) of the present invention may perform the operation according to the present invention according to FIGS. 2 to 8 described above.

[0148]

[0149] In addition, as another aspect of the present invention, the operation of the proposal or invention described above may be implemented, performed or executed by a “computer” (a comprehensive concept including a system on chip (SoC) or a (micro) processor, etc.), or may be provided as a code or a computer-readable storage medium storing or including the code or a computer program product, and the scope of the present invention may be extended to the code or the computer-readable storage medium storing or including the code or the computer program product.

[0150]

[0151] The detailed description of the preferred embodiments of the present invention disclosed above has been provided to enable those skilled in the art to implement and practice the present invention. While the above description has been made with reference to preferred embodiments of the present invention, those skilled in the art will appreciate that various modifications and variations of the present invention, as defined by the following claims, are possible. Accordingly, the present invention is not intended to be limited to the embodiments disclosed herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A method for providing notifications according to the cooking status determined while performing cooking control. A first step of filtering a preset number (n) of the latest acquired image data acquired periodically to obtain the current cooking state (A); A second step of determining a change in the cooking state based on the current cooking state (A) and the reference cooking state (B); A third step of determining the progress of the cooking state based on the average cooking state (C) of the queue and the reference cooking state (B), in which the current cooking state (A) is stored when it is determined that the cooking state has changed; and A cooking status change notification method, comprising a fourth step of providing a cooking status notification, as the above average cooking status (C) is a more advanced cooking status than the above reference cooking status (B).

2. In paragraph 1, The above cooking state is set to have one of a plurality of state values ​​having a certain interval, A cooking status change notification method, wherein the cooking status notification is provided for each of the plurality of status values ​​and is configured to be provided sequentially according to a sequential increase or decrease of the status values.

3. A cooking state change notification method in which, in the first paragraph, the average cooking state (C) is a cooking state that is advanced to a preset degree compared to the standard cooking state (B), the standard cooking state (B) is updated to the average cooking state (C).

4. In the first paragraph, the second step is A cooking status change notification method, comprising a step of storing the current cooking status (A) in the queue of a preset size when it is determined that the cooking status has changed.

5. A cooking status change notification method, wherein the first step and the second step are repeated when it is determined that the cooking status has not changed in the first paragraph.

6. A cooking status change notification method in paragraph 5, wherein if the current cooking status (A) is not the same as the reference cooking status (B) and is a cooking status that has not progressed further, the cooking status is determined to have not changed.

7. In the first paragraph, the third step is: A method for notifying a change in cooking status, which is performed when the above queue is full.

8. A cooking status change notification method in which the first step and the second step are repeated when it is determined that the cooking status has not progressed in the first paragraph.

9. In the first paragraph, the fourth step is: A cooking state change notification method, comprising the step of providing a cooking state notification for a cooking state between the average cooking state (C) and the reference cooking state (B), as the average cooking state (C) is an advanced cooking state exceeding a preset range compared to the reference cooking state (B).

10. In paragraph 1, A cooking status change notification method comprising a step of comparing the provision time of the cooking status notification with the recipe-based expected notification time for the cooking control.

11. In paragraph 10, A cooking status change notification method, comprising a step of reducing the acquisition cycle of the image data by a preset ratio or reducing the temperature for the cooking control by a preset value when the cooking status notification is provided earlier than the expected notification time based on the recipe.

12. A computer-readable medium storing a computer program for implementing a method according to any one of claims 1 to 11.

13. A cooking appliance control device configured to provide notifications according to the cooking status determined while performing cooking control. Includes a processor and a user interface, The above processor: By filtering the latest acquired image data of a preset number (n) that are acquired periodically, the current cooking state (A) is acquired, Based on the current cooking state (A) and the reference cooking state (B), the change in the cooking state is determined, When the above cooking state is determined to have changed, the progress of the cooking state is determined based on the average cooking state (C) of the queue in which the current cooking state (A) is stored and the reference cooking state (B), and A cooking appliance control device configured to provide a cooking status notification when the above average cooking status (C) is a more advanced cooking status than the above reference cooking status (B).

14. In paragraph 13, The above cooking state is set to have one of a plurality of state values ​​having a certain interval, A cooking appliance control device, wherein the above cooking status notification is provided for each of the plurality of status values ​​and is configured to be provided sequentially according to a sequential increase or decrease of the status values.

15. In the 13th paragraph, the processor, Compare the provision time of the above cooking status notification with the recipe-based expected notification time for the above cooking control, A cooking appliance control device configured to reduce the acquisition cycle of the image data by a preset ratio or reduce the temperature for the cooking control by a preset value when the cooking status notification is provided earlier than the expected notification time based on the recipe.

Images