Cooking condition setting system, cooking condition setting method, and cooking condition setting program

Abstract

The invention provides a cooking condition setting system which can easily set optimal cooking conditions for food materials placed on a heating plate. A cooking condition setting system is provided with: a captured image acquisition unit that acquires a captured image of a heating tray on which a food material is placed, the captured image being captured by an imaging device; a food material region recognition unit that recognizes a food material region on the basis of the captured image, the food material region being a region occupied by the food material placed on the heating tray in the heating tray; the food material area calculation part is used for calculating the area of the food material relative to the heating plate on the basis of the food material area; a cooking condition setting unit that sets cooking conditions on the basis of the area of the food material with respect to the heating tray; and a cooking condition display unit that displays the cooking conditions on a display device.

Description

Technical Field

[0001] This disclosure relates to a cooking condition setting system, a cooking condition setting method, and a cooking condition setting procedure. Background Technology

[0002] Patent Document 1 discloses a structure in a heating cooker comprising: a food imaging device for photographing food placed on a tray and disposed within a heating chamber; and a three-dimensional measuring device for measuring the three-dimensional shape of the food disposed within the heating chamber. The aforementioned heating cooker estimates food information such as type, size, and quantity based on information obtained from the food imaging device and the three-dimensional measuring device, and identifies the food regions of each food item placed on the tray based on the image information captured by the food imaging device. Furthermore, the heating cooker controls the heating device accordingly, based on the estimated food information and the cooking conditions set for each food item and the food regions of each food item.

[0003] Existing technical documents

[0004] Patent documents

[0005] Patent Document 1: Japanese Patent Application Publication No. 2022-88138 Summary of the Invention

[0006] The problem that the invention aims to solve

[0007] This disclosure provides a cooking condition setting system, cooking condition setting method, and cooking condition setting program that can easily set optimal cooking conditions for ingredients placed on a heating plate.

[0008] Methods for solving problems

[0009] This specification contains the full contents of Japanese Patent Application / Treaty Application 2023-172297, filed on October 3, 2023.

[0010] The cooking condition setting system disclosed herein sets cooking conditions for ingredients placed on a heating plate and cooked by a heating cooker. The system comprises: an image acquisition unit that acquires an image of the heating plate containing the ingredients, captured by an imaging device; an ingredient region recognition unit that identifies an ingredient region based on the captured image, the ingredient region being the area occupied by the ingredients placed on the heating plate; an ingredient area calculation unit that calculates the area of ​​the ingredients relative to the heating plate based on the ingredient region; a cooking condition setting unit that sets the cooking conditions based on the area of ​​the ingredients relative to the heating plate; and a cooking condition display unit that displays the cooking conditions using a display device.

[0011] The cooking condition setting method disclosed herein is a computer-executed method for setting cooking conditions for ingredients placed on a heating plate and cooked by a heating cooker. It includes: an image acquisition step, acquiring an image of the heating plate containing the ingredients, captured by an imaging device; an ingredient region identification step, identifying an ingredient region based on the captured image, the ingredient region being the area occupied by the ingredients placed on the heating plate within the heating plate; an ingredient area calculation step, calculating the area of ​​the ingredients relative to the heating plate based on the ingredient region; a cooking condition setting step, setting the cooking conditions based on the area of ​​the ingredients relative to the heating plate; and a cooking condition display step, causing a display device to display the cooking conditions.

[0012] The cooking condition setting program disclosed herein, in order to set cooking conditions for ingredients placed on a heating plate and cooked by a heating cooker, enables a computer to function as the following components: an image acquisition unit that acquires an image of the heating plate on which the ingredients are placed, captured by an imaging device; an ingredient area recognition unit that identifies an ingredient area based on the captured image, the ingredient area being the area occupied by the ingredients placed on the heating plate in the heating plate; an ingredient area calculation unit that calculates the area of ​​the ingredients relative to the heating plate based on the ingredient area; a cooking condition setting unit that sets the cooking conditions based on the area of ​​the ingredients relative to the heating plate; and a cooking condition display unit that causes a display device to display the cooking conditions.

[0013] Invention Effects

[0014] According to the cooking condition setting system, cooking condition setting method and cooking condition setting procedure disclosed herein, it is easy to set the optimal cooking conditions for ingredients placed on a heating plate. Attached Figure Description

[0015] Figure 1 This is an explanatory diagram illustrating the method of setting cooking conditions supported by the cooking condition setting system in the implementation embodiment.

[0016] Figure 2 This is a structural diagram of the heating cooker according to the implementation method.

[0017] Figure 3 This is a structural diagram of the cooking condition setting system in the implementation method.

[0018] Figure 4 This is an explanatory diagram of the camera capture support screen of the terminal device in the implementation method.

[0019] Figure 5 This is an explanatory diagram of the shooting conditions of the baking tray of the terminal device in the embodiment.

[0020] Figure 6This is an explanatory diagram of the calculation and processing of the ingredient occupancy rate in the implementation method.

[0021] Figure 7 This is an explanatory diagram of the food information screen on the terminal device in the implementation method.

[0022] Figure 8 This is an explanatory diagram of the food area correction screen of the terminal device in the implementation method.

[0023] Figure 9 This is an explanatory diagram of the cooking conditions mapping in the implementation method.

[0024] Figure 10 This is an explanatory diagram of the cooking condition confirmation screen in the implementation method.

[0025] Figure 11 This is the first flowchart of the cooking condition setting process in the implementation method.

[0026] Figure 12 This is the second flowchart of the cooking condition setting process in the implementation method. Detailed Implementation

[0027] (Insights, etc., that form the basis of this disclosure)

[0028] When the inventor conceived of this disclosure, the following technology existed: a heating cooker comprising: a food imaging device for photographing food placed on a tray and disposed within a heating chamber; and a three-dimensional measuring device for measuring the three-dimensional shape of the food disposed within the heating chamber. The aforementioned heating cooker estimates food information such as type, size, and quantity based on information obtained from the food imaging device and the three-dimensional measuring device, and identifies the food regions of each food item placed on the tray based on the image information captured by the food imaging device. Furthermore, the aforementioned heating cooker controls the heating device in accordance with the cooking conditions set for each food item according to the estimated food information and the food regions of each food item.

[0029] In the aforementioned technologies, due to factors such as the type of food and external interference, the measurement error of the three-dimensional shape of the food by the three-dimensional measuring device sometimes increases, and the food imaging device sometimes misidentifies the image of the food. Furthermore, the inventors have discovered the following problems: in these situations, the accuracy of the obtained food information decreases, and the cooking conditions of the heating cooker become inappropriate. Therefore, in order to solve the above problems, the inventors have formulated the subject matter of this disclosure.

[0030] Therefore, this disclosure provides a cooking condition setting system, a cooking condition setting method, and a cooking condition setting program that can easily set optimal cooking conditions for ingredients placed on a heating plate.

[0031] Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. However, sometimes unnecessary detailed descriptions are omitted. For example, detailed descriptions of matters already known may be omitted, or descriptions of substantially the same structures may be repeated. This is to avoid making the following description too lengthy and to make it easier for those skilled in the art to understand.

[0032] Furthermore, the accompanying drawings and the following description are provided to enable those skilled in the art to fully understand this disclosure, and are not intended to limit the subject matter of the claims.

[0033] (Implementation Method)

[0034] The following uses Figures 1-12 The implementation method is described below.

[0035] [1. Overview of cooking condition setting support provided by the cooking condition setting system]

[0036] Reference Figure 1 The following is a summary description of the cooking condition setting support of the heating cooker 100 in the cooking condition setting system 1 of this embodiment. The cooking condition setting system 1 is configured as part of the functionality of a server connected to the communication network 500. The heating cooker 100 and the terminal device 50 used by the user U communicate with the cooking condition setting system via the communication network 500 through the wireless router 310 provided in the house 300.

[0037] The heating cooker 100 includes a display device 101 and a start button 102. The display device 101 is configured by arranging a touch sensor on the surface of a flat panel display such as a liquid crystal display or an organic EL display. The user U places the food 160 on the baking tray 150 (heating tray) corresponding to the heating cooker 100, and opens the opening / closing door 116 to house the baking tray 150 inside the heating cooker 100. Four markings 151 for identifying the baking tray 150 are provided on the baking tray 150. The user U can also set the cooking conditions of the heating cooker 100 by touching the display device 101, or by using a cooking support application installed on the terminal device 50. The user U operates the start button 102 to start the heating cooker 100 cooking the food 160.

[0038] Terminal device 50 is a communication-enabled terminal device such as a smartphone, tablet, or mobile phone. Display device 81 is constructed by arranging touch sensors on the surface of a flat panel display such as a liquid crystal display or an organic EL display. The cooking support application displays a screen on display device 81 of terminal device 50 prompting users to perform the following operations.

[0039] The shooting operation... uses the camera 82 (equivalent to the shooting device disclosed herein) of the terminal device 50 to take pictures of the baking tray 150 on which the ingredients 160 are placed.

[0040] Inputting ingredient information... Inputting ingredient information such as type and status of ingredient 160 using the display device 81 of terminal device 50.

[0041] Details regarding the shooting operation and the input of ingredient information will be described later.

[0042] The captured image SP of the baking pan 150 obtained through the aforementioned shooting operation and the ingredient information FDi input through the aforementioned ingredient information input operation are sent from the terminal device 50 to the cooking condition setting system 1. The cooking condition setting system 1 applies the area of ​​the ingredient 160 relative to the baking pan 150 identified by the captured image SP and the ingredient information FDi to the cooking condition mapping 32 prepared according to each model of the heating cooker, and sets the cooking conditions of the heating cooker 100.

[0043] Here, the area of ​​ingredient 160 relative to baking pan 150 refers to the area of ​​ingredient 160 calculated by multiplying the known area of ​​baking pan 150 by the ratio of the image area of ​​ingredient 160 identified based on the captured image SP to the image area of ​​baking pan 150. Cooking condition mapping 32 is obtained by establishing a correspondence between the combination of ingredient area relative to baking pan and ingredient information and appropriate cooking conditions through experiments, computer simulations, etc. Details regarding the setting and processing of cooking conditions will be described later.

[0044] The cooking condition setting system 1 sends cooking condition data CCI, representing the set cooking conditions, to the terminal device 50, causing the display device 81 to display the cooking conditions. The user U confirms the cooking conditions displayed on the display device 81; if there are no issues, a cooking condition sending instruction operation is performed. In response to the sending instruction operation, the cooking condition setting system 1 sends the cooking condition data CCI to the heating cooker 100, thereby setting the cooking conditions for the ingredients 160 placed on the baking tray 150 in the heating cooker 100.

[0045] [2. Structure of a heating cooker]

[0046] Reference Figure 2 The structure of the heating cooker 100 will be described below. The heating cooker 100 is a microwave-steam-grill combo. The heating chamber 110 inside the chamber is connected by a right wall 111, a left wall 112, an inner wall 113, an upper wall 114, a bottom wall 115, and an opening / closing door 116 (see reference). Figure 1It is configured in a roughly rectangular shape. A throat (spindle) 117 with a roughly quadrilateral cross section is provided on the bottom wall surface 115, and a high-frequency excitation part 118 for supplying power to the heating chamber 110 is provided in the roughly central part of the throat 117.

[0047] The magnetron 119, serving as a high-frequency generation mechanism, is driven by the inverter drive power supply 135 to generate a high-frequency signal that supplies power to the heating chamber 110. The waveguide 120 guides the high-frequency signal generated by the magnetron 119 to the excitation section 118. An antenna 121, extending within the waveguide 120 and coupled to the high-frequency signal transmitted within the waveguide 120, is provided in the excitation section 118. One end of the antenna 121 is connected to the radio wave radiation mechanism 122 as a directional radiating antenna of the waveguide type. The output shaft of a motor 123 is inserted into the other end of the antenna 121; this motor 123 is the drive mechanism that rotates the radio wave radiation mechanism 122.

[0048] The radio wave radiation mechanism 122 is driven by a motor 123, and its fan-shaped upper surface rotates in a plane that is approximately parallel to the bottom surface of the throat 117. A sealing mechanism 124 made of a radio wave transmitting material such as glass or ceramic is provided at the opening of the throat 117.

[0049] The baking pan 150 includes: a pan body 150a with a concave-convex surface for placing food; and heating elements 150b and 150c, which are disposed on the bottom and side surfaces of the pan body 150a and are electromagnetic wave absorbers with ferrite as the main component. The baking pan 150 is fixed and accommodated in the heating chamber 110 by any one of the upper guide rail portion 128a, middle guide rail portion 128b, and lower guide rail portion 128c disposed on the right wall surface 111 and the left wall surface 112.

[0050] A heater 129 is disposed above the heating chamber 110, and a convection heater unit 130 is disposed behind the heater 129. The convection heater unit 130 consists of a fan that stirs the air inside the heating chamber 110, a motor that drives the fan to rotate, and a sheath heater disposed around the fan. A thermistor 131 is disposed in the heating chamber 110 to detect the temperature inside the heating chamber 110.

[0051] The water supply unit 132 is equipped with a water supply tank 132a and a pump 132b, which delivers water from the water supply tank 132a to the water supply nozzle 132c and discharges it into the heating chamber 110. An infrared sensor 133 is installed above the inner wall 113 of the heating chamber 110, which uses the entire area of ​​the baking pan 150 as the temperature detection area.

[0052] The operation of the heating cooker 100 is controlled by a control unit 136. The control unit 136 comprises a processor, memory, communication unit, etc. (not shown). The control unit 136 operates according to the display device 101 (see reference). Figure 1 The operation of the magnetron 119, heater 129, convection heater unit 130, and water supply unit 132 is controlled in accordance with the cooking conditions specified by the user U or set by the cooking condition setting system 1, and the temperature detected by the thermistor 131 and infrared sensor 133, thereby performing heating and cooking. The magnetron 119, heater 129, convection heater unit 130, and water supply unit 132 correspond to the multiple heating units of this disclosure.

[0053] [3. Structure of the cooking condition setting system]

[0054] Reference Figure 3 The structure of the cooking condition setting system 1 will be described below. The cooking condition setting system 1 is a computer system including a communication unit 2, a processor 10, and a memory 30. The cooking condition setting system 1 communicates with the terminal device 50 and the heating cooker 100 (see reference 1) via the communication unit 2 and a communication network 500. Figure 1 They communicate with each other.

[0055] The terminal device 50 includes a processor 60, a memory 70, a communication unit 80, and the aforementioned display device 81 and camera 82. The memory 70 stores the program of the cooking support application 71, and the processor 60 supports the user U's operation of taking pictures of the baking pan 150 and inputting food information by executing the cooking support application 71.

[0056] The cooking condition setting system 1 stores a cooking condition setting program 31 and a cooking condition mapping 32 in its memory 30. The processor 10 (equivalent to the computer of this disclosure) reads and executes the cooking condition setting program 31, thereby functioning as a shooting support unit 11, a shooting image acquisition unit 12, a food area recognition unit 13, a food area confirmation screen display unit 14, a food area correction unit 15, a food area calculation unit 16, a food information acquisition unit 17, a cooking condition setting unit 18, and a cooking condition display unit 19.

[0057] The processing performed by the image acquisition unit 12 is equivalent to the image acquisition step in the cooking condition setting method of this disclosure, and the processing performed by the ingredient area recognition unit 13 is equivalent to the ingredient area recognition step in the cooking condition setting method of this disclosure. The processing performed by the ingredient area calculation unit 16 is equivalent to the ingredient area calculation step in the cooking condition setting method of this disclosure, and the processing performed by the ingredient information acquisition unit 17 is equivalent to the ingredient information acquisition step in the cooking condition setting method of this disclosure. The processing performed by the cooking condition setting unit 18 is equivalent to the cooking condition setting step in the cooking condition setting method of this disclosure, and the processing performed by the cooking condition display unit 19 is equivalent to the cooking condition display step in the cooking condition setting method of this disclosure.

[0058] The camera support unit 11 sends camera support data to the terminal device 50 to support the capture of images of the baking pan 150 on which the food 160 is placed. Upon receiving the camera support data, the terminal device 50 uses the cooking support application 71 to... Figure 4 The shooting support screen 200 shown is displayed on the display device 81. The shooting support screen 200 displays a guide frame 201, a prompt 204 instructing the user to align the entire image portion 202 of the baking pan 150 with the guide frame 201 for taking the picture, and a shutter button 203. The guide frame 201 includes... Figure 1 The four markings 151 on the baking tray 150 shown correspond to the guide markings 205a~205d.

[0059] The user U adjusts the position of the terminal device 50 relative to the baking pan 150 by aligning the image portion 202 of the baking pan 150 with the guide frame 201, and operates the shutter button 203. The cooking support application 71 responds to the operation of the shutter button 203 by taking a picture with the camera 82 and sending the captured image to the cooking condition setting system 1.

[0060] The image acquisition unit 12 receives and acquires the image captured by the baking pan 150 sent from the terminal device 50. For example... Figure 5 As shown, the image acquisition unit 12 determines whether the offset between the image portion 202 of the baking pan 150 and the guide frame 201 in the captured image is within a specified range. Figure 5 In the image, for ease of explanation, the image portion 202 of baking pan 150 is represented by a dashed line.

[0061] The image acquisition unit 12 sets rectangular regions 206a, 206b, 206c, and 206d centered on each of the four guide marks 205a to 205d. Then, it captures images of the four marks 151 detected by the image portion 202 of the baking pan 150 (refer to...). Figure 1 If the image portions 152a to 152d of the four markers 151 are located within the rectangular regions 206a to 206d, it is determined that the captured image is an appropriately captured image. Here, the state in which the image portions 152a to 152d of the four markers 151 are located within the rectangular regions 206a to 206d corresponds to the situation in which the offset of the heating plate relative to the guide frame of this disclosure is within a specified range.

[0062] In addition, Figure 4 The shooting support screen shown in Figure 200 can also display... Figure 5The frame shown is a rectangular area 206a-206d centered on each of the four guide marks 205a-205d. By displaying the frame of the rectangular area 206a-206d, it is possible for the user U to confirm that the image portions 152a-152d of the four marks 151 of the baking pan 150 are within the corresponding rectangular area 206a-206d for taking pictures.

[0063] If at least one of the image portions 152a-152d of the four markers 151 is located outside the corresponding rectangular areas 206a-206d, the image acquisition unit 12 determines that an image has not been properly captured and performs a process to prompt the user U to retake the image. Figure 6 As shown in E1 to E4, the food region recognition unit 13 extracts the food region A from the captured image. Specifically, the food region recognition unit 13 detects the image portion of the baking pan 150 from the captured image taken by the camera 82 (as shown in E2), and performs trapezoidal correction as shown in E3. Then, as shown in E4, the food region recognition unit 13 performs image processing such as binarization on each pixel of the trapezoidally corrected image portion of the baking pan 150, and recognizes the food 160 (see reference). Figure 1 The image area (food area).

[0064] The ingredient area confirmation screen display unit 14 sends data representing the ingredient area confirmed by the ingredient area recognition unit 13 to the terminal device 50. Upon receiving the ingredient area confirmation screen data, the terminal device 50 uses the cooking support application 71 to... Figure 7 The ingredient information screen 210 is displayed on the display device 81.

[0065] The ingredient information screen 210 displays an ingredient area confirmation screen 211, an ingredient information input screen 213, a cooking condition display 214 corresponding to the ingredient area, an OK button 215, and a retake button 216, representing the ingredient area identified by the ingredient area recognition unit 13. In response to the operation of the retake button 216, the cooking support application 71 switches the display on the display device 81 to... Figure 4 The shooting support screen 200 shown can reshoot the baking pan 150. The cooking conditions display 214 is determined based on the range of the ingredient area.

[0066] The ingredient area confirmation screen 211 is obtained by overlaying the image portion representing the ingredient area using filled squares 223 onto the image portion 221 of the baking pan 150, with multiple squares arranged in a matrix. The user confirms the ingredient area confirmation screen 211 and operates the ingredient area correction button 212 if they wish to correct the ingredient area. Alternatively, a marker 151 can be displayed on the image portion 221 of the baking pan 150 (see reference). Figure 1The detection icons 153a~153d indicate that a baking pan 150 suitable for heating the cooker 100 is being used.

[0067] In response to the operation of the ingredient area correction button 212, the cooking support application 71 sends ingredient area correction request data to the cooking condition setting system 1. The ingredient area correction unit 15, in response to receiving the ingredient area correction request data, sends the ingredient area correction screen data to the terminal device 50. The terminal device 50, having received the ingredient area correction screen data, displays it via the cooking support application 71. Figure 8 The ingredient area shown is corrected in image 220.

[0068] In the food ingredient area, adjust the display by zooming in (image 220). Figure 7 The baking pan 150 is shown with image portion 221, a grid matrix 222, and a food area. The display shows statements 225 saying "Please click on the grid to adjust the food area" and 226 saying "Please select a grid where more than half of the square is filled with food." The user can identify image portion 221 and click on a square that is part of the food image 160 but not recognized as a food area to indicate that it should be included in the food area. For example, by clicking on square 224, the user instructs that square 224 be included in the food area.

[0069] Furthermore, for squares that are not part of the image of food ingredient 160 but are identified as food ingredient areas, a click operation can be performed to indicate that they are not included in the food ingredient area. For example, by the user clicking on square 223, it can be indicated that square 223 is not included in the food ingredient area.

[0070] In addition to clicking, other methods for selecting the squares to be corrected include dragging and sliding.

[0071] The cooking support application, in response to the user's click on a square, sends correction data for the food area—indicating whether the clicked square's image portion is included in the food area or whether the clicked square's image portion is excluded from the food area—to the cooking condition setting system 1. The food area correction unit 15, in response to receiving the food area correction data, such as... Figure 6 As shown in E5, the ingredient area A is modified to A'.

[0072] The ingredient information acquisition unit 17 sends data from the ingredient information input screen, used for inputting ingredient information related to ingredient 160, to the terminal device 50. In the terminal device 50, in response to receiving the data from the ingredient information input screen, the cooking support application 71, such as... Figure 7The ingredient information input screen 213 is displayed as shown. In this embodiment, the input (selection) items for the user U are set as follows: "Frozen meat (food larger than a bite size)", "Frozen fish (food larger than a bite size)", "Hamburger patty / bone-in meat or fish (refrigerated)", "Hamburger patty / bone-in meat or fish (frozen)", and "Sauce-marinated / baked food". Additionally, Figure 7 The input item shown is an example; you can also use other ingredient distinctions as input items.

[0073] The cooking support application 71 sends the ingredient information input data, representing the items entered through the ingredient information input screen 213, to the cooking condition setting system 1. The ingredient information acquisition unit 17 receives the ingredient information input data and acquires the input items represented by the ingredient information input data as ingredient 160. In response to the operation of the confirm button 215, the cooking support application sends the confirmation instruction data of the ingredient information to the cooking condition setting system 1.

[0074] The food ingredient area calculation unit 16 responds to receiving confirmation instruction data for food ingredient information sent from the terminal device 50, such as... Figure 6 As shown in E6, the proportion (ingredient occupancy rate) of the ingredient area A or A' (in the case of correction by user U) in the image portion of the baking pan 150 is calculated. Then, the ingredient area calculation unit 16 multiplies the ingredient occupancy rate by the known area of ​​the baking pan 150 to calculate the area of ​​the ingredient relative to the baking pan. The cooking condition setting unit 18 applies the area of ​​the ingredient calculated by the ingredient area calculation unit 16 and the ingredient information obtained by the ingredient information acquisition unit 17 to the cooking condition mapping 32 to obtain the corresponding cooking conditions, and sets the obtained cooking conditions as the cooking conditions of the heating cooker 100 for the ingredient 160.

[0075] like Figure 9 As shown, the cooking condition mapping 32 maps appropriate cooking conditions to the area of ​​the ingredients relative to the baking pan 150 calculated by the ingredient area calculation unit 16, and the five input items mentioned above (in... Figure 9 This is obtained by matching the checked options (items 1 through 5) to their corresponding combinations. Figure 9 In the example, the cooking conditions include a grilling / steaming mode, a cooking level (high, medium, low), a shelf position (upper, middle, lower), and a cooking time. The grilling / steaming mode and cooking level settings correspond to the operating modes of the multiple heating elements disclosed herein.

[0076] In the cooking condition mapping 32, the presence or absence of checkmarks for items 1 to 5 corresponds to cooking condition data according to the following rules 1 to 3.

[0077] Rule 1… Regarding refrigeration and freezing, add steam when freezing (item 1, item 2, item 4) is selected.

[0078] Rule 2… When the easily burnt sauce / marinated / baked dishes (item 5) are selected, the shelf position is lowered compared to when they are not selected.

[0079] Rule 3… Regarding meat and fish, the heating time is longer when meat (item 1) is selected than when fish (item 2) is selected.

[0080] In addition, Figure 9 In this context, the area of ​​the ingredient relative to the baking pan's 150 mm area is used (cm²). 2 The area of ​​the food relative to the baking pan 150 can be calculated using the proportion of the food area within the image portion of the baking pan (food occupancy rate), or the proportion of the food area within the image portion of the baking pan. Alternatively, the area of ​​the food relative to the baking pan 150 can be calculated using the proportion of the food area relative to other known parameters of the baking pan 150, such as the outer perimeter length of the baking pan 150, the length of the long side or the short side of the baking pan 150.

[0081] The grilling mode heats food placed on the grill pan 150 using microwaves, a heater, or both. The grilling mode is further subdivided into manual double-sided grilling mode, manual top-surface grilling mode, manual bottom-surface grilling mode, and manual double-sided grilling + steam mode. Manual double-sided grilling mode heats both the top surface (the surface facing the top of the heating chamber 110) and the bottom surface (the surface facing the heating chamber 110 towards the food on the grill pan 150) of the food placed on the grill pan 150. Manual top-surface grilling mode heats only the top surface of the food placed on the grill pan 150. Manual bottom-surface grilling mode heats only the bottom surface of the food placed on the grill pan 150. Manual double-sided grilling + steam mode is a mode that, in addition to manual double-sided grilling, also uses steam to heat the food.

[0082] Regarding the completion level, adjust the intensity (strong), medium (standard), and weak using the following two factors (A) and (B). (A) Steam time: 180 seconds for weak / medium, 360 seconds for strong. ※The overall time is the same for strong, medium, and weak. (B) Change the total heat output by adding duty cycle. The heating sequence is MW (microwave) → steam → heater.

[0083] • If steam is present: Total 15 minutes.

[0084] After 6 minutes of (strong) steam heating, MW continues to operate (ON) for the remaining 9 minutes, with the heater running in a "27 seconds on, 3 seconds off" cycle.

[0085] (In the middle) After steam heating for 3 minutes, MW continues to work for the remaining 12 minutes, with the heater operating on a "24-second operation, 6-second stop" cycle.

[0086] After (weak) steam heating for 3 minutes, the MW operates on a "27-second on, 3-second off" cycle for the remaining 12 minutes, while the heater operates on a "22-second on, 8-second off" cycle.

[0087] • No steam: (Strong) MW continues to operate, and the heater continues to operate.

[0088] (Middle) MW continues to work, and the heater operates on a "work 27 seconds, stop 3 seconds" schedule.

[0089] (Weak) MW continues to operate, with the heater running in a "22-second on, 8-second off" pattern.

[0090] *It should be noted that the intensity can be adjusted using three heating elements (steam, MW, heater), or any one of the heating elements.

[0091] Regarding shelf positions, the cooking sequence can be changed for each shelf position (upper, middle, lower), or the cooking sequence can be set to the same even if the shelf position changes.

[0092] Regarding time (seconds), when setting time (seconds) to x, 0.6x-100 seconds is set as the microwave-based heating time (MW time). Here, the settings of 0.6 and 100 are one example, and the intercept (100 in this example) and slope (0.6 in this example) are set according to each cooking sequence.

[0093] The cooking condition display unit 19 sends data from a cooking condition confirmation screen, representing the cooking conditions set by the cooking condition setting unit 18, to the terminal device 50. Upon receiving the data from the cooking condition confirmation screen, the terminal device uses the cooking support application 71 to... Figure 10 The cooking conditions confirmation screen 230 shown is displayed on the display device 81.

[0094] The cooking condition confirmation screen 230 displays an image 231 indicating the holding position of the baking pan 150 (any one of the upper, middle, or lower layers), a statement 232 indicating the holding position of the baking pan 150, user U's ingredient information input information 233, an image 234 showing the ingredient area in the baking pan 150, information 235 on the cooking conditions set by the cooking condition setting unit 18, and a send button 236. Alternatively, the ingredient information input information 233 and the ingredient area display image 234 can be omitted to simplify the screen display.

[0095] exist Figure 10 In the example, information 235, representing the cooking conditions, displays a manual "grill" program, a dual-sided + steam heating mode, a grill pan 150 positioned in the middle rack, completion level: standard, and time: 20 minutes and 0 seconds. The user U confirms the content displayed on the cooking condition confirmation screen 230; if there are no issues, they press the send button 236. The cooking support application 71, responding to the press of the send button 236, sends the cooking condition sending instruction data to the cooking condition setting system 1.

[0096] In response to receiving transmission instruction data for cooking conditions sent from the terminal device 50, the cooking condition setting unit 18 sends cooking condition data representing the cooking conditions to the heating cooker 100. The control unit 136 of the heating cooker 100 (see reference...) Figure 2 ) Receives cooking condition data and identifies the cooking conditions, and displays the cooking conditions on the display device 101 (see reference 101). Figure 1 The system notifies the user that the cooking conditions have been set via a beep. The user then checks the display on device 101, places the baking pan 150 containing the ingredients 160 in the position indicated by the cooking conditions, and operates the start button 102 (see reference). Figure 1 In response to the operation of the start button 102, the control unit 136 begins heating and cooking according to the cooking conditions.

[0097] [4. A series of processes in the cooking condition setting system]

[0098] according to Figures 11-12 The flowchart shown illustrates a series of processes for setting the cooking conditions of the heating cooker 100 by the cooking condition setting system 1 described above.

[0099] exist Figure 11 In step S1, when the cooking condition setting system 1 receives access from the terminal device 50 based on the cooking support application 71, the process proceeds to step S2, establishing communication with the terminal device 50. In the next step S3, the camera support unit 11 sends camera support screen data to the terminal device 50. Thus, in the terminal device 50, Figure 4 The shooting support screen 200 shown is displayed on the display device 81, supporting the user U to shoot the baking pan 150.

[0100] In the next step S4, when the image acquisition unit 12 receives the captured image sent from the terminal device 50, the processing proceeds to step S5. In step S5, the image acquisition unit 12 determines whether the captured area of ​​the captured image is an appropriate range that includes the entire baking pan 150. Then, if the captured area of ​​the captured image is appropriate, the image acquisition unit 12 proceeds to step S7; if the captured area of ​​the captured image is inappropriate, the processing proceeds to step S20.

[0101] In step S20, the image acquisition unit 12 sends the shooting support screen data prompting for reshooting to the terminal device 50, causing the processing to proceed to step S4. Thus, in Figure 4 The shooting support screen 200 shown here adds a message such as "Please put the baking pan back in the guide frame and take another picture", allowing the user to retake the picture of the baking pan 150. In this way, by prompting the user to retake the picture for an inappropriate image, it is possible to avoid the food area recognition unit 13 performing food area recognition processing on the entire image that does not include the baking pan 150, thus preventing the food area calculation unit 16 from calculating an incorrect food area.

[0102] In step S7, the food ingredient area recognition unit 13 refers to Figure 6 E1 to E4 identify the food area as described above. In the next step S8, the food area confirmation screen display unit 14 sends the food area confirmation screen data to the terminal device 50. Therefore, in the terminal device 50, Figure 7 The ingredient information screen 210 is displayed on the display device 81. The user U can check the ingredient area confirmation screen 211 of the ingredient information screen 210 and correct the ingredient area.

[0103] In the next step S9, the ingredient information acquisition unit 17 sends the data from the ingredient information input screen to the terminal device 50. Thus, in the terminal device 50, Figure 7 The ingredient information input screen 213 shown is displayed on the display device 81, allowing the user U to input (select) information about ingredient 160. Through the following... Figure 12 The process of steps S10, S30, and S40 is repeated. In step S10, when the food area calculation unit 16 receives the cooking condition determination instruction data sent from the terminal device 50, the process proceeds to step S11.

[0104] In step S30, refer to Figure 8 As described above, when the food ingredient area correction unit 15 receives correction data for the food ingredient area sent from the terminal device 50, it initiates step S31 to correct the food ingredient area based on the correction data. Then, the food ingredient area correction unit 15 initiates step S10. In step S40, referring to... Figure 7As described above, when the ingredient information acquisition unit 17 receives ingredient information data sent from the terminal device 50, it causes the processing to proceed to step S41 to acquire the ingredient information represented by the ingredient information data. Then, the ingredient information acquisition unit 17 causes the processing to proceed to step S10.

[0105] In step S11, the food area calculation unit 16 calculates the area of ​​the food relative to the baking pan 150 by multiplying the ratio of the food area to the image area of ​​the baking pan 150 by the known area of ​​the baking pan 150, based on the food area identified by the food area recognition unit 13 (or the corrected food area if corrected by the food area correction unit 15). In the next step S12, the cooking condition setting unit 18 applies the food area and food information to the cooking condition mapping 32 prepared according to the model of the heating cooker 100, and sets the cooking conditions.

[0106] In the next step S13, the cooking condition display unit 19 sends the cooking condition data to the terminal device 50. Thus, in the terminal device 50, Figure 10 The cooking condition confirmation screen 230 is displayed on the display device 101. The user U confirms the cooking condition confirmation screen 230 and operates the send button 236. In response to this operation, the terminal device 50 sends the cooking condition sending instruction data to the cooking condition setting system 1.

[0107] In the next step S14, when the cooking condition setting unit 18 receives the cooking condition transmission instruction data sent from the terminal device 50, the process proceeds to step S15. In step S15, the cooking condition setting unit 18 sends the cooking condition data to the heating cooker 100. Thus, the cooking conditions of the heating cooker 100 are set.

[0108] [5. Effects, etc.]

[0109] As described above, in this embodiment, the cooking condition setting system 1 sets the cooking conditions of the heating cooker 100 based on the area of ​​the food relative to the baking pan 150. By using the area of ​​the food relative to the baking pan 150, which is less susceptible to the detection conditions of the detection mechanism or external interference, it is possible to suppress the setting of inappropriate cooking conditions for the heating cooker 100. Furthermore, it is easy to set optimal cooking conditions for the food placed on the heating pan.

[0110] Furthermore, the cooking condition setting system 1 uses an image of the baking pan 150 on which the ingredients 160 are placed and the ingredient information input by the user U to set the cooking conditions of the heating cooker 100. In this way, by using the ingredient information input by the user U, compared with the case where cooking conditions are set only using the detection information of the detection unit such as sensors, the influence of the detection conditions of the detection mechanism, external interference, etc., can be reduced, and inappropriate cooking conditions are prevented from being set for the heating cooker 100.

[0111] (Other implementation methods)

[0112] As described above, the above embodiments have been illustrated as examples of the technology disclosed in this application. However, the technology in this disclosure is not limited to this and can also be applied to embodiments that have been modified, substituted, added, omitted, etc.

[0113] In the above embodiments, such as Figure 1 As shown, a heating cooker 100 with the function of communicating with a cooking condition setting system 1 is illustrated, and cooking condition data is sent from the cooking condition setting system 1 to the heating cooker 100. Alternatively, if the heating cooker 100 does not have a communication function, the user U can confirm the cooking condition on the display device 81 of the terminal device 50 (see reference 1). Figure 10 You can set the cooking conditions by operating the display device 101 of the heating cooker 100.

[0114] In the above embodiments, such as Figure 3 As shown, the cooking condition setting system 1 is configured to function as a server. Alternatively, the cooking condition setting system 1 can also be configured to function as a cooking support application 71 installed on the terminal device 50. In this case, the processor 60 of the terminal device 50 executes the cooking support application 71 (equivalent to the cooking condition setting program of this disclosure), thereby functioning as the imaging support unit 11, the image acquisition unit 12, the ingredient area recognition unit 13, the ingredient area confirmation screen display unit 14, the ingredient area correction unit 15, the ingredient area calculation unit 16, the ingredient information acquisition unit 17, the cooking condition setting unit 18, and the cooking condition display unit 19. The cooking condition mapping 32 can be stored on the terminal device 50, or it can be configured so that the terminal device 50 accesses and references the cooking condition mapping 32 stored on a server, etc.

[0115] In this structure, cooking conditions are set by performing processes such as taking pictures of the baking pan 150, re-taking pictures, and correcting the food areas in the pictures on the terminal device 50 side without communicating with the server. Therefore, compared to performing these processes on the server side, the time required to set the cooking conditions can be shortened.

[0116] Alternatively, a portion of the functionality of the cooking condition setting system 1 can be incorporated into the functionality of the cooking support application 71 installed on the terminal device 50. For example, the functions of the image capture support unit 11, image acquisition unit 12, ingredient area recognition unit 13, ingredient area confirmation screen display unit 14, ingredient area correction unit 15, and ingredient information acquisition unit 17 can be incorporated into the cooking support application. In this case, no communication with the server is performed; instead, the processes of capturing images of the baking pan 150, re-capturing images, and correcting ingredient areas in the captured images are executed on the terminal device 50 side. Therefore, compared to performing these processes on the server side, the time required for setting the cooking conditions can be shortened. Furthermore, it can be configured such that, on the terminal device 50 side, a system generates... Figure 5 The guide frame 201 shown is used to send a cropped image of the entire baking pan 150 and cropped images of the four marked image portions 152a-152d to the server. As a result, the amount of image information sent from the terminal device 50 to the server is reduced, and the calculation of the area of ​​the food relative to the baking pan 150 and the recognition of the baking pan 150 can be performed efficiently on the server side.

[0117] Furthermore, the system can be configured such that the server includes a shooting support unit 11, an image acquisition unit 12, and a food area recognition unit 13, while the terminal device 50 includes a food area confirmation screen display unit 14, a food area correction unit 15, a food area calculation unit 16, a food information acquisition unit 17, and a cooking condition setting unit 18. In this case, the specifications are as follows: the server side performs processing to recognize the food area from the image captured from the baking pan 150, sends the food area information from the server 1 to the terminal device 50, and the terminal device 50 performs correction of the food area and calculation of the area of ​​the corrected food area to set the cooking conditions.

[0118] Furthermore, the cooking condition setting system 1 can also be configured as the function of the control unit 136 of the heating cooker 100. In this case, the processor of the control unit 136 executes the cooking condition setting program stored in the memory of the control unit 136, and functions as the imaging support unit 11, the image acquisition unit 12, the food area recognition unit 13, the food area confirmation screen display unit 14, the food area correction unit 15, the food area calculation unit 16, the food information acquisition unit 17, the cooking condition setting unit 18, and the cooking condition display unit 19. Furthermore, the display is shown on the display device 101 of the heating cooker 100. Figure 7 , Figure 8 , Figure 10 The image shown may be transmitted from the heating cooker 100 to the terminal device 50, and then displayed on the display device 81 of the terminal device 50. Figure 7 , Figure 8 , Figure 10The image shown.

[0119] In this structure, since the processes of taking pictures of the baking pan 150, re-taking pictures, and correcting the food areas in the pictures are performed on the heating cooker 100 side without communicating with the server, the time required to set the cooking conditions can be shortened compared to the case where these processes are performed on the server side.

[0120] Alternatively, a portion of the functions of the cooking condition setting system 1 can be incorporated into the functions of the control unit 136 of the heating cooker 100. For example, the functions of the imaging support unit 11, the image acquisition unit 12, the food area recognition unit 13, the food area confirmation screen display unit 14, the food area correction unit 15, and the food information acquisition unit 17 can be incorporated into the functions of the control unit 136 of the heating cooker 100. In this case, communication with the server is not performed, and the processes of photographing the baking pan 150, re-photographing, and correcting the food areas in the photographed images are performed on the terminal device 50 side. Therefore, compared to performing these processes on the server side, the time required to set the cooking conditions can be shortened.

[0121] In the above embodiment, the baking pan 150 is photographed by the camera 82 provided with the terminal device 50. However, it is also possible to configure the baking pan 150 contained in the heating cooker 100 to be photographed by a camera installed inside the housing of the heating cooker 100. The camera installed inside the housing of the heating cooker 100 is equivalent to the shooting device of this disclosure. In this case, the camera can be arranged so that the entire baking pan 150 contained in the heating cooker 100 is housed within the shooting range, and therefore the shooting support unit 11 is not required.

[0122] In the above embodiment, the cooking condition setting unit 18 uses the area of ​​the ingredients relative to the baking pan 150 calculated based on the image of the baking pan 150 and the ingredient information input by the user U to set the cooking conditions of the heating cooker 100. Alternatively, the user U's input of ingredient information may be omitted, and the cooking conditions of the heating cooker 100 may be set using only the area of ​​the ingredients relative to the baking pan 150. Alternatively, information other than the area of ​​the ingredients relative to the baking pan 150 based on the image of the baking pan 150 and the ingredient information input by the user U may be used to set the cooking conditions of the heating cooker 100. Alternatively, the ingredient information input by the user U may not be used, and the cooking conditions of the heating cooker 100 may be set using information other than the area of ​​the ingredients relative to the baking pan 150.

[0123] In the above embodiments, such as Figure 9As shown, the heating output (grilling, steam, completion), the capacity of the baking pan, and the heating time are set as cooking conditions. In addition, heating conditions based on the temperature (internal temperature) of grilling, steam, etc., can also be set.

[0124] The controller that controls the operation of the cooking condition setting system of this disclosure is only required to control the cooking condition setting system of this disclosure. When describing the subject matter of the invention, the components controlling the cooking condition setting system of this disclosure are sometimes described as control mechanisms or control units, or similar terms, in addition to controller. The controller can be implemented in various ways. For example, a processor can be used as the controller. If a processor is used as the controller, the processor reads the program from a storage medium storing the program and executes the program, thereby enabling the execution of various processes. Therefore, the processing content can be changed by changing the program stored in the storage medium, thus increasing the freedom to change the control content. Examples of processors include CPUs (Central Processing Units) and MPUs (Micro-Processing Units). Examples of storage media include hard disks, flash memory, and optical disks. Furthermore, wired logic, which cannot be rewritten, can also be used as the controller. Using wired logic as the controller is effective in improving processing speed. Examples of wired logic include ASICs (Application Specific Integrated Circuits). Furthermore, the controller can be implemented by combining a processor and wiring logic. Combining a processor and wiring logic to implement the controller increases both the freedom of software design and processing speed. Additionally, a controller and a circuit with different functions can be constructed from a single semiconductor element. Examples of circuits with other functions include A / D / A conversion circuits. The controller can be constructed from a single semiconductor element or from multiple semiconductor elements. In the case of multiple semiconductor elements, the various controls described in the claims can be implemented using different semiconductor elements. Alternatively, the controller can be constructed using a structure that includes semiconductor elements and passive components such as resistors or capacitors.

[0125] The communicator (communication unit) in this disclosure is only required to enable communication between the system of this disclosure and external devices. When describing the subject matter of the invention, the component enabling communication between the system of this disclosure and external devices is sometimes referred to as a communication mechanism, communication unit, transceiver mechanism, or transceiver unit, or similar terms, in addition to "communicator". The communicator can be implemented in various ways. For example, the communicator can be wired to an external device or wirelessly connected to an external device. If the communicator is wired to connect the device of this disclosure to an external device, it is effective in terms of communication security and stability. Examples of wired communicators include wired LANs based on the Ethernet standard or wired connections using fiber optic cables. Examples of wireless communicators include wireless connections to external devices via base stations or direct wireless connections to external devices. Wireless connections to external devices via base stations, etc., include, for example, IEEE 802.11 wireless LAN for wireless communication with WiFi routers, third-generation mobile communication systems (commonly known as 3G), fourth-generation mobile communication systems (commonly known as 4G), WiMax (commonly known as IEEE 802.16), or LPWA (Low Power Wide Area). Using a communicator that directly wirelessly connects the device of this disclosure to external devices effectively improves communication security, and the device of this disclosure can communicate with external devices even in locations where relay devices such as WiFi routers are absent. Examples of communicators that directly wirelessly connect the device of this disclosure to external devices include Bluetooth-based communication, NFC (Near Field Communication) communication via a loop antenna, or infrared communication.

[0126] Furthermore, the above-described embodiments are used to illustrate the technology in this disclosure, and therefore, various changes, substitutions, additions, omissions, etc., can be made within the scope of the claims or their equivalents.

[0127] (Postscript)

[0128] The following technology has been disclosed through the above description of the embodiments.

[0129] (Technology 1) A cooking condition setting system for setting cooking conditions for food ingredients placed on a heating plate and cooked by a heating cooker, wherein the cooking condition setting system comprises: an image acquisition unit that acquires an image of the heating plate on which the food ingredients are placed, captured by an imaging device; a food ingredient area recognition unit that identifies a food ingredient area based on the captured image, the food ingredient area being the area occupied by the food ingredients placed on the heating plate in the heating plate; a food ingredient area calculation unit that calculates the area of ​​the food ingredients relative to the heating plate based on the food ingredient area; a cooking condition setting unit that sets the cooking conditions based on the area of ​​the food ingredients relative to the heating plate; and a cooking condition display unit that displays the cooking conditions using a display device.

[0130] This structure allows for easy setting of optimal cooking conditions for ingredients placed on the heating plate.

[0131] (Technology 2) The cooking condition setting system according to Technology 1, wherein the cooking condition setting system comprises: a food area confirmation screen display unit that causes the display device to display a food area confirmation screen, wherein the food area confirmation screen displays the image portion identified by the food area recognition unit as the food area in relation to the captured image in a manner distinguishable from image portions other than the food area; and a food area correction unit that corrects the food area in response to a correction instruction operation of the operating device by a user of the heating cooker, wherein the food area calculation unit calculates the area of ​​the food relative to the heating plate based on the food area corrected by the food area correction unit.

[0132] According to this structure, for ingredients that are difficult for the ingredient area recognition unit to identify, the user can correct the ingredient area, thereby improving the recognition accuracy of the ingredient area and setting more appropriate cooking conditions.

[0133] (Technology 3) According to the cooking condition setting system of Technology 2, the ingredient area confirmation screen display unit displays an image obtained by overlapping the area indicating the range of the ingredient area with the captured image on the ingredient area confirmation screen.

[0134] This design makes it easier for users to identify the food ingredients.

[0135] (Technology 4) A cooking condition setting system according to any one of Technology 1 to Technology 3, wherein the cooking conditions include at least one of heating time, heating output, heating temperature, and the location of the heating plate within the chamber of the heating cooker.

[0136] This structure allows users to confirm the heating time, heating output, heating temperature, and the location of the heating plate inside the box, which are the basic cooking conditions for ingredients.

[0137] (Technology 5) A cooking condition setting system according to any one of Technologies 1 to 4, wherein the image acquisition unit acquires the image captured by the imaging device of the terminal device used by the user of the heating cooker.

[0138] According to this structure, by using the camera device on the terminal device to take pictures of the heating plate containing food, it is not necessary to have a camera device in the heating cooker, thus reducing the cost of the heating cooker.

[0139] (Technology 6) The cooking condition setting system according to Technology 5, wherein the cooking condition setting system includes a shooting support unit, the shooting support unit displays a guide frame on the shooting screen captured by the shooting device displayed on the display device of the terminal device, the guide frame guiding the entire heating plate into the shooting range.

[0140] According to this structure, by displaying a guide frame on the shooting screen of the shooting device on the terminal device, the user can be supported in taking appropriate pictures of the heating plate.

[0141] (Technology 7) The cooking condition setting system according to Technology 6, wherein the shooting support unit causes the display device to display the guide frame and a statement, the statement prompting to shoot in a manner that makes the offset of the heating plate relative to the guide frame within a specified range.

[0142] According to this structure, by displaying a prompt on the display device to take a picture in a manner that ensures the offset of the heating plate relative to the guide frame is within a specified range, the user can be supported in taking appropriate pictures of the heating plate.

[0143] (Technology 8) The cooking condition setting system according to Technology 6 or Technology 7, wherein when the offset of the heating plate relative to the guide frame, as identified from the image captured by the shooting device, is outside the predetermined range, the shooting support unit causes the display device to display a statement such as: prompting to shoot in a manner that makes the offset of the heating plate relative to the guide frame within the predetermined range.

[0144] According to this structure, if the offset of the heating plate relative to the guide frame is outside the specified range, it can prompt the user to correct the photographic position of the photographic device.

[0145] (Technology 9) A cooking condition setting system according to any one of Technologies 6 to 8, wherein the shooting support causes the shooting screen to display a mark indicating the position of the heating plate identified from an image captured by the shooting device.

[0146] Based on this structure, the position of the heating plate in the captured image can be easily identified by the display of the markings.

[0147] (Technology 10) A cooking condition setting system according to any one of Technologies 6 to 9, wherein the image acquisition unit acquires an image captured by the imaging device when the offset of the heating plate relative to the guide frame is within the predetermined range, and uses the captured image as the object for the food region recognition unit to recognize the food region.

[0148] Based on this structure, the image captured, which includes the entire heating plate, can efficiently identify the food area.

[0149] (Technology 11) A cooking condition setting system according to any one of Technology 1 to Technology 4, wherein the image acquisition unit acquires the image captured by the imaging device disposed inside the housing of the heating cooker containing the heating plate.

[0150] According to this structure, a heating plate contained in and positioned to a certain extent within the heating cooker can be stably photographed by a photographing device installed inside the heating cooker.

[0151] (Technology 12) A cooking condition setting system according to any one of Technologies 1 to 4, wherein the imaging device and the display device are disposed in a terminal device used by the user of the heating cooker, the image acquisition unit, the food area recognition unit, the food area calculation unit and the cooking condition setting unit are disposed in a server communicating with the terminal device, the image acquisition unit acquires the image by receiving the image captured by the imaging device and sent by the terminal device, and the cooking condition display unit causes the display device to display the cooking conditions by sending cooking condition data representing the cooking conditions to the terminal device.

[0152] According to this structure, images captured by the camera device on the terminal device can be sent to the server, and the server can centrally set the cooking conditions for the food placed on the heating plate.

[0153] (Technology 13) A cooking condition setting method, which is a computer-executed method for setting cooking conditions for ingredients placed on a heating plate and cooked by a heating cooker, wherein the cooking condition setting method includes: an image acquisition step, acquiring an image of the heating plate on which the ingredients are placed, captured by an imaging device; an ingredient region identification step, identifying an ingredient region based on the captured image, the ingredient region being the area occupied by the ingredients placed on the heating plate in the heating plate; an ingredient area calculation step, calculating the area of ​​the ingredients relative to the heating plate based on the ingredient region; a cooking condition setting step, setting the cooking conditions based on the area of ​​the ingredients relative to the heating plate; and a cooking condition display step, causing a display device to display the cooking conditions.

[0154] By having a computer execute the cooking condition setting method of this structure, the same effect as the cooking condition setting system of Technology 1 can be achieved.

[0155] (Technology 14) A cooking condition setting program that, in order to set cooking conditions for ingredients placed on a heating plate and cooked by a heating cooker, enables a computer to function as the following units: an image acquisition unit that acquires an image of the heating plate on which the ingredients are placed, captured by an imaging device; an ingredient area recognition unit that identifies an ingredient area based on the captured image, the ingredient area being the area occupied by the ingredients placed on the heating plate in the heating plate; an ingredient area calculation unit that calculates the area of ​​the ingredients relative to the heating plate based on the ingredient area; a cooking condition setting unit that sets the cooking conditions based on the area of ​​the ingredients relative to the heating plate; and a cooking condition display unit that causes a display device to display the cooking conditions.

[0156] The structure of the cooking condition setting system of Technology 1 can be realized by having a computer execute the cooking condition setting program of this structure.

[0157] Industrial availability

[0158] This disclosure can be applied to easily setting optimal cooking conditions for ingredients placed on a heating plate.

[0159] Symbol Explanation

[0160] 1. Cooking Condition Setting System

[0161] 2 communication units

[0162] 10 processors

[0163] 11 Filming Support Department

[0164] 12 Image Acquisition Unit

[0165] 13 Food Ingredient Area Identification Department

[0166] 14. Ingredient Area Confirmation Screen Display

[0167] 15. Food Ingredient Area Correction Department

[0168] 16. Food Ingredient Area Calculation Department

[0169] 17. Food Information Acquisition Department

[0170] 18 Cooking Conditions Setting Section

[0171] 19 Cooking Conditions Display Section

[0172] 30 memory

[0173] 31 Cooking Condition Setting Program

[0174] 32 Cooking Condition Mapping

[0175] 50 terminal devices

[0176] 60 processor

[0177] 70 memory

[0178] 71 Cooking Support Apps

[0179] 80 communication units

[0180] 81 display device

[0181] 82 cameras

[0182] 100 heating cooker

[0183] 101 display device

[0184] 102 Start button

[0185] 150 baking pan

[0186] 160 ingredients

[0187] 200 shooting support screen

[0188] 210 Food Information Screen

[0189] 211 Ingredient Area Confirmation Screen

[0190] 213 Ingredient Information Input Screen

[0191] 220 Food Area Correction Screen

[0192] 230 Cooking Condition Confirmation Screen

[0193] U users

Claims

1. A cooking condition setting system for setting cooking conditions for ingredients placed on a heating plate and cooked by a heating cooker, wherein, The cooking condition setting system includes: The image acquisition unit acquires an image of the heating plate containing the food ingredients, captured by the imaging device. The food ingredient area recognition unit identifies the food ingredient area based on the captured image, wherein the food ingredient area is the area occupied by the food ingredient placed on the heating plate in the heating plate; The food area calculation unit calculates the area of ​​the food relative to the heating plate based on the food area; The cooking condition setting unit sets the cooking conditions based on the area of ​​the ingredients relative to the heating plate; as well as A cooking conditions display unit that displays the cooking conditions on a display device.

2. The cooking condition setting system according to claim 1, wherein, The cooking condition setting system includes: The ingredient area confirmation screen display unit causes the display device to display an ingredient area confirmation screen. The ingredient area confirmation screen displays the image portion of the captured image that is identified as the ingredient area by the ingredient area recognition unit in a way that can be distinguished from the image portion outside the ingredient area. as well as The food ingredient area correction unit, in response to a correction instruction from the user of the heating cooker to the operating device, corrects the food ingredient area. The food area calculation unit calculates the area of ​​the food relative to the heating plate based on the food area corrected by the food area correction unit.

3. The cooking condition setting system according to claim 2, wherein, The food area confirmation screen display unit displays an image obtained by overlapping the area indicating the range of the food area with the captured image on the food area confirmation screen.

4. The cooking condition setting system according to any one of claims 1 to 3, wherein, The cooking conditions include at least one of heating time, heating output, heating temperature, and the location of the heating plate within the housing of the heating cooker.

5. The cooking condition setting system according to any one of claims 1 to 3, wherein, The image acquisition unit acquires the image captured by the imaging device on the terminal device used by the user of the heating cooker.

6. The cooking condition setting system according to claim 5, wherein, The cooking condition setting system includes a shooting support unit, which displays a guide frame on the shooting screen captured by the shooting device displayed on the display device of the terminal device. The guide frame guides the viewer in a way that the entire heating plate is contained within the shooting range.

7. The cooking condition setting system according to claim 6, wherein, The shooting support unit causes the display device to display the guide frame and a statement, which prompts the shooting to be performed in a manner that keeps the offset of the heating plate relative to the guide frame within a specified range.

8. The cooking condition setting system according to claim 7, wherein, If the offset of the heating plate relative to the guide frame, as identified from the image captured by the shooting device, is outside the specified range, the shooting support unit causes the display device to display a statement that prompts the shooting to be performed in a manner that ensures the offset of the heating plate relative to the guide frame is within the specified range.

9. The cooking condition setting system according to claim 6, wherein, The shooting support unit causes the shooting screen to display a marker indicating the position of the heating plate as identified from the image captured by the shooting device.

10. The cooking condition setting system according to claim 6, wherein, The image acquisition unit acquires an image captured by the imaging device when the offset of the heating plate relative to the guide frame is within the specified range, and uses this image as the object for the food area recognition unit to recognize the food area.

11. The cooking condition setting system according to any one of claims 1 to 3, wherein, The image acquisition unit acquires the image captured by the imaging device installed inside the heating cooker housing the heating plate.

12. The cooking condition setting system according to any one of claims 1 to 3, wherein, The camera and the display are mounted on a terminal device used by the user of the heating cooker. The image acquisition unit, the food ingredient area recognition unit, the food ingredient area calculation unit, and the cooking condition setting unit are located on a server that communicates with the terminal device. The image acquisition unit acquires the captured image by receiving the captured image captured by the shooting device and transmitted by the terminal device. The cooking condition display unit sends cooking condition data representing the cooking conditions to the terminal device, causing the display device to display the cooking conditions.

13. A method for setting cooking conditions, which is a method for setting cooking conditions executed by a computer for setting cooking conditions for ingredients placed on a heating plate and cooked by a heating cooker, wherein, The cooking condition setting method includes: The image acquisition step involves acquiring an image of the heating plate containing the food ingredients, captured by the imaging device. The food ingredient area recognition step identifies the food ingredient area based on the captured image. The food ingredient area is the area occupied by the food ingredient placed on the heating plate in the heating plate. The food area calculation step involves calculating the area of ​​the food relative to the heating plate based on the food area. The cooking conditions setting step involves setting the cooking conditions based on the area of ​​the ingredients relative to the heating plate. as well as The cooking conditions display step causes the display device to display the cooking conditions.

14. A cooking condition setting program that enables a computer to function as a component for setting cooking conditions for ingredients placed on a heating plate and cooked by a heating cooker: The image acquisition unit acquires an image of the heating plate containing the food ingredients, captured by the imaging device. The food ingredient area recognition unit identifies the food ingredient area based on the captured image, wherein the food ingredient area is the area occupied by the food ingredient placed on the heating plate in the heating plate; The food area calculation unit calculates the area of ​​the food relative to the heating plate based on the food area; The cooking condition setting unit sets the cooking conditions based on the area of ​​the ingredients relative to the heating plate; as well as A cooking conditions display unit that displays the cooking conditions on a display device.

Images