Cooking condition setting system, cooking condition setting method, and cooking condition setting program

Abstract

To provide a cooking condition setting system capable of easily setting an optimal cooking condition to food located on a heating tray.SOLUTION: A cooking condition setting system comprises: a photographed image acquisition part for acquiring an image of a heating tray, on which food is located, the image being photographed by an imaging device; a food region recognition part for recognizing a food region of the heating tray occupied with the food located on the heating tray based on the photographed image; a food area calculation part for calculating an area of the food on the heating tray based on the food region; a cooking condition setting part for setting a cooking condition based on the area of the food on the heating tray; and a cooking condition display part for displaying the cooking condition on a display device.SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] The present disclosure relates to a cooking condition setting system, a cooking condition setting method, and a cooking condition setting program. [Background technology]

[0002] Patent Document 1 discloses a cooking device that includes a food photography device that photographs food placed on a tray and placed in a heating chamber, and a three-dimensional measurement device that measures the three-dimensional shape of the food placed in the heating chamber. The cooking device estimates food information such as the type, size, and amount of food based on information acquired by the food photography device and the three-dimensional measurement device, and recognizes the food area of ​​each food placed on the tray from the image information captured by the food photography device. The cooking device then controls the heating device according to cooking conditions set for each food and the food area of ​​each food according to the estimated food information. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication No. 2022-88138 Summary of the Invention [Problem to be solved by the invention]

[0004] The present disclosure provides a cooking condition setting system, a cooking condition setting method, and a cooking condition setting program that can easily set optimal cooking conditions for ingredients placed on a heating tray. [Means for solving the problem]

[0005] The cooking condition setting system of the present disclosure is a cooking condition setting system that sets cooking conditions for ingredients placed on a heating plate and cooked by a heating cooker, and includes an image acquisition unit that acquires an image of the heating plate on which ingredients are placed, captured by a photographing device, an ingredient area recognition unit that recognizes an ingredient area, which is the area on the heating plate occupied by the ingredients placed on the heating plate, based on the captured image, an ingredient area calculation unit that calculates the area of ​​the ingredients relative to the heating plate based on the ingredient area, a cooking condition setting unit that sets the cooking conditions based on the area of ​​the ingredients relative to the heating plate, and a cooking condition display unit that displays the cooking conditions on a display device.

[0006] The cooking condition setting method disclosed herein is a cooking condition setting method executed by a computer to set cooking conditions for ingredients placed on a heating plate and cooked in a heating cooker, and includes an image acquisition step of acquiring an image of the heating plate on which ingredients are placed, photographed by an imaging device; an ingredient area recognition step of recognizing an ingredient area on the heating plate, which is an area occupied by the ingredients placed on the heating plate, based on the photographed image; an ingredient area calculation step of calculating the area of ​​the ingredients relative to the heating plate based on the ingredient area; a cooking condition setting step of setting the cooking conditions based on the area of ​​the ingredients relative to the heating plate; and a cooking condition display step of displaying the cooking conditions on a display device.

[0007] The cooking condition setting program of the present disclosure causes a computer to function as an image acquisition unit that acquires an image of the heating plate on which ingredients are placed, captured by an imaging device, a food ingredient area recognition unit that recognizes an food ingredient area, which is the area on the heating plate occupied by the ingredients placed on the heating plate, based on the captured image, a food ingredient area calculation unit that calculates the area of ​​the ingredients relative to the heating plate based on the food ingredient area, a cooking condition setting unit that sets the cooking conditions based on the area of ​​the ingredients relative to the heating plate, and a cooking condition display unit that displays the cooking conditions on a display device, in order to set cooking conditions for ingredients placed on a heating plate and cooked in a heating cooker. Effect of the Invention

[0008] According to the cooking condition setting system, cooking condition setting method, and cooking condition setting program disclosed herein, optimal cooking conditions can be easily set for ingredients placed on a heating tray. [Brief description of the drawings]

[0009] [Figure 1] FIG. 2 is an explanatory diagram of a setting mode of cooking conditions supported by the cooking condition setting system in the embodiment. [Diagram 2] FIG. 1 is a diagram showing the configuration of a cooking device according to an embodiment of the present invention; [Diagram 3] A configuration diagram of a cooking condition setting system according to an embodiment. [Figure 4] FIG. 13 is an explanatory diagram of a shooting support screen of the terminal device in the embodiment. [Diagram 5] FIG. 2 is an explanatory diagram of conditions for photographing a grill plate using a terminal device according to an embodiment; [Figure 6] FIG. 2 is an explanatory diagram of a calculation process of an ingredient occupancy rate in the embodiment; [Figure 7] FIG. 13 is an explanatory diagram of an ingredient information screen of a terminal device according to an embodiment. [Figure 8] FIG. 13 is an explanatory diagram of an ingredient region correction screen of a terminal device according to an embodiment. [Figure 9] FIG. 2 is an explanatory diagram of a cooking condition map according to the embodiment. [Figure 10] FIG. 13 is an explanatory diagram of a cooking condition confirmation screen in the embodiment. [Figure 11] 1 is a first flowchart of a cooking condition setting process according to an embodiment. [Figure 12] 2 is a second flowchart of the cooking condition setting process according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] (The knowledge and other information that formed the basis of this disclosure) At the time when the inventors came up with the present disclosure, there was a technology for a cooking device that includes a food photography device that photographs food placed on a tray and placed in a heating chamber, and a three-dimensional measurement device that measures the three-dimensional shape of the food placed in the heating chamber. The cooking device estimates food information such as the type, size, and amount of food based on information acquired by the food photography device and the three-dimensional measurement device, and recognizes the food area of ​​each food placed on the tray from the image information captured by the food photography device. The cooking device then controls the heating device according to cooking conditions set for each food item according to the estimated food information and the food area of ​​each food item. In the above technology, due to factors such as the type of food ingredient and external disturbances, the 3D measuring device may have a large measurement error in the 3D shape of the food ingredient, and the food photography device may misrecognize the image of the food ingredient. The inventors discovered that in these cases, the accuracy of the acquired food ingredient information decreases, leading to inappropriate settings of the cooking conditions of the cooking device. The inventors have come up with the subject matter of the present disclosure in order to solve the above problems. Therefore, the present disclosure provides a cooking condition setting system, a cooking condition setting method, and a cooking condition setting program that can easily set optimal cooking conditions for ingredients placed on a heating tray.

[0011] Hereinafter, the embodiments will be described in detail with reference to the drawings. However, more detailed explanation than necessary may be omitted. For example, detailed explanation of already well-known matters or duplicate explanation of substantially the same configuration may be omitted. This is to avoid the following explanation becoming more redundant than necessary and to facilitate understanding by those skilled in the art. It should be noted that the accompanying drawings and the following description are provided to enable those skilled in the art to fully understand the present disclosure, and are not intended to limit the subject matter described in the claims.

[0012] (Embodiment) Hereinafter, the embodiment will be described with reference to FIGS. 1 to 12. FIG. [1. Overview of cooking condition setting support by the cooking condition setting system] An overview of support for setting cooking conditions for a cooking appliance 100 by a cooking condition setting system 1 of the present embodiment will be described with reference to Fig. 1. The cooking condition setting system 1 is configured as part of the functions of a server connected to a communication network 500. The cooking appliance 100 and a terminal device 50 used by a user U communicate with the cooking condition setting system via the communication network 500 by a wireless router 310 provided in a house 300.

[0013] The cooking device 100 includes a display device 101 and a start button 102. The display device 101 is configured by arranging a touch sensor on the surface of a flat panel display such as a liquid crystal display or an organic electroluminescence display. A user U places food 160 on a grill plate 150 (heating plate) corresponding to the cooking device 100, opens the opening and closing door 116, and places the grill plate 150 in the chamber of the cooking device 100. The grill plate 150 is provided with four marks 151 for identifying the grill plate 150. The user U can set cooking conditions for the cooking device 100 by touching the display device 101, but can also set cooking conditions for the cooking device 100 using a cooking support app installed in the terminal device 50. The user U operates the start button 102 to start cooking the food 160 by the cooking device 100.

[0014] The terminal device 50 is a terminal device with a communication function, such as a smartphone, a tablet terminal, or a mobile phone. The display device 81 is configured by arranging a touch sensor on the surface of a flat panel display, such as a liquid crystal display or an organic electroluminescence display. The cooking support app displays a screen on the display device 81 of the terminal device 50 to prompt the user to perform the following operations. Photo-taking operation: taking a photo of grill plate 150 on which food 160 is placed, using camera 82 (corresponding to the photo-taking device of this disclosure) provided on terminal device 50. Input operation of ingredient information: input of ingredient information such as the type and condition of the ingredient 160 via the display device 81 of the terminal device 50. The photographing operation and the input operation of ingredient information will be described in detail later.

[0015] The captured image SP of grill pan 150 captured by the above-mentioned capturing operation and the ingredient information FDi input by the above-mentioned ingredient information input operation are transmitted from terminal device 50 to cooking condition setting system 1. Cooking condition setting system 1 applies the area of ​​ingredient 160 relative to grill pan 150 recognized from the captured image SP and the ingredient information FDi to cooking condition map 32 prepared for each model of cooking appliance, and sets the cooking conditions for cooking appliance 100.

[0016] Here, the area of ​​ingredients 160 relative to grill pan 150 refers to the area of ​​ingredients 160 calculated by multiplying the known area of ​​grill pan 150 by the ratio of the image area of ​​ingredients 160 to the image area of ​​grill pan 150 recognized from captured image SP. Cooking condition map 32 is a map that associates combinations of the area of ​​ingredients relative to the grill pan and ingredient information with appropriate cooking conditions through experiments, computer simulations, etc. The process of setting cooking conditions will be described in detail later.

[0017] Cooking condition setting system 1 transmits cooking condition data CCi indicating the set cooking conditions to terminal device 50, and causes display device 81 to display the cooking conditions. User U checks the cooking conditions displayed on display device 81, and if there are no problems, performs an operation to instruct transmission of the cooking conditions. In response to the transmission instruction operation, cooking condition setting system 1 transmits cooking condition data CCi to cooker 100, whereby cooking conditions for food 160 placed on grill pan 150 are set in cooker 100.

[0018] [2. Configuration of cooking device] The configuration of the cooking device 100 will be described with reference to Fig. 2. The cooking device 100 is a steam oven range, and an internal heating chamber 110 is configured in a substantially rectangular parallelepiped shape by a right wall surface 111, a left wall surface 112, a rear wall surface 113, an upper wall surface 114, a bottom wall surface 115, and an opening / closing door 116 (see Fig. 1), all of which are made of a metal material. A constricted portion 117 having a substantially rectangular cross section is provided on the bottom wall surface 115, and a high-frequency excitation portion 118 that supplies power to the inside of the heating chamber 110 is provided in the substantially central portion of the constricted portion 117.

[0019] Magnetron 119, which is a high frequency generating means, is driven by inverter drive power supply 135 to generate a high frequency wave to be fed to heating chamber 110, and waveguide 120 guides the high frequency wave generated by magnetron 119 to excitation unit 118. Antenna 121 is provided in excitation unit 118, which extends into waveguide 120 and couples with the high frequency wave transmitted through waveguide 120, and one end of antenna 121 is connected to radio wave emitting means 122 as a waveguide-type emitting antenna having directionality. An output shaft of motor 123, which is a driving means for rotating radio wave emitting means 122, is inserted into the other end of antenna 121.

[0020] The radio wave emitting means 122 is driven by a motor 123 to rotate such that the sector-shaped upper surface is in a plane approximately parallel to the bottom surface of the diaphragm portion 117. The opening of the diaphragm portion 117 is provided with a sealing means 124 made of a radio wave transmitting material such as glass or ceramics.

[0021] Grill pan 150 includes pan body 150a with an uneven surface on which food is placed, and heating elements 150b, 150c, which are electromagnetic wave absorbers mainly made of ferrite and are provided on the bottom and side surfaces of pan body 150a. Grill pan 150 is accommodated in heating chamber 110 by engaging with upper rail portion 128a, middle rail portion 128b, or lower rail portion 128c provided on right wall surface 111 and left wall surface 112 of heating chamber 110.

[0022] A heater 129 is provided above the heating chamber 110, and a convection heater unit 130 is provided behind the heater 129. The convection heater unit 130 is composed of a fan that agitates the air inside the heating chamber 110, a motor that rotates the fan, and a sheathed heater arranged around the fan. The heating chamber 110 is provided with a thermistor 131 that detects the temperature inside the heating chamber 110.

[0023] Water supply unit 132 is provided with water supply tank 132a and pump 132b that sends water in water supply tank 132a to water supply nozzle 132c and discharges it into heating chamber 110. An infrared sensor 133 is provided above back wall surface 113 of heating chamber 110, and the entire area of ​​grill plate 150 is used as a temperature detection area.

[0024] The operation of the cooking device 100 is controlled by a control unit 136. The control unit 136 is composed of a processor, a memory, a communication unit, etc., which are not shown. The control unit 136 performs cooking by controlling the operation of the magnetron 119, the heater 129, the convection heater unit 130, and the water supply unit 132 according to the cooking conditions specified by the user U by operating the display device 101 (see FIG. 1) or the cooking conditions set by the cooking condition setting system 1, and according to the temperatures detected by the thermistor 131 and the infrared sensor 133. The magnetron 119, the heater 129, the convection heater unit 130, and the water supply unit 132 correspond to the multiple heating sections of the present disclosure.

[0025] [3. Configuration of cooking condition setting system] The configuration of the cooking condition setting system 1 will be described with reference to Fig. 3. The cooking condition setting system 1 is a computer system including a communication unit 2, a processor 10, a memory 30, etc. The cooking condition setting system 1 communicates with a terminal device 50 and a cooking appliance 100 (see Fig. 1) via a communication network 500 using the communication unit 2.

[0026] The terminal device 50 includes a processor 60, a memory 70, a communication unit 80, and the above-mentioned display device 81 and camera 82. A cooking support application 71 program is stored in the memory 70, and the processor 60 executes the cooking support application 71 to support the above-mentioned operation of the user U to photograph the grill plate 150 and input food ingredient information.

[0027] Cooking condition setting system 1 has memory 30 storing cooking condition setting program 31 and cooking condition map 32. Processor 10 (corresponding to the computer in this disclosure) reads and executes cooking condition setting program 31 to function as photography support unit 11, photographed image acquisition unit 12, ingredient area recognition unit 13, ingredient area confirmation screen display unit 14, ingredient area correction unit 15, ingredient area calculation unit 16, ingredient information acquisition unit 17, cooking condition setting unit 18, and cooking condition display unit 19.

[0028] The process executed by the captured image acquisition unit 12 corresponds to the captured image acquisition step in the cooking condition setting method of the present disclosure, and the process executed by the ingredient region recognition unit 13 corresponds to the ingredient region recognition step in the cooking condition setting method of the present disclosure. The process executed by the ingredient area calculation unit 16 corresponds to the ingredient area calculation step in the cooking condition setting method of the present disclosure, and the process executed by the ingredient information acquisition unit 17 corresponds to the ingredient information acquisition step in the cooking condition setting method of the present disclosure. The process executed by the cooking condition setting unit 18 corresponds to the cooking condition setting step in the cooking condition setting method of the present disclosure, and the process executed by the cooking condition display unit 19 corresponds to the cooking condition display step in the cooking condition setting method of the present disclosure.

[0029] The photography support unit 11 transmits to the terminal device 50 data of a photography support screen for supporting the photographing of the grill plate 150 on which ingredients 160 are placed. In the terminal device 50 that has received the data of the photography support screen, the cooking support application 71 displays the photography support screen 200 shown in FIG. 4 on the display device 81. The photography support screen 200 displays a guide frame 201, a message 204 encouraging the user to align the entire image portion 202 of the grill plate 150 with the guide frame 201 and take a photograph, and a shutter button 203. The guide frame 201 includes guide marks 205a to 205d that correspond to the four marks 151 on the grill plate 150 shown in FIG. 1.

[0030] The user U adjusts the position of the terminal device 50 relative to the grill plate 150 so that the image portion 202 of the grill plate 150 fits into the guide frame 201, and operates the shutter button 203. The cooking support application 71 captures an image using the camera 82 in response to the operation of the shutter button 203, and transmits the captured image to the cooking condition setting system 1.

[0031] Captured image acquisition unit 12 receives and acquires a captured image of grill pan 150 transmitted from terminal device 50. Captured image acquisition unit 12 determines whether the amount of deviation between image portion 202 of grill pan 150 in the captured image and guide frame 201 is within a predetermined range, as shown in Fig. 5. For ease of explanation, image portion 202 of grill pan 150 is indicated by a dashed line in Fig. 5.

[0032] The captured image acquisition unit 12 sets rectangular areas 206a, 206b, 206c, and 206d with the guide marks 205a to 205d at their centers for each of the four guide marks 205a to 205d. If the image portions 152a to 152d of the four marks 151 (see FIG. 1) detected from the image portion 202 of the grill pan 150 are located within the rectangular areas 206a to 206d, respectively, it is determined that the captured image has been properly captured. Here, the state in which the image portions 152a to 152d of the four marks 151 are located within the rectangular areas 206a to 206d, respectively, corresponds to the case in which the deviation amount of the heating pan with respect to the guide frame of the present disclosure is within a predetermined range.

[0033] Note that, in the photography support screen 200 shown in Fig. 4, the frames of rectangular areas 206a-206d may be displayed with the four guide marks 205a-205d shown in Fig. 5 at their centers. By displaying the frames of rectangular areas 206a-206d, the user U can be supported in photographing by confirming that the image portions 152a-152d of the four marks 151 of the grill pan 150 are within the corresponding rectangular areas 206a-206d.

[0034] If at least one of image portions 152a-152d of four marks 151 is located outside the range of the corresponding rectangular areas 206a-206d, captured image acquisition unit 12 determines that the captured image was not properly captured, and executes a process to prompt user U to retake the image. As shown in E1-E4 of FIG. 6, food ingredient area recognition unit 13 extracts food ingredient area A from the captured image. That is, food ingredient area recognition unit 13 detects the image portion of grill pan 150 from the image captured by camera 82 shown in E1 as shown in E2, and performs keystone correction as shown in E3. Then, food ingredient area recognition unit 13 performs image processing such as binarization of each pixel on the keystone corrected image portion of grill pan 150 as shown in E4, thereby recognizing the area (food ingredient area) of the image portion of food ingredient 160 (see FIG. 1).

[0035] The ingredient region confirmation screen display unit 14 transmits data of the ingredient region confirmation screen, which shows the ingredient region recognized by the ingredient region recognition unit 13, to the terminal device 50. In the terminal device 50 that has received the data of the ingredient region confirmation screen, the cooking support app 71 causes the display device 81 to display the ingredient information screen 210 shown in FIG.

[0036] The ingredient information screen 210 displays an ingredient area confirmation screen 211 showing the ingredient area recognized by ingredient area recognition unit 13, an ingredient information input screen 213, a cooking condition display 214 according to the ingredient area, a confirm button 215, and a retake button 216. In response to the operation of the retake button 216, the cooking support application 71 switches the display on the display device 81 to the photography support screen 200 shown in Fig. 4, making it possible to take a retake of the grill pan 150. The cooking condition display 214 is determined according to the range of the ingredient area.

[0037] Ingredient area confirmation screen 211 is obtained by superimposing an image portion showing the ingredient area by filled-in squares 223 on image portion 221 of grill pan 150, with multiple squares arranged in a matrix. User U checks ingredient area confirmation screen 211, and operates ingredient area correction button 212 if he / she wishes to correct the ingredient area. Detection icons 153a-153d of mark 151 (see FIG. 1) may be displayed on image portion 221 of grill pan 150 to enable user U to confirm that a grill pan 150 compatible with cooking appliance 100 is being used.

[0038] In response to an operation of the ingredient region correction button 212, the cooking support application 71 transmits ingredient region correction request data to the cooking condition setting system 1. In response to receiving the ingredient region correction request data, the ingredient region correction unit 15 transmits ingredient region correction screen data to the terminal device 50. In the terminal device 50 that has received the ingredient region correction screen data, the cooking support application 71 displays the ingredient region correction screen 220 shown in FIG. 8 .

[0039] Ingredient area correction screen 220 displays an enlarged image portion 221 of grill pan 150, a matrix of squares 222, and the ingredient area shown in FIG. 7. Also displayed are a message 225 saying "Tap a square to correct the range of ingredients" and a message 226 saying "Select a square where more than half of the square is filled with ingredients." User U can check image portion 221 and tap a square that is part of the image of ingredient 160 but is not recognized as an ingredient area to instruct it to be included in the ingredient area. For example, user U can tap square 224 to instruct it to be included in the ingredient area.

[0040] In addition, a user can tap a square that is not part of the image of the ingredient 160 but is recognized as an ingredient region to indicate that the square is not to be included in the ingredient region. For example, the user U taps on the square 223 to indicate that the square 223 is not to be included in the ingredient region. Note that, as a method for selecting a square to be corrected, a slide operation, a swipe operation, or the like may be adopted in addition to a tap operation.

[0041] In response to a tap operation on a square by user U, the cooking support app transmits ingredient area correction data to cooking condition setting system 1, which instructs the ingredient area to include the image part of the tapped square in the ingredient area or to exclude the image part of the tapped square from the ingredient area. In response to receiving the ingredient area correction data, ingredient area corrector 15 corrects ingredient area A to A', as shown at E5 in Fig. 6 .

[0042] The ingredient information acquisition unit 17 transmits data of an ingredient information input screen for inputting ingredient information about the ingredient 160 to the terminal device 50. In response to receiving the data of the ingredient information input screen, the cooking support application 71 displays an ingredient information input screen 213 as shown in FIG. 7 on the terminal device 50. In this embodiment, the following items are set as items to be input (checked) by the user U: "Frozen meat (larger than a bite-sized item)", "Frozen fish (larger than a bite-sized item)", "Hamburg steak / meat or fish on the bone (refrigerated)", "Hamburg steak / meat or fish on the bone (frozen)", and "Marinated / Gratin". Note that the input items shown in FIG. 7 are merely examples, and other ingredient categories may be used as input items.

[0043] The cooking support app 71 sends ingredient information input data indicating the items entered on the ingredient information input screen 213 to the cooking condition setting system 1. The ingredient information acquisition unit 17 receives the ingredient information input data and acquires the input items indicated by the ingredient information input data as ingredient information of the ingredient 160. In response to the operation of the decision button 215, the cooking support app sends ingredient information decision instruction data to the cooking condition setting system 1.

[0044] In response to receiving the ingredient information determination instruction data transmitted from terminal device 50, ingredient area calculation unit 16 calculates the proportion of ingredient area A or A' (if modified by user U) that occupies the image portion of grill pan 150 (ingredient occupancy rate), as shown in E6 of Fig. 6. Then, ingredient area calculation unit 16 multiplies the ingredient occupancy rate by the known area of ​​grill pan 150 to calculate the ingredient area relative to the grill pan. Cooking condition setting unit 18 applies the ingredient area calculated by ingredient area calculation unit 16 and the ingredient information acquired by ingredient information acquisition unit 17 to cooking condition map 32 to acquire corresponding cooking conditions, and sets the acquired cooking conditions as the cooking conditions of cooker 100 for ingredient 160.

[0045] As shown in Fig. 9, cooking condition map 32 associates appropriate cooking conditions with combinations of the area of ​​ingredients on grill plate 150 calculated by ingredient area calculation unit 16 and whether the five input items mentioned above (referred to as items 1 to 5 in Fig. 9) are checked or not. In the example of Fig. 9, the cooking conditions set include grill / steam operation mode, finish (high, medium, low), shelf position (upper, middle, lower), and cooking time. The grill / steam operation mode and finish settings correspond to the operation patterns of the multiple heating units of this disclosure.

[0046] In the cooking map 32, cooking condition data is associated with whether or not items 1 to 5 are checked according to the following rules 1 to 3. Rule 1... Regarding refrigeration and freezing, when freezing (item 1, item 2, item 4) is checked, turn on steam. Rule 2: When marinated / gratin foods that are prone to burning (item 5) are checked, place them on a lower shelf than when they are not checked. Rule 3: For meat and fish, the heating time for meat (item 1) should be longer than the heating time for fish (item 2) if checked.

[0047] In FIG. 9, the area of ​​the food relative to the grill plate 150 is shown as the area of ​​the food (cm 2) itself is used, but the ratio of the food area to the image portion of the grill plate (food occupancy rate) or the like may also be used as the area of ​​the food relative to grill plate 150. Alternatively, the area of ​​the food relative to grill plate 150 may be calculated using the ratio of the food area to another known index value of grill plate 150 that serves as a reference, such as the perimeter of grill plate 150 or the length of the long side or short side of grill plate 150.

[0048] The grill mode is a mode in which food placed on the grill pan 150 is heated by microwaves, a heater, or microwaves and a heater. The grill mode is subdivided into a manual double-sided grill mode, a manual upper grill mode, a manual lower grill mode, and a manual double-sided grill + steam mode. The manual double-sided grill mode is a mode in which both the upper surface (the surface facing the upper surface of the heating chamber 110) and the lower surface (the surface facing the grill pan 150 placement surface of the heating chamber 110) of the food placed on the grill pan 150 are heated. The manual upper grill mode is a mode in which the upper surface of the food placed on the grill pan 150 is heated. The manual lower grill mode is a mode in which the lower surface of the food placed on the grill pan 150 is heated. The manual double-sided grill + steam mode is a mode in which the food to be heated is heated using steam in addition to the manual double-sided grill mode.

[0049] The finish can be adjusted to strong, medium (standard), or weak based on the following two elements (A) and (B). (A) Steam time: Low / Medium is 180 seconds, High is 360 seconds. *The total time is the same for High, Medium, and Low. (B) By adding a duty, the total heat power is changed. The heating order is MW (microwave) → steam → heater. With steam: 15 minutes total. (Strong) Steam for 6 minutes. Of the remaining 9 minutes, MW is ON continuously. Heater is ON for 27 seconds and OFF for 3 seconds. (Middle) Steam for 3 minutes. Of the remaining 12 minutes, MW is on continuously. Heater is on for 24 seconds and off for 6 seconds. (Weak) Steam for 3 minutes. Of the remaining 12 minutes, MW is on for 27 seconds, off for 3 seconds, heater is on for 22 seconds, and off for 8 seconds. Without steam: (Strong) MW continuously ON Heater continuously ON. (Middle) MW continuous ON, heater ON for 27 seconds, OFF for 3 seconds. (Weak) MW continuous ON Heater ON 22 seconds OFF 8 seconds. *You can adjust the strength of all three heating elements (steam, MW, heater), or you can adjust the strength of just one heating element.

[0050] Regarding the shelf position, the cooking sequence may be different for each shelf position (upper, middle, lower), or the cooking sequence may remain the same even if the shelf position changes. Regarding the time (seconds), when the time (seconds) is x, the microwave heating time (MW time) is 0.6x-100 seconds. Here, the settings of 0.6 and 100 are just examples, and the intercept (here, 100 is an example) and the slope (here, 0.6 is an example) are set according to each cooking sequence.

[0051] The cooking condition display unit 19 transmits data of a cooking condition confirmation screen, which indicates the cooking conditions set by the cooking condition setting unit 18, to the terminal device 50. In the terminal device that has received the data of the cooking condition confirmation screen, the cooking support application 71 causes the display device 81 to display the cooking condition confirmation screen 230 shown in FIG.

[0052] Cooking condition confirmation screen 230 displays grill tray storage position image 231 indicating the storage position (upper, middle, or lower) of grill tray 150, text 232 indicating the storage position of grill tray 150, ingredient information input 233 by user U, ingredient area display image 234 of grill tray 150, cooking condition information 235 set by cooking condition setting unit 18, and send button 236. Note that ingredient information input information 233 and ingredient area display image 234 may be omitted to simplify the screen display.

[0053] 10, the cooking condition information 235 displayed is "grill" manual course, double-sided + steam heating mode, grill tray 150 placed in the middle level, standard finish, and time: 20 minutes 00 seconds. The user U checks the displayed contents of the cooking condition confirmation screen 230, and if there are no problems, operates the send button 236. In response to the operation of the send button 236, the cooking support application 71 transmits cooking condition transmission instruction data to the cooking condition setting system 1.

[0054] Cooking condition setting unit 18 transmits cooking condition data indicating the cooking conditions to cooking device 100 in response to receiving cooking condition transmission instruction data transmitted from terminal device 50. Control unit 136 (see FIG. 2) of cooking device 100 receives the cooking condition data, recognizes the cooking conditions, displays the cooking conditions on display device 101 (see FIG. 1), and notifies the user by a buzzer sound or the like that setting of the cooking conditions has been completed. User U checks the display on display device 101, places grill tray 150 with ingredients 160 placed on it in the position instructed by the cooking conditions, and operates start button 102 (see FIG. 1). In response to the operation of start button 102, control unit 136 starts cooking according to the cooking conditions.

[0055] [4. A series of processes using the cooking condition setting system] A series of processes for setting cooking conditions for the cooker 100 by the cooking condition setting system 1 described above will be described with reference to the flowcharts shown in Figs.

[0056] 11, when the cooking condition setting system 1 is accessed from the terminal device 50 via the cooking support application 71, the process proceeds to step S2 to establish communication with the terminal device 50. In the following step S3, the photography support unit 11 transmits photography support screen data to the terminal device 50. As a result, in the terminal device 50, the photography support screen 200 shown in FIG. 4 is displayed on the display device 81 to support the user U in photographing the grill plate 150.

[0057] In the next step S4, captured image acquisition unit 12 proceeds to step S5 when it receives a captured image transmitted from terminal device 50. In step S5, captured image acquisition unit 12 determines whether the shooting range of the acquired captured image is appropriate and includes the entire grill pan 150. If the shooting range of the captured image is appropriate, captured image acquisition unit 12 proceeds to step S7, and if the shooting range of the captured image is not appropriate, captured image acquisition unit 12 proceeds to step S20.

[0058] In step S20, photographed image acquisition unit 12 transmits photographing support screen data prompting terminal device 50 to take a new photograph, and the process proceeds to step S4. As a result, a message such as "Please take a new photograph so that the grill plate fits within the guide frame" is additionally displayed on photographing support screen 200 shown in Fig. 4, thereby supporting user U in taking a new photograph of grill plate 150. By prompting user U to take a new photograph of an inappropriate photographed image in this way, it is possible to prevent food area recognition unit 13 from performing food area recognition processing on a photographed image that does not include the entire grill plate 150, and prevent food area calculation unit 16 from calculating an erroneous food area.

[0059] In step S7, the ingredient region recognition unit 13 recognizes the ingredient region as described above with reference to E1 to E4 in Fig. 6. In the following step S8, the ingredient region confirmation screen display unit 14 transmits data of the ingredient region confirmation screen to the terminal device 50. As a result, in the terminal device 50, the ingredient information screen 210 shown in Fig. 7 is displayed on the display device 81, and the user U can check the ingredient region confirmation screen 211 of the ingredient information screen 210 and correct the ingredient region.

[0060] In the next step S9, the ingredient information acquisition unit 17 transmits the data of the ingredient information input screen to the terminal device 50. As a result, the ingredient information input screen 213 shown in Fig. 7 is displayed on the display device 81 of the terminal device 50, and the user U can input (check) information on the ingredient 160. In the loop process of steps S10, S30, and S40 in the next Fig. 12, when the ingredient area calculation unit 16 receives cooking condition determination instruction data transmitted from the terminal device 50 in step S10, the process proceeds to step S11.

[0061] In step S30, when the ingredient region correction unit 15 receives correction data for the ingredient region transmitted from the terminal device 50 as described above with reference to Fig. 8, the process proceeds to step S31, where the ingredient region correction unit 15 corrects the ingredient region according to the correction data. Then, the process proceeds to step S10. In step S40, when the ingredient information acquisition unit 17 receives ingredient information data transmitted from the terminal device 50 as described above with reference to Fig. 7, the process proceeds to step S41, where the ingredient information acquisition unit 17 acquires ingredient information indicated by the ingredient information data. Then, the process proceeds to step S10.

[0062] In step S11, food ingredient area calculation unit 16 calculates the area of ​​the food ingredient relative to heating plate 150 by multiplying the ratio of the food ingredient area to the image area of ​​grill plate 150 based on the food ingredient area recognized by food ingredient area recognition unit 13 (or the corrected food ingredient area if corrected by food ingredient area correction unit 15) by the known area of ​​grill plate 150. In the following step S12, cooking condition setting unit 18 applies the food ingredient area and food ingredient information to cooking condition map 32 prepared for each model of cooking appliance 100 to set the cooking conditions.

[0063] In the following step S13, the cooking condition display unit 19 transmits the cooking condition data to the terminal device 50. As a result, in the terminal device 50, the cooking condition confirmation screen 230 shown in FIG. 10 is displayed on the display device 101. The user U checks the cooking condition confirmation screen 230 and operates the send button 236. In response to this operation, cooking condition transmission instruction data is transmitted from the terminal device 50 to the cooking condition setting system 1.

[0064] In the next step S14, the cooking condition setting unit 18 advances the process to step S15 when it receives cooking condition transmission instruction data transmitted from the terminal device 50. In step S15, the cooking condition setting unit 18 transmits the cooking condition data to the cooking device 100. As a result, the cooking conditions of the cooking device 100 are set.

[0065] [5. Effects, etc.] As described above, in the present embodiment, cooking condition setting system 1 sets cooking conditions for cooking device 100 based on the area of ​​ingredients on grill pan 150. In this way, by using the area of ​​ingredients on grill pan 150, which is less susceptible to the detection conditions by the detection means and external disturbances, it is possible to prevent inappropriate cooking conditions from being set for cooking device 100. Also, it is possible to easily set optimal cooking conditions for ingredients placed on the heating pan.

[0066] Furthermore, the cooking condition setting system 1 sets cooking conditions for the cooking device 100 using an image of the grill pan 150 on which the ingredients 160 are placed and ingredient information input by the user U. In this way, by using the ingredient information input by the user U, it is possible to reduce the degree of influence of the detection conditions by the detection means and disturbances, etc., compared to a case where cooking conditions are set using only detection information by a detection unit such as a sensor, and to prevent inappropriate cooking conditions from being set for the cooking device 100.

[0067] (Other embodiments) As described above, the above embodiment has been described as an example of the technology disclosed in the present application. However, the technology in the present disclosure is not limited to this, and can be applied to embodiments in which modifications, substitutions, additions, omissions, etc. are made.

[0068] In the above embodiment, as shown in Fig. 1, the cooking appliance 100 has a function of communicating with the cooking condition setting system 1, and cooking condition data is transmitted from the cooking condition setting system 1 to the cooking appliance 100. In another embodiment, when the cooking appliance 100 does not have a communication function, the user U may set cooking conditions by operating the display device 101 of the cooking appliance 100 according to the cooking condition confirmation screen 230 (see Fig. 10) displayed on the display device 81 of the terminal device 50.

[0069] In the above embodiment, as shown in Fig. 3, the cooking condition setting system 1 is configured as a function of a server. In another embodiment, the cooking condition setting system 1 may be configured as a function of a cooking support app 71 installed in the terminal device 50. In this case, the processor 60 of the terminal device 50 executes the cooking support app 71 (corresponding to the cooking condition setting program of the present disclosure) to function as a photographing support unit 11, a photographed image acquisition unit 12, an ingredient region recognition unit 13, an ingredient region confirmation screen display unit 14, an ingredient region correction unit 15, an ingredient area calculation unit 16, an ingredient information acquisition unit 17, a cooking condition setting unit 18, and a cooking condition display unit 19. The cooking condition map 32 may be stored in the terminal device 50, or the terminal device 50 may access and refer to the cooking condition map 32 stored in a server or the like.

[0070] In this configuration, the processes of photographing grill pan 150, re-photographing, and correcting the food area in the photographed image are executed on terminal device 50 side without communicating with the server, and cooking conditions are set. Therefore, the time required to set cooking conditions can be reduced compared to when these processes are executed on the server side.

[0071] Alternatively, some of the functions of the cooking condition setting system 1 may be configured as functions of a cooking support app 71 installed in the terminal device 50. For example, the setting and photographing support unit 11, the photographed image acquisition unit 12, the food area recognition unit 13, the food area confirmation screen display unit 14, the food area correction unit 15, and the food information acquisition unit 17 may be configured as functions of the cooking support app. In this case, the processing of photographing the grill plate 150, re-photographing, and correcting the food area in the photographed image is performed on the terminal device 50 side without communicating with the server, so that the time required to set the cooking conditions can be shortened compared to the case where these processing are performed on the server side. In addition, the terminal device 50 side may generate a trimmed image of the entire grill plate 150 based on the guide frame 201 shown in FIG. 5 and a trimmed image of the image portions 152a to 152d of the four marks 151, and transmit them to the server. This reduces the amount of image information data sent from terminal device 50 to the server, and enables the server side to efficiently calculate the area of ​​the ingredients on grill plate 150 and identify grill plate 150.

[0072] Alternatively, the server may include setting and photography support unit 11, photographed image acquisition unit 12, and ingredient area recognition unit 13, while terminal device 50 may include ingredient area confirmation screen display unit 14, ingredient area correction unit 15, ingredient area calculation unit 16, ingredient information acquisition unit 17, and cooking condition setting unit 18. In this case, the server performs the process of recognizing the ingredient area from the photographed image of grill pan 150, transmits information about the ingredient area from server 1 to terminal device 50, and terminal device 50 corrects the ingredient area and calculates the area of ​​the ingredient area after the correction, thereby setting the cooking conditions.

[0073] Cooking condition setting system 1 may be configured as a function of control unit 136 of cooking device 100. In this case, the processor of control unit 136 executes a cooking condition setting program stored in the memory of control unit 136, thereby functioning as photographing support unit 11, photographed image acquisition unit 12, food area recognition unit 13, food area confirmation screen display unit 14, food area correction unit 15, food area calculation unit 16, food information acquisition unit 17, cooking condition setting unit 18, and cooking condition display unit 19. Then, the screens shown in Figs. 7, 8, and 10 are displayed on display device 101 of cooking device 100, or screen data is transmitted from cooking device 100 to terminal device 50, and the screens shown in Figs. 7, 8, and 10 are displayed on display device 81 of terminal device 50.

[0074] In this configuration, the processes of photographing the grill plate 150, re-photographing it, and correcting the food area in the photographed image are performed on the cooking appliance 100 side without communicating with the server, so that the time required to set the cooking conditions can be reduced compared to when these processes are performed on the server side.

[0075] Alternatively, some of the functions of cooking condition setting system 1 may be configured as functions of control unit 136 of cooking appliance 100. For example, setting and photographing support unit 11, photographed image acquisition unit 12, food ingredient area recognition unit 13, food ingredient area confirmation screen display unit 14, food ingredient area correction unit 15, and food ingredient information acquisition unit 17 may be configured as functions of control unit 136 of cooking appliance 100. In this case as well, the processes of photographing grill tray 150, re-photographing, and correcting the food ingredient area in the photographed image are executed on terminal device 50 without communicating with the server, so that the time required to set cooking conditions can be shortened compared to when these processes are executed on the server side.

[0076] In the above embodiment, the grill pan 150 is photographed by the camera 82 provided in the terminal device 50, but the grill pan 150 housed in the heat cooker 100 may be photographed by a camera provided inside the heat cooker 100. The camera provided inside the heat cooker 100 corresponds to the imaging device of the present disclosure. In this case, the camera can be positioned so that the entire grill pan 150 housed in the heat cooker 100 falls within the imaging range, making the imaging support unit 11 unnecessary.

[0077] In the above embodiment, the cooking condition setting unit 18 sets the cooking conditions of the cooking device 100 using the area of ​​the ingredients on the grill plate 150 calculated based on the image of the grill plate 150 and the ingredient information input by the user U. As another embodiment, the input of ingredient information by the user U may be omitted and the cooking conditions of the cooking device 100 may be set using only the area of ​​the ingredients on the grill plate 150. Alternatively, the cooking conditions of the cooking device 100 may be set using information other than the area of ​​the ingredients on the grill plate 150 based on the image of the grill plate 150 and the ingredient information input by the user U. Alternatively, the cooking conditions of the cooking device 100 may be set using information other than the area of ​​the ingredients on the grill plate 150 without using the ingredient information input by the user U.

[0078] In the above embodiment, as shown in FIG. 9, the heating output (grill steam, finish), grill pan storage position, and heating time are set as cooking conditions. In addition to these, heating conditions based on the temperature of the oven, steam, etc. (internal temperature) may also be set.

[0079] The controller that controls the operation of the cooking condition setting system in the present disclosure may be any controller that can control the cooking condition setting system in the present disclosure. When expressing the subject matter of the invention, the controller may be expressed as a control means, a control unit, or a similar term in addition to the controller as the one that controls the cooking condition setting system in the present disclosure. The controller can be realized in various forms. For example, a processor may be used as the controller. If a processor is used as the controller, various processes can be executed by loading a program from a storage medium storing the program into the processor and executing the program by the processor. Therefore, the process contents can be changed by changing the program stored in the storage medium, so that the degree of freedom in changing the control contents can be increased. Examples of the processor include a CPU (Central Processing Unit) and an MPU (Micro-Processing Unit). Examples of the storage medium include a hard disk, a flash memory, and an optical disk. In addition, a wired logic that cannot be rewritten in a program may be used as the controller. Using a wired logic as the controller is effective in improving the processing speed. Examples of the wired logic include an ASIC (Application Specific Integrated Circuit). In addition, the controller may be realized by combining a processor and a wired logic. If the controller is realized by combining a processor and wired logic, it is possible to increase the degree of freedom of software design and improve the processing speed. In addition, the controller and a circuit having a function different from that of the controller may be configured with a single semiconductor element. An example of a circuit having a different function is an A / D-D / A conversion circuit. In addition, the controller may be configured with a single semiconductor element or multiple semiconductor elements. When configured with multiple semiconductor elements, each control described in the claims may be realized with different semiconductor elements. Furthermore, the controller may be configured with a configuration including a semiconductor element and a passive component such as a resistor or a capacitor.

[0080] The communicator (communication unit) in the present disclosure may be any one that enables communication between the system of the present disclosure and an external device. When expressing the subject matter of the invention, in addition to the communicator, a communication means, a communication unit, a transmission / reception means, a transmission / reception unit, or a similar term may be used to enable communication between the system of the present disclosure and an external device. The communicator can be realized in various forms. For example, the communicator may be connected to the external device by wire, or may be connected to the external device by wireless communication. A communicator that connects the device of the present disclosure to the external device by wire is effective in terms of communication security and communication stability. Examples of a communicator with a wired connection include a wired LAN based on the Ethernet (registered trademark) standard, or a wired connection using an optical fiber cable. Examples of a communicator with a wireless connection include a wireless connection to an external device via a base station or a direct wireless connection to an external device. Examples of wireless connections with external devices via base stations include IEEE802.11-compatible wireless LANs that wirelessly communicate with WiFi (registered trademark) routers, third-generation mobile communication systems (commonly known as 3G), fourth-generation mobile communication systems (commonly known as 4G), IEEE 802.16-compatible WiMax (registered trademark), and LPWA (Low Power Wide Area). Using a communicator that directly wirelessly connects the device of the present disclosure to an external device is effective in improving the security of communication, and the device of the present disclosure can communicate with an external device even in a place where there is no relay device such as a WiFi (registered trademark) router. Examples of communicators that directly wirelessly connect the device of the present disclosure to an external device include communication by Bluetooth (registered trademark), communication by NFC (Near Field Communication) via a loop antenna, and infrared communication.

[0081] It should be noted that the above-described embodiments are intended to illustrate the technology of the present disclosure, and various modifications, substitutions, additions, omissions, and the like can be made within the scope of the claims or their equivalents.

[0082] (Additional Note) The above description of the embodiments discloses the following techniques.

[0083] (Technology 1) A cooking condition setting system that sets cooking conditions for ingredients placed on a heating plate and cooked in a heating cooker, the cooking condition setting system comprising: an image acquisition unit that acquires an image of the heating plate on which ingredients are placed, captured by a camera; an ingredient area recognition unit that recognizes an ingredient area on the heating plate, which is the area occupied by the ingredients placed on the heating plate, based on the captured image; an ingredient area calculation unit that calculates the area of ​​the ingredients relative to the heating plate based on the ingredient area; a cooking condition setting unit that sets the cooking conditions based on the area of ​​the ingredients relative to the heating plate; and a cooking condition display unit that displays the cooking conditions on a display device. According to this configuration, optimal cooking conditions can be easily set for the ingredients placed on the heating tray.

[0084] (Technology 2) A cooking condition setting system as described in Technology 1, comprising: an ingredient area confirmation screen display unit that causes the display device to display an ingredient area confirmation screen that displays, for the captured image, image portions that have been recognized as ingredient areas by the ingredient area recognition unit in a manner that makes them distinguishable from image portions other than the ingredient areas; and an ingredient area correction unit that corrects the ingredient area in response to a correction instruction operation by a user of the heating cooker on an operating device, wherein the ingredient area calculation unit calculates the area of ​​ingredients relative to the heating plate based on the ingredient area corrected by the ingredient area correction unit. According to this configuration, by allowing the user to modify the ingredient area for ingredients that are difficult to recognize by the ingredient area recognition unit, the accuracy of ingredient area recognition can be improved and more appropriate cooking conditions can be set.

[0085] (Technology 3) The cooking condition setting system described in Technology 2, wherein the food area confirmation screen display unit displays an image on the food area confirmation screen in which an area indicating image portion showing the range of the food area is superimposed on the captured image. This configuration makes it easier for the user to check the ingredient area.

[0086] (Technology 4) A cooking condition setting system according to any one of Technology 1 to Technology 3, wherein the cooking conditions include at least one of a heating time, a heating output, a heating temperature, and a storage position of the heating dish within the cooking device. This configuration allows the user to check the basic cooking conditions for ingredients, such as heating time, heating output, heating temperature, and the storage position of the heating tray within the oven.

[0087] (Technology 5) A cooking condition setting system described in any one of Technologies 1 to 4, wherein the captured image acquisition unit acquires the captured image by the photographing device provided in a terminal device used by a user of the heating cooker. According to this configuration, by using a photographing device provided on the terminal device to photograph the heating plate on which ingredients are placed, it is not necessary to provide a photographing device on the cooking appliance, and the cost of the cooking appliance can be reduced.

[0088] (Technology 6) A cooking condition setting system as described in Technology 5, which is provided with a photography support unit that displays a guide frame on the photography screen captured by the photography device, displayed on a display device provided in the terminal device, to guide the user to include the entire heating dish within the photography range. According to this configuration, by displaying a guide frame on the photographing screen of the photographing device provided in the terminal device, it is possible to support the user in photographing the heating plate appropriately.

[0089] (Technology 7) A cooking condition setting system as described in Technology 6, in which the photography support unit displays on the display device, together with the guide frame, a message encouraging the user to take a photograph so that the amount of deviation of the heating dish relative to the guide frame is within a specified range. With this configuration, a message is displayed on the display device encouraging the user to take a photograph so that the amount of deviation of the heating plate from the guide frame is within a specified range, thereby supporting the user in taking an appropriate photograph of the heating plate.

[0090] (Technology 8) A cooking condition setting system as described in Technology 6 or Technology 7, in which the photography support unit, when the amount of deviation of the heating dish from the guide frame recognized from the image captured by the photography device is outside the specified range, displays on the display device a message encouraging the user to take a photograph so that the amount of deviation of the heating dish from the guide frame is within the specified range. According to this configuration, if the amount of deviation of the heating tray from the guide frame is outside a predetermined range, it is possible to urge the user to correct the photographing position of the photographing device.

[0091] (Technology 9) A cooking condition setting system described in any one of Technologies 6 to 8, wherein the photography support unit displays a marker indicating the position of the heating dish recognized from an image captured by the photography device on the photography screen. According to this configuration, the marker can be displayed to facilitate confirmation of the position of the heating plate on the shooting screen.

[0092] (Technology 10) A cooking condition setting system described in any one of Technologies 6 to 9, wherein the captured image acquisition unit acquires an image captured by the photographing device when the amount of deviation of the heating plate relative to the guide frame is within the specified range, as the captured image to be used for recognizing the food area by the food area recognition unit. According to this configuration, food area recognition can be efficiently performed by limiting the captured images to those that include the entire heating plate.

[0093] (Technology 11) A cooking condition setting system described in any one of Technology 1 to Technology 4, wherein the photographed image acquisition unit acquires the photographed image taken by the photographing device provided inside the cooking appliance that accommodates the heating dish. According to this configuration, the heating plate, which is accommodated in the cooking appliance and positioned to a certain extent, can be stably photographed by the photographing device provided inside the cooking appliance.

[0094] (Technology 12) A cooking condition setting system as described in any one of Technologies 1 to 4, wherein the photographing device and the display device are provided in a terminal device used by a user of the cooking appliance, and the photographed image acquisition unit, the food ingredient area recognition unit, the food ingredient area calculation unit, and the cooking condition setting unit are provided in a server that communicates with the terminal device, and the photographed image acquisition unit acquires the photographed image by receiving the photographed image photographed by the photographing device and transmitted by the terminal device, and the cooking condition display unit displays the cooking conditions on the display device by transmitting cooking condition data indicating the cooking conditions to the terminal device. According to this configuration, images captured by the image capturing device provided in the terminal device can be transmitted to the server, and cooking conditions for the ingredients placed on the heating tray can be collected and set by the server.

[0095] (Technology 13) A cooking condition setting method executed by a computer to set cooking conditions for ingredients placed on a heating plate and cooked in a heating cooker, the cooking condition setting method including: an image acquisition step of acquiring an image of the heating plate on which ingredients are placed, photographed by a photographing device; an ingredient area recognition step of recognizing an ingredient area on the heating plate, which is an area occupied by the ingredients placed on the heating plate, based on the photographed image; an ingredient area calculation step of calculating an ingredient area relative to the heating plate based on the ingredient area; a cooking condition setting step of setting the cooking conditions based on the ingredient area relative to the heating plate; and a cooking condition display step of displaying the cooking conditions on a display device. By executing the cooking condition setting method having this configuration by a computer, it is possible to obtain the same effects as those of the cooking condition setting system of Technique 1.

[0096] (Technology 14) A cooking condition setting program that causes a computer to function as an image acquisition unit that acquires an image of the heating plate on which ingredients are placed, captured by a photographing device, a food ingredient area recognition unit that recognizes an ingredient area on the heating plate, which is the area on the heating plate occupied by the ingredients placed on the heating plate, based on the captured image, an ingredient area calculation unit that calculates the area of ​​the ingredients relative to the heating plate based on the ingredient area, a cooking condition setting unit that sets the cooking conditions based on the area of ​​the ingredients relative to the heating plate, and a cooking condition display unit that displays the cooking conditions on a display device, in order to set cooking conditions for ingredients placed on a heating plate and cooked in a cooking appliance. By executing the cooking condition setting program having this configuration by a computer, the cooking condition setting system of Technique 1 can be realized. [Industrial Applicability]

[0097] The present disclosure is applicable to applications in which optimal cooking conditions can be easily set for ingredients placed on a heating tray. [Explanation of symbols]

[0098] 1. Cooking condition setting system 2 Communication Unit 10 Processors 11. Filming Support Department 12 Image capture unit 13 Food area recognition section 14 Food area confirmation screen display section 15 Food area correction department 16 Food area calculation section 17 Food information acquisition department 18 Cooking condition setting section 19 Cooking condition display section 30 Memory 31 Cooking condition setting program 32 Cooking Condition Map 50 Terminal Equipment 60 processors 70 Memory 71 Cooking support app 80 Communication Unit 81 Display device 82 Camera 100 Cooker 101 Display device 102 Start button 150 Grill Plate 160 Ingredients 200 Shooting support screen 210 Ingredient information screen 211 Food area confirmation screen 213 Ingredient information input screen 220 Food area correction screen 230 Cooking condition confirmation screen U User

Claims

1. A cooking condition setting system for setting cooking conditions for ingredients placed on a heating tray and cooked by a cooking device, comprising: an image acquisition unit that acquires an image of the heating plate on which ingredients are placed, the image being captured by an image capture device; an ingredient region recognition unit that recognizes an ingredient region, which is an area of ​​the heating tray occupied by the ingredient placed on the heating tray, based on the captured image; an ingredient area calculation unit that calculates an ingredient area relative to the heating plate based on the ingredient area; a cooking condition setting unit that sets the cooking conditions based on an area of ​​the foodstuff relative to the heating plate; A cooking condition display unit that displays the cooking conditions on a display device; A cooking condition setting system comprising:

2. an ingredient region confirmation screen display unit that displays, on the display device, an ingredient region confirmation screen that displays an ingredient region of the captured image by the ingredient region recognition unit in a manner that allows the ingredient region to be distinguished from other ingredients; and an ingredient region correction unit that corrects the ingredient region in response to a correction instruction operation by a user of the cooking appliance via an operation device, The food area calculation unit calculates the area of ​​the food with respect to the heating plate based on the food area corrected by the food area correction unit. The cooking condition setting system according to claim 1 .

3. The food area confirmation screen display unit displays an image in which an area indicating image portion indicating the range of the food area is superimposed on the photographed image on the food area confirmation screen. The cooking condition setting system according to claim 2.

4. The cooking conditions include at least one of a heating time, a heating output, a heating temperature, and a storage position of the heating dish in the chamber of the cooking device. The cooking condition setting system according to any one of claims 1 to 3.

5. The photographed image acquisition unit acquires the photographed image taken by the photographing device provided in a terminal device used by a user of the cooking appliance. The cooking condition setting system according to any one of claims 1 to 3.

6. A photographing support unit is provided for displaying a guide frame on a photographing screen of the photographing device displayed on a display device provided in the terminal device, the guide frame instructing the user to include the entire heating dish in a photographing range. The cooking condition setting system according to claim 5.

7. The photographing support unit displays, on the display device, together with the guide frame, a message encouraging the user to photograph the heating plate so that a deviation amount of the heating plate with respect to the guide frame falls within a predetermined range. The cooking condition setting system according to claim 6.

8. When a deviation amount of the heating plate with respect to the guide frame recognized from an image captured by the imaging device is outside the predetermined range, the imaging support unit displays on the display device a message encouraging the user to capture an image so that the deviation amount of the heating plate with respect to the guide frame falls within the predetermined range. The cooking condition setting system according to claim 7.

9. The photographing support unit displays, on the photographing screen, a marker indicating the position of the heating plate recognized from the image photographed by the photographing device. The cooking condition setting system according to claim 6.

10. The photographed image acquisition unit acquires an image photographed by the photographing device in a state in which a deviation amount of the heating plate with respect to the guide frame is within the predetermined range, as the photographed image to be used as a target for recognizing the food area by the food area recognition unit. The cooking condition setting system according to claim 6.

11. The photographed image acquisition unit acquires the photographed image taken by the photographing device provided in a chamber of a cooking appliance that houses the heating tray. The cooking condition setting system according to any one of claims 1 to 3.

12. The photographing device and the display device are provided in a terminal device used by a user of the cooking appliance, The photographed image acquisition unit, the food area recognition unit, the food area calculation unit, and the cooking condition setting unit are provided in a server that communicates with the terminal device, the captured image acquisition unit acquires the captured image by receiving the captured image captured by the imaging device and transmitted by the terminal device; The cooking condition display unit transmits cooking condition data indicating the cooking conditions to the terminal device, thereby causing the display device to display the cooking conditions. The cooking condition setting system according to any one of claims 1 to 3.

13. A cooking condition setting method executed by a computer to set cooking conditions for ingredients placed on a heating tray and cooked in a cooking device, comprising the steps of: an image capturing step of capturing an image of the heating plate on which ingredients are placed, the image being captured by an image capturing device; an ingredient region recognition step of recognizing an ingredient region, which is a region of the heating tray occupied by the ingredient placed on the heating tray, based on the captured image; an ingredient area calculation step of calculating an ingredient area relative to the heating plate based on the ingredient area; a cooking condition setting step of setting the cooking conditions based on an area of ​​the foodstuff relative to the heating plate; a cooking condition display step of displaying the cooking conditions on a display device; A cooking condition setting method including:

14. A computer is provided to set cooking conditions for food placed on the heating tray and cooked by the cooking device. an image acquisition unit that acquires an image of the heating plate on which ingredients are placed, the image being captured by an image capture device; an ingredient region recognition unit that recognizes an ingredient region, which is an area of ​​the heating tray occupied by the ingredient placed on the heating tray, based on the captured image; an ingredient area calculation unit that calculates an ingredient area relative to the heating plate based on the ingredient area; a cooking condition setting unit that sets the cooking conditions based on an area of ​​the foodstuff relative to the heating plate; A cooking condition display unit that displays the cooking conditions on a display device; A cooking condition setting program that functions as a cooking condition setting program.

Images