Recipe display system, recipe display method, and program

Abstract

A recipe display system (1) is provided with: an input IF (24) for acquiring recipe information described in a natural language; an analysis unit (111) for analyzing the recipe information acquired by the input IF (24) so as to acquire process information including first information indicating cooking processing in a cooking process and second information indicating the time required for the cooking process; and a generation unit (112) for generating instruction information to operate a time management function for managing an elapsed time in the cooking process, or instruction information to operate the cooking function of a cooking apparatus for executing the cooking process, by using the process information acquired by the analysis unit (111), and exercising control for causing the generated instruction information to be displayed on a display screen together with the recipe information.

Description

Technical Field

[0006] ,

[0004] , , , , ,

[0005] , , , , , , , ,

[0001] The present disclosure relates to a recipe display system, a recipe display method, and a program.

Background Art

[0002] There is a technology for converting qualitative expressions in recipe information into quantitative expressions (see, for example, Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] The present disclosure provides a recipe display system, a recipe display method, and a program that reduce the user's effort by enabling the generation of information for controlling or setting cooking equipment from recipe information.

Means for Solving the Problems

[0005] The recipe display system in the present disclosure includes an input interface that acquires recipe information described in natural language, and an analysis unit that acquires process information including first information indicating cooking processes in a cooking process and second information indicating the time required for the cooking process by analyzing the recipe information acquired by the input interface. A recipe display system comprising: a time management function that manages the elapsed time in the cooking process using the process information acquired by the analysis unit, or a generation unit that generates command information for operating a cooking function of a cooking device that executes the cooking process, and controls to display the generated command information on a display screen together with the recipe information.

Effects of the Invention

[0006] The recipe display system described in this disclosure can reduce the effort required of the user by enabling the generation of information for controlling or setting cooking equipment, etc., from recipe information. [Brief explanation of the drawing]

[0007] [Figure 1] This is a block diagram showing an example of the configuration of the recipe display system according to Embodiment 1. [Figure 2] This is a sequence diagram showing a first example of the processing of the recipe display system according to Embodiment 1. [Figure 3] This is a sequence diagram showing a second example of the processing of the recipe display system according to Embodiment 1. [Figure 4] This is an explanatory diagram showing an example of recipe information and control information displayed by the recipe display system according to Embodiment 1. [Figure 5] This is a flowchart showing the server processing according to Embodiment 1. [Figure 6] This is an explanatory diagram showing an example of recipe information that is processed according to Embodiment 1. [Figure 7] This is an explanatory diagram showing an example of the analysis of recipe information, which is the target of processing according to Embodiment 1. [Figure 8] This is an explanatory diagram showing an example of an alternative device word according to Embodiment 1. [Figure 9] This is an explanatory diagram showing examples of words extracted by the analysis unit according to Embodiment 1 and examples of time management control information generated by the generation unit. [Figure 10] This is an explanatory diagram showing an example of a substitute time table according to Embodiment 1. [Figure 11] This is an explanatory diagram showing an example of a registered cooking equipment list according to Embodiment 1. [Figure 12] This is an explanatory diagram showing an example of a registered cooking equipment list according to Embodiment 1. [Figure 13] This is an explanatory diagram showing an example of a registered cooking equipment list according to Embodiment 1. [Figure 14] This is an explanatory diagram showing an example of control information generated by the recipe display system according to Embodiment 1. [Figure 15] It is an explanatory diagram showing an example of recipe information and time information displayed by the recipe display system according to Embodiment 1. [Figure 16] It is an explanatory diagram showing an example of time information displayed by the recipe display system according to Embodiment 1. [Figure 17] It is an explanatory diagram showing an example of time information displayed by the recipe display system according to Embodiment 1. [Figure 18] It is an explanatory diagram showing an example of time information displayed by the recipe display system according to Embodiment 1. [Figure 19] It is an explanatory diagram showing an example of time information displayed by the recipe display system according to Embodiment 1. [Figure 20] It is an explanatory diagram showing an example of time information displayed by the recipe display system according to Embodiment 1. [Figure 21] It is an explanatory diagram showing an example of time information displayed by the recipe display system according to Embodiment 1. [Figure 22] It is an explanatory diagram showing an example of recipe information and time information displayed by the recipe display system according to Embodiment 1. [Figure 23] It is an explanatory diagram showing an example of recipe information and time information displayed by the recipe display system according to Embodiment 1. [Figure 24] It is an explanatory diagram of a time type table showing the types of time displayed by the recipe display system according to Embodiment 1. [Figure 25] It is an explanatory diagram showing an example of time information displayed by the recipe display system according to Embodiment 1. [Figure 26] It is an explanatory diagram showing an example of time information displayed by the recipe display system according to Embodiment 1. [Figure 27] It is an explanatory diagram showing a condition table indicating the conditions of time notification according to Embodiment 1. [Figure 28] It is an explanatory diagram showing a pattern of time management control information including time notification according to Embodiment 1. [Figure 29] It is an explanatory diagram showing an example of time information displayed by the recipe display system according to Embodiment 1. [Figure 30] This is an explanatory diagram showing an example of range representation conversion according to Embodiment 1. [Figure 31] This is an explanatory diagram showing an example of a table illustrating the method for adjusting the substitute time according to Embodiment 1. [Figure 32] This is an explanatory diagram showing an example of recipe information that is processed according to Embodiment 1. [Figure 33] This is an explanatory diagram showing an example of time correction for the cooking process according to Embodiment 1. [Figure 34] This is an explanatory diagram showing an example of recipe information and time information displayed by the recipe display system according to Embodiment 1. [Figure 35] This is an explanatory diagram showing an example of a substitute time table according to Embodiment 1. [Figure 36] This is an explanatory diagram showing an example of recipe information that is processed according to Embodiment 1. [Figure 37] This is an explanatory diagram showing an example of recipe information and equipment control information displayed by the recipe display system according to Embodiment 1. [Figure 38] This is an explanatory diagram showing an example of the rules for the phrase conversion process according to Embodiment 1. [Figure 39] This is an explanatory diagram showing an example of recipe information that is processed according to Embodiment 1. [Figure 40] This is an explanatory diagram showing an example of recipe information and equipment control information displayed by the recipe display system according to Embodiment 1. [Figure 41] This is an explanatory diagram showing an example of time information displayed by the recipe display system according to Embodiment 1. [Figure 42] This is an explanatory diagram showing an example of time information displayed by the recipe display system according to Embodiment 1. [Figure 43] This is an explanatory diagram showing an example of time information displayed by the recipe display system according to Embodiment 1. [Figure 44] This is an explanatory diagram showing an example of time information displayed by the recipe display system according to Embodiment 1. [Figure 45]This is an explanatory diagram showing an example of time information displayed by the recipe display system according to Embodiment 1. [Figure 46] This is an explanatory diagram showing an example of time information displayed by the recipe display system according to Embodiment 1. [Figure 47] This is an explanatory diagram showing an example of time information displayed by the recipe display system according to Embodiment 1. [Figure 48] This is an explanatory diagram showing an example of a method for adjusting the cooking process time according to Embodiment 1. [Figure 49] This is an explanatory diagram showing an example of recipe information and time information displayed by the recipe display system according to Embodiment 1. [Figure 50] This is an explanatory diagram showing an example of time information displayed by the recipe display system according to Embodiment 1. [Figure 51] This is an explanatory diagram showing an example of time information displayed by the recipe display system according to Embodiment 1. [Figure 52] This is an explanatory diagram showing an example of recipe information displayed by the recipe display system according to Embodiment 1. [Figure 53] This is an explanatory diagram showing an example of recipe information displayed by the recipe display system according to Embodiment 1. [Figure 54] This is an explanatory diagram showing examples of time information and dialogue information displayed by the recipe display system according to Embodiment 1. [Figure 55] This is an explanatory diagram showing examples of time information and dialogue information displayed by the recipe display system according to Embodiment 1. [Figure 56] This is an explanatory diagram showing examples of time information and dialogue information displayed by the recipe display system according to Embodiment 1. [Figure 57] This is an explanatory diagram showing an example of a cooling means according to Embodiment 1. [Figure 58] This is an explanatory diagram showing an example of time information displayed by the recipe display system according to Embodiment 1. [Figure 59] This is an explanatory diagram showing an example of time information displayed by the recipe display system according to Embodiment 1. [Figure 60]This is an explanatory diagram showing an example of time information displayed by the recipe display system according to Embodiment 1. [Figure 61] This is an explanatory diagram showing an example of time information displayed by the recipe display system according to Embodiment 1. [Figure 62] This is an explanatory diagram showing an example of how the recipe display system according to Embodiment 1 acquires recipe information. [Figure 63] This is an explanatory diagram showing an example of how the recipe display system according to Embodiment 1 acquires recipe information. [Figure 64] This is an explanatory diagram showing an example of how the recipe display system according to Embodiment 1 acquires recipe information. [Figure 65] This is an explanatory diagram showing an example of how the recipe display system according to Embodiment 1 acquires recipe information. [Figure 66] This is a block diagram showing an example of the configuration of a recipe display system according to a modified example of Embodiment 1. [Figure 67] This is an explanatory diagram showing an example of recipe information and control information displayed by the recipe display system according to Embodiment 2. [Figure 68] This is a flowchart showing the server processing according to Embodiment 2. [Figure 69] This is an explanatory diagram showing an example of a table that shows the control information generated by the recipe display system according to Embodiment 2 and the conversion of device words. [Figure 70] This is an explanatory diagram showing an example of a device word conversion table according to Embodiment 2. [Modes for carrying out the invention]

[0008] (Knowledge that forms the basis of this disclosure) Cooking recipes are generally written in natural language so that they can be easily understood by people.

[0009] On the other hand, people who cook using recipes often use cooking appliances such as ovens or microwaves, or timers to manage cooking time. These cooking appliances or timers are also referred to as cooking-related equipment. Cooking-related equipment may also operate based on command information from control devices designed to control them.

[0010] However, there is a problem in that users have to read recipe information, which is simply text, and then manually operate cooking appliances (such as timers) to input settings, which can be time-consuming.

[0011] The present invention provides a recipe display system, a recipe display method, and a program that reduce user effort by enabling the system to generate information for controlling or setting cooking equipment, etc., from recipe information.

[0012] The following describes examples of inventions that can be obtained from the disclosures in this specification, and explains the effects and other benefits that can be obtained from such inventions.

[0013] (1) A recipe display system comprising: an input interface for acquiring recipe information written in natural language; an analysis unit for acquiring process information including first information indicating cooking processes in a cooking process and second information indicating the time required for the cooking process by analyzing the recipe information acquired by the input interface; and a generation unit for generating a time management function for managing the elapsed time in the cooking process, or command information for operating the cooking function of a cooking appliance that performs the cooking process, using the process information acquired by the analysis unit, and controlling the generated command information to be displayed on a display screen together with the recipe information.

[0014] Here, the first piece of information is, for example, information related to the cooking process. This information includes, for example, cooking process words and equipment words. The second piece of information is, for example, information including time information.

[0015] According to the above embodiment, the recipe display system can manage the elapsed time in the cooking process or operate cooking equipment using recipe information written in natural language. Since the recipe information written in natural language can be written in a way that is easily understood by humans, users can manage the time in the cooking process or operate cooking equipment based on that recipe information without having to take any action such as converting the recipe information written in natural language for use in the recipe display system. In this way, the recipe display system can reduce the effort required of the user by enabling the generation of information for controlling or setting cooking equipment, etc. from the recipe information.

[0016] (2) The recipe display system according to (1), wherein the generation unit outputs control information that causes the command information to be displayed on a display screen as a display object that can be operated by a user, and the recipe display system further comprises an operation unit that accepts operations on the display object displayed on the display screen, and a function control unit that, when the operation unit accepts an operation, operates the time management function or the cooking function according to the command information associated with the display object that is the target of the operation.

[0017] According to the above embodiment, the recipe display system activates the time management function or cooking function in response to user operations on the display object that activates the time management function or cooking function. Therefore, the user can activate the time management function or cooking function more easily by operating on the display object. Thus, the recipe display system can more easily reduce the effort required of the user.

[0018] (3) The recipe display system according to (2), further comprising a timer unit for measuring the elapsed time in the cooking process, wherein the function control unit operates the timer unit when operating the time management function.

[0019] According to the above embodiment, the recipe display system uses a timer unit to measure elapsed time, making it easier to manage the time required for the cooking process. Therefore, the recipe display system can more easily reduce the effort required from the user.

[0020] (4) The recipe display system according to (3), wherein the timer unit displays on the display screen time information including the measured elapsed time or the remaining time in the cooking process calculated using the measured elapsed time.

[0021] According to the above embodiment, the recipe display system displays the elapsed time or remaining time of the cooking process, allowing the user to proceed with the cooking process while visually checking the elapsed time or remaining time. In this way, the recipe display system can assist the user while they are cooking, or in other words, it can support the user's cooking. Therefore, the recipe display system can support the user's cooking by reducing the effort required of the user.

[0022] (5) The recipe display system according to (4), wherein when the timer unit displays time information on the display screen, it displays a figure indicating the elapsed time or the remaining time on the display screen in accordance with the string indicating the cooking process included in the recipe information.

[0023] According to the above embodiment, the recipe display system displays the elapsed time or remaining time as a graphic, so that the user can more easily grasp the elapsed time or remaining time from the displayed graphic. Therefore, the recipe display system can reduce the user's effort while making it easier for the user to grasp the elapsed time or remaining time.

[0024] (6) The recipe display system according to any one of (2) to (5), wherein the analysis unit analyzes the recipe information using natural language processing to obtain process information including first information including third information indicating the cooking equipment that performs the cooking process in the cooking process, the recipe display system further comprises a communication interface capable of communicating with the cooking equipment, and the function control unit transmits equipment control information for operating the cooking function of the cooking equipment to the cooking equipment indicated by the third information via the communication interface when operating the cooking function.

[0025] Here, the third piece of information is, for example, information that includes device-related terms.

[0026] According to the above embodiment, the recipe display system can more easily operate cooking functions by transmitting equipment control information to cooking equipment via a communication interface. Therefore, the recipe display system can more easily reduce the effort required from the user.

[0027] (7) The recipe display system according to (1) or (2), further comprising a storage unit that stores equipment information indicating one or more cooking appliances registered by the user, wherein the analysis unit determines whether the cooking process in the cooking step can be performed by the one or more cooking appliances, and if it determines that it can be performed, generates first control information as command information to operate the cooking appliance that performs the cooking process from among the one or more cooking appliances, and if it determines that it cannot be performed, generates second control information as command information to operate the time management function that manages the elapsed time in the cooking step.

[0028] Here, the device information includes, for example, a list of registered devices.

[0029] According to the above embodiment, the recipe display system can easily determine whether to activate the time management function or the cooking function depending on whether the user has registered cooking equipment capable of performing cooking processes. Therefore, the recipe display system can further reduce the effort required of the user.

[0030] (8) The recipe display system according to (7), wherein the analysis unit determines that the cooking process in the cooking step can be performed by an alternative cooking device which is a different cooking device from the cooking device that performs the cooking process in the cooking step and is included in the one or more cooking devices, and if it determines that the cooking process in the cooking step can be performed by the one or more cooking devices, it performs a conversion process on the recipe information, the conversion process includes converting the cooking device to the alternative cooking device and converting the second information to the time when the alternative cooking device performs the cooking process, and the generation unit controls the display screen to display the converted recipe information.

[0031] According to the above embodiment, if the user has not registered a cooking appliance capable of performing the cooking process, the recipe display system can operate an alternative cooking appliance registered by the user to perform the converted cooking process. Even when the user has not registered a cooking appliance capable of performing the cooking process, the recipe display system can contribute to the smooth progress of cooking activities or tasks through a timer-based time management function. Therefore, the recipe display system can further reduce the effort required from the user.

[0032] (9) The recipe display system according to any one of (1) to (8), wherein the recipe display system is a terminal device, and the terminal device further comprises the display screen.

[0033] According to the above embodiment, the recipe display system can reduce the effort required of the user by enabling the generation of information for controlling or setting cooking equipment, etc., from recipe information using a single terminal device.

[0034] (10) The recipe display system according to any one of (1) to (8), comprising a server having the analysis unit and the generation unit, and a terminal device having the input interface and the display screen.

[0035] According to the above embodiment, the recipe display system can reduce the effort required of the user by enabling the generation of information for controlling or setting cooking equipment, etc., from recipe information using a server and terminal devices.

[0036] (11) The recipe display system according to (10), further comprising the cooking equipment.

[0037] According to the above embodiment, the recipe display system can reduce the effort required of the user by enabling the generation of information for controlling or setting cooking equipment, etc., from recipe information using a server, terminal devices, and cooking equipment.

[0038] (12) A recipe display method that a recipe display system equipped with an input interface executes using at least one processor, wherein the input interface acquires recipe information written in natural language, analyzes the recipe information acquired by the input interface to acquire process information including first information indicating cooking processes in a cooking process and second information indicating the time required for the cooking process, uses the acquired process information to generate a time management function for managing the elapsed time in the cooking process, or command information for operating the cooking function of a cooking appliance that performs the cooking process, and controls the system to display the generated command information together with the recipe information on a display screen.

[0039] According to the above embodiment, the same effect as the recipe display system described above is achieved.

[0040] (13) A program that causes at least one computer to execute the recipe display method described in (12).

[0041] According to the above embodiment, the same effect as the recipe display system described above is achieved.

[0042] The embodiments will be described in detail below, with reference to the drawings as appropriate. However, unnecessarily detailed explanations may be omitted. For example, detailed explanations of already well-known matters and redundant explanations of substantially identical configurations may be omitted. This is to avoid the following explanation becoming unnecessarily verbose and to facilitate understanding for those skilled in the art.

[0043] The inventors provide the accompanying drawings and the following description so that those skilled in the art may fully understand the disclosure, and not to limit the subject matter described in the claims.

[0044] (Embodiment 1) This embodiment describes a recipe display system that reduces user effort by enabling the generation of information for controlling or setting cooking equipment, etc., from recipe information.

[0045] Figure 1 is a block diagram showing an example of the configuration of the recipe display system 1 according to this embodiment.

[0046] As shown in Figure 1, the recipe display system 1 comprises at least a server 10 and a terminal 20. The recipe display system 1 may also further include cooking equipment 30. Note that the cooking equipment 30 may consist of one or more cooking devices 30.

[0047] Server 10, terminal 20, and cooking equipment 30 are connected via network N, enabling communication between them.

[0048] Server 10 is a server device which is a computer that generates information to control cooking-related equipment based on recipe information. Server 10 comprises a processor 11, a storage unit 12, and a communication interface 13.

[0049] The processor 11 enables the server 10 to perform software functions by executing software programs. The processor 11 is, for example, a CPU (Central Processing Unit). The processor 11 is also connected to other components of the server 10 by an internal bus, and by sending and receiving information with the other components, it enables the server 10 to perform software functions, thereby realizing the analysis unit 111 and the generation unit 112 described below.

[0050] The analysis unit 111 is a functional unit that analyzes recipe information. The analysis unit 111 acquires recipe information written in natural language from the terminal 20 via the network N and communication IF 13. The analysis unit 111 then analyzes the acquired recipe information using natural language processing to obtain process information that includes first information indicating the cooking process in the cooking process and second information indicating the time required for the cooking process. Natural language processing is, for example, morphological analysis.

[0051] Furthermore, the analysis unit 111 may obtain information (corresponding to third information) indicating the cooking equipment 30 that performs the cooking process in the cooking process by analyzing the recipe information using natural language processing. The third information is included in the first information.

[0052] Furthermore, the analysis unit 111 may determine whether the cooking process in the cooking step can be performed by one or more cooking devices 30 registered by the user, and may perform the following processing according to the determination result. That is, if the analysis unit 111 determines that the cooking process in the cooking step can be performed by one or more cooking devices 30 registered by the user, it may generate device control information (also called first control information) as command information to operate the cooking device 30 that performs the cooking process from among the one or more cooking devices 30. Also, if the analysis unit 111 determines that the cooking process in the cooking step cannot be performed by one or more cooking devices 30 registered by the user, it may generate time management control information (also called second control information) as command information to operate a time management function that manages the elapsed time in the cooking step.

[0053] For example, if the cooking process in the cooking step can be performed by an alternative cooking device, the analysis unit 111 can determine that the cooking process in the cooking step can be performed using one or more cooking devices 30. Here, the alternative cooking device is a cooking device 30 that is different from the cooking device 30 that performs the cooking process in the cooking step, and is included in one or more cooking devices 30. If the analysis unit 111 determines that the cooking process in the cooking step can be performed using one or more cooking devices 30, it performs a conversion process to recipe information. The conversion process includes converting the cooking device to an alternative cooking device and converting the second information to the time it would take for the alternative cooking device to perform the cooking process.

[0054] The generation unit 112 is a functional unit that generates command information. Using the process information acquired by the analysis unit 111, the generation unit 112 generates command information that either manages the elapsed time in the cooking process or activates the cooking function of the cooking equipment 30 that performs the cooking process. The generation unit 112 also controls the display screen to show the recipe information. At this time, the generation unit 112 controls the display screen to show the generated command information together with the recipe information.

[0055] More specifically, the generation unit 112 can control the display of command information on the display screen by outputting control information that displays the command information on the display screen as a display object that can be operated by the user.

[0056] Furthermore, when the generation unit 112 has been processed by the analysis unit 111 to convert the information into recipe information, it controls the display unit 112 to display the converted recipe information on the display screen.

[0057] The generation unit 112 may also generate at least one of the device control information and the time management control information.

[0058] The display screen that the generation unit 112 controls to display the command information is, for example, the display screen of the display unit 26 of the terminal 20. This is the example used in this explanation, but it is not limited to this case.

[0059] The memory unit 12 is a storage device having a memory area for storing information. The memory unit 12 includes RAM (Random Access Memory) which is used as a temporary memory area when the processor 11 performs information processing. The memory unit 12 also includes storage (for example, an HDD (Hard Disk Drive), SSD (Solid State Drive), or flash memory, etc.) in which information used for processing by the processor 11 is stored.

[0060] The memory unit 12 stores program data for natural language processing software used in the analysis process by the analysis unit 111, a substitute time table, or a registered cooking equipment list. The program data mentioned above is the program data executed by the processor 11. The information stored in the memory unit 12 will be explained in detail later.

[0061] Communication IF13 is a communication interface that is connected to network N in a communicative manner. Communication IF13 may be a communication interface for a wired communication standard (e.g., Ethernet®), or a communication interface for a wireless communication standard (e.g., Wi-Fi®), or a mobile communication system (e.g., 3G (3rd Generation), 4G (4th Generation), or 5G (5th Generation)).

[0062] Terminal 20 is a terminal device that is a computer used by a user. Terminal 20 may be, for example, a smartphone, tablet, personal computer, or smart device such as a smart speaker. Terminal 20 comprises a processor 21, a storage unit 22, a communication IF 23, an input IF 24, an operation unit 25, and a display unit 26.

[0063] The processor 21 enables the terminal 20 to perform software functions by executing software programs. The processor 21 is, for example, a CPU. The processor 21 is also connected to other components of the terminal 20 by an internal bus, and by sending and receiving information with the other components and enabling the terminal 20 to perform software functions, it realizes the function control unit 211 and timer unit 212 described below.

[0064] The function control unit 211 is a functional unit that operates the time management function or the cooking function. Specifically, when the operation unit 25 receives an operation from the user, the function control unit 211 operates the time management function or the cooking function according to the command information associated with the display object that is the target of that operation.

[0065] Specifically, the function control unit 211 activates the timer unit 212 when activating the time management function.

[0066] Furthermore, when the function control unit 211 activates the cooking function, it transmits device control information to the cooking appliance 30 via the communication IF 23. In this case, the cooking appliance 30 receives the transmitted device control information and operates the cooking unit 34 according to the received device control information.

[0067] The timer unit 212 is a functional unit that measures the elapsed time during the cooking process. The timer unit 212 measures the elapsed time during the cooking process under the control of the functional control unit 211.

[0068] The processor 21 can display time information on the display screen. Time information is a display object that is displayed on the display screen. Specifically, the processor generates time information from time management control information. In addition, the time information specifically includes the elapsed time measured by the timer unit 212, or the remaining time in the cooking process calculated using the elapsed time measured by the timer unit 212.

[0069] The processor 21 may display time information as textual information in hours, minutes, and seconds format, or as a graphic. For example, the processor 21 may display a graphic whose appearance changes over time (for example, its dimensions, area, shape, direction, or color changes). More specifically, the processor 21 may display a graphic whose dimensions change over time, such as a graphic whose dimensions increase or decrease over time. An example of such a graphic is a progress bar. A progress bar is a long, rectangular graphic whose length increases over time, indicating the passage of time. The processor 21 may also display a graphic indicating elapsed time or remaining time in accordance with a string of characters indicating the cooking process included in the recipe information on the display screen. The processor 21 may also display a graphic whose shape or color changes over time as time information.

[0070] The memory unit 22 is a storage device having a memory area for storing information. The memory unit 22 includes RAM, which is used as a temporary memory area when the processor 21 performs information processing. The memory unit 22 also includes storage where information used for processing by the processor 21 is stored.

[0071] Communication IF23 is a communication interface that is connected to network N in a communicative manner. Communication IF23 may be a communication interface for a wired communication standard (e.g., Ethernet), a communication standard for wireless communication (e.g., Wi-Fi), or a communication interface for a mobile communication system (e.g., 3G, 4G, or 5G).

[0072] Input IF24 is an input interface that acquires recipe information written in natural language. When Input IF24 acquires recipe information, it provides the acquired recipe information to the processor 21. Input IF24 can be implemented using a keyboard, touch panel, mouse, microphone, or camera, etc.

[0073] The operation unit 25 is an operation unit that receives operations from the user. When the operation unit 25 receives an operation from the user, it provides operation information indicating the received operation to the processor 21. The operation unit 25 is implemented by a touch panel or a microphone. The operation unit 25 may also share the same hardware as the input IF 24.

[0074] The display unit 26 is a display device that displays information as an image on a display screen. The display unit 26 is a liquid crystal display panel or an organic EL (Electro Luminescence) display panel, etc.

[0075] Cooking appliance 30 is an appliance used for cooking. Examples of cooking appliances 30 include ovens, toasters, microwave ovens, automatic cookers (so-called auto cookers), refrigerators, bread makers, mixers, gas stoves, microwave ovens, or rice cookers. Cooking appliance 30 comprises a processor 31, a storage unit 32, a communication interface 33, a cooking unit 34, and an operation unit 35. Cooking appliance 30 may also further include a display unit 36.

[0076] The processor 31 enables the cooking appliance 30 to perform software functions by executing software programs. The processor 31 is, for example, a CPU. The processor 31 is also connected to other components of the cooking appliance 30 by an internal bus, and can control other components of the cooking appliance 30 by enabling the cooking appliance 30 to perform software functions while sending and receiving information with the other components.

[0077] The memory unit 32 is a storage device having a memory area for storing information. The memory unit 32 includes RAM, which is used as a temporary memory area when the processor 31 performs information processing. The memory unit 32 also includes storage where information used for processing by the processor 31 is stored.

[0078] Communication IF33 is a communication interface that is connected to network N in a communicative manner. Communication IF33 may be a communication interface for a wired communication standard (e.g., Ethernet), a communication standard for wireless communication (e.g., Wi-Fi), or a communication interface for a mobile communication system (e.g., 3G, 4G, or 5G).

[0079] The cooking unit 34 performs cooking processes. The cooking unit 34 has, for example, a heater, a magnetron, a compressor, or a motor, and uses these to perform cooking processes. Cooking processes include, for example, baking, boiling, heating, cooling, or stirring, and two or more of these may be combined.

[0080] The control unit 35 receives user input for the cooking appliance 30. The control unit 35 has, for example, operation buttons that receive user input. For example, the control unit 35 has at least a start button that receives a start operation to begin cooking by the cooking unit 34. The control unit 35 may also have a stop button that receives a stop operation to stop cooking by the cooking unit 34. When the control unit 35 receives input for an operation button, it provides operation information to the processor 31 indicating the received operation. The operation information may include information indicating the start or stop of the cooking process, or the type of cooking process (such as heating).

[0081] The display unit 36 ​​is a display device that displays information as an image on a display screen. The display unit 36 ​​is a liquid crystal display panel or an organic EL display panel, etc.

[0082] When the processor 31 receives device control information via the communication IF 33, it operates the cooking unit 34 according to the received device control information, thereby causing the cooking unit 34 to perform cooking processing. Also, when the processor 31 obtains operation information from the operation unit 35, it operates the cooking unit 34 according to the operation information, thereby causing the cooking unit 34 to perform cooking processing.

[0083] Furthermore, the processor 31 generates an object for display on the application screen based on the device control information and displays the object on the application screen. By manipulating the object, the cooking unit 34 is made to execute the cooking process. Alternatively, a synchronized timer may be operated and displayed based on the time information included in the device control information, or the timer unit 212 may be operated and the measurement of elapsed time may be started based on the time information included in the device control information.

[0084] Figures 2 and 3 are sequence diagrams showing an example of the processing of the recipe display system 1 according to this embodiment. Figure 4 is an explanatory diagram showing an example of recipe information and control information displayed by the recipe display system 1 according to this embodiment. The processing of the recipe display system 1 will be explained with reference to Figures 2 to 4.

[0085] Figure 2 is a sequence diagram showing a first example of the processing of the recipe display system 1 according to this embodiment. The sequence diagram shown in Figure 2 shows the processing of the recipe display system 1 when the server 10 generates device control information.

[0086] In step S11, terminal 20 obtains recipe information. Terminal 20 sends the obtained recipe information to server 10. Server 10 receives the transmitted recipe information.

[0087] Specifically, terminal 20 obtains recipe information via input IF24. Terminal 20 may obtain recipe information entered by the user in an input form, or it may obtain recipe information (more specifically, textual information of the recipe information) by obtaining an image containing the recipe information and generating it from that image using OCR (Optical Character Recognition / Reader) processing. Alternatively, terminal 20 may obtain recipe information by obtaining an image containing the recipe information and generating the recipe procedure from that image. Furthermore, input IF24 may obtain web page description information (e.g., HTML (Hyper Text Markup Language)) containing the recipe information from a web page containing the recipe information via the internet and obtain recipe information from the obtained description information. The method of obtaining recipe information by input IF24 will be explained in detail later.

[0088] An example of recipe information obtained by input IF24 is shown in Figure 4(a). The recipe information shown in Figure 4(a) is written in natural language so that it can be easily understood by humans.

[0089] In step S12, the server 10 analyzes the recipe information received in step S11, generates command information, and sends it to the terminal 20. The terminal 20 receives the transmitted command information.

[0090] The recipe information analysis process performed by server 10 is natural language processing, and can be done, for example, by morphological analysis, a well-known technique. Server 10 also generates instruction information, including device control information.

[0091] An example of the analysis process performed by server 10 is shown in Figure 4(b). In Figure 4(b), the recipe information is broken down into morphemes, and each morpheme is shown separated by a slash symbol " / ".

[0092] In step S13, terminal 20 displays recipe information and command information on its display screen. The recipe information displayed by terminal 20 is the recipe information acquired in step S11. The command information displayed is the command information received in step S12. An example of the recipe information and command information displayed by terminal 20 is shown in Figure 4(c). In Figure 4(c), device control information 41 for controlling the cooking appliance 30, which is an oven toaster, is shown together with the recipe information.

[0093] In step S14, terminal 20 determines whether or not it has received an operation from the user regarding the command information displayed in step S13. If it determines that the above operation has been received (Yes in step S14), it proceeds to step S15; otherwise (No in step S14), it executes step S14 again. In other words, server 10 remains in a waiting state in step S14 until it receives the above operation.

[0094] In step S15, terminal 20 transmits device control information to cooking appliance 30. Cooking appliance 30 receives the transmitted device control information.

[0095] In step S16, the cooking appliance 30 operates according to the appliance control information received in step S15. Specifically, the cooking appliance 30 performs the cooking process by operating the cooking unit 34.

[0096] Furthermore, after executing step S15, terminal 20 may operate and display a timer synchronized with the cooking appliance 30, or it may operate the timer unit 212 based on the time information included in the appliance control information and start measuring the elapsed time (step S17).

[0097] Figure 3 is a sequence diagram showing a second example of the processing of the recipe display system 1 according to this embodiment. The sequence diagram shown in Figure 3 shows the processing of the recipe display system 1 when the server 10 generates time management control information.

[0098] Step S11 is the same as step S11 in Figure 2.

[0099] In step S12A, the server 10 analyzes the recipe information received in step S11, generates command information, and sends it to the terminal 20, similar to step S12 in Figure 2. The terminal 20 receives the transmitted command information. The server 10 generates command information that includes time management control information as the command information.

[0100] In step S13A, terminal 20 displays recipe information and command information on the display screen, similar to step S13 in Figure 2. An example of the recipe information and command information displayed by terminal 20 is shown in Figure 4(d). In Figure 4(d), time information 42 is shown together with the recipe information.

[0101] In step S14A, terminal 20, similar to step S14 in Figure 2, determines whether or not it has received an operation from the user regarding the command information displayed in step S13A, and proceeds to step S15A or executes step S14A again. In other words, server 10 remains in a waiting state in step S14A until it receives the above operation.

[0102] In step S15A, terminal 20 activates the timer unit 212 according to the time management control information received in step S12A and starts measuring the elapsed time.

[0103] In step S16A, the cooking appliance 30 is expected to perform cooking by operating the cooking unit 34. The cooking appliance 30 is expected to perform the above cooking by operating based on the user's operation, for example, after viewing the recipe information displayed on the terminal 20. At this time, the operation of the cooking unit by the cooking appliance 30 (step S16A) is not controlled by the server 10 or the terminal 20, etc., but is controlled by the user's manual operation. The user can only use the timer displayed on the display unit 26 of the terminal 20.

[0104] The following describes the processes that server 10 performs.

[0105] Figure 5 is a flowchart showing the processing of the server 10 according to this embodiment. The processing shown in Figure 5 represents the detailed processing included in step S12 of Figure 2 or step S12A of Figure 3. The processing shown in Figure 5 will be explained with reference to Figures 6 to 15.

[0106] Here, we will explain as an example the case in step S11 (see Figure 3) where terminal 20 acquires recipe information R1 shown in Figure 6, and server 10 acquires that recipe information R1 from terminal 20.

[0107] In the recipe information R1 shown in Figure 6, the first line shows cooking procedure #1 (also simply called procedure), and the second line shows procedure #2. The initial "1" in the first line and the initial "2" in the second line are numbers indicating the order of the procedure. The same applies hereafter.

[0108] In step S101, the analysis unit 111 performs a process to analyze the text elements of the recipe information R1 by using natural language processing. An example of the analysis of the text elements of the recipe information R1 is shown in Figure 7. In Figure 7, similar to Figure 4(b), the recipe information is broken down into morphemes, and each morpheme is shown separated by a slash symbol " / ".

[0109] In step S102, the analysis unit 111 performs a process to extract elements that represent cooking processes and elements that represent cooking equipment from the text elements analyzed in step S101. The elements that represent cooking processes extracted by the analysis unit 111 in step S102 are also called "cooking process words," and the elements that represent cooking equipment are also called "equipment words."

[0110] If, in step S102, the analysis unit 111 extracts cooking processing words but determines that it cannot extract equipment words, it may refer to the table shown in Figure 8 to obtain alternative equipment words associated with cooking processing words and use them as equipment words. The alternative equipment words shown in Figure 8 are words that indicate equipment associated with cooking processing words, for example, words that indicate equipment that is standardly used in cooking processing related to cooking processing words.

[0111] The table shown in Figure 8 may consist only of cooking equipment registered by the user, or it may be included by the system from the beginning.

[0112] An example of cooking process words extracted by the analysis unit 111 in step S102 is shown in the "Extracted Cooking Process Words" column of Figure 9.

[0113] Specifically, the cooking process words extracted by the analysis unit 111 include "bleaching" included in step #1 of recipe information R1, and "heat medium heat," "stir-fry," and "stir-fry" included in step #2.

[0114] In this case, the corresponding equipment word for the cooking process words "medium heat, heat," "stir-fry," and "stir-fry" is "frying pan." On the other hand, since the analysis unit 111 could not extract the equipment word for the cooking process word "bleach" in step #1, it refers to the table shown in Figure 8 and determines that an alternative equipment word is not needed.

[0115] In step S103, the analysis unit 111 initiates loop A, which repeatedly executes the processes described in steps S104 to S108. In loop A, each cooking process word extracted in step S102 is processed, and ultimately all cooking process words are processed. The cooking process word being processed is also called the "focused cooking process word."

[0116] In step S104, the analysis unit 111 performs a process to extract elements that indicate time and modify the cooking processing word of interest from the text elements analyzed in step S101. The elements that indicate time extracted in step S104 are also called "time words".

[0117] An example of a time word extracted by the analysis unit 111 in step S104 is shown in the "Extracted Time Words" column of Figure 9.

[0118] Specifically, in the first iteration of Loop A, the analysis unit 111 extracted "1 minute" for "bleaching" included in step #1 of recipe information R1. Similarly, in the second iteration of Loop A, the analysis unit 111 extracted "about 2 minutes" for "heat over medium heat" included in step #2 of recipe information R1. In the third iteration of Loop A, the analysis unit 111 extracted "7 minutes" for "stir-fry" included in step #2 of recipe information R1. In the fourth iteration of Loop A, the analysis unit 111 extracted "about 3 minutes" for "stir-fry" included in step #2 of recipe information R1.

[0119] In step S105, the analysis unit 111 determines whether or not a time word was extracted in step S104. If it determines that a time word was extracted (Yes in step S105), the process proceeds to step S106; otherwise (No in step S105), the process proceeds to step S111.

[0120] In step S111, the analysis unit 111 performs a process to obtain a substitute time from the storage unit 12. The processor 11 uses the obtained substitute time as the time required for the cooking process corresponding to the cooking process word of interest.

[0121] The analysis unit 111 may choose not to use substitute time for cooking processing words that do not generate control information for the cooking equipment 30. In that case, the analysis unit 111 determines whether the cooking processing word of interest is a cooking processing word that generates control information for the cooking equipment 30 (step S112). If it is a cooking processing word that generates control information (Yes in step S112), the unit proceeds to step S106. If it is not a cooking processing word that generates control information (No in step S112), the unit proceeds to step S109 (in other words, steps S106-S108 and S116 are skipped).

[0122] Substitute times are predetermined, for example, for each cooking process word or cooking process type. Figure 10 shows a substitute time table that associates the predetermined substitute times for each cooking process word. The substitute time table in Figure 10 shows an example where substitute times are predetermined for each cooking process type or cooking process word.

[0123] In Figure 10, cooling and heating are shown as examples of cooking processes. For the cooling process words (i.e., "expose," "cool," "let cool"), a substitute time of "10 minutes" is set. For the heating process words (i.e., "bake," "heat," "stir-fry," "heat"), a substitute time of "5 minutes" is set.

[0124] If the analysis unit 111 does not extract a time word corresponding to the cooking process word "sarashi" in step #1, the analysis unit 111 can set the substitute time "10 minutes" associated with the cooking process word "sarashi" in the substitute time table as the time word corresponding to the cooking process word "sarashi".

[0125] In step S106, the analysis unit 111 determines whether it is possible to perform the cooking process indicated by the cooking process word using the cooking equipment 30 (also called registered cooking equipment) registered by the user. If it is determined that the cooking process can be performed using the cooking equipment 30 (Yes in step S106), the process proceeds to step S107; otherwise (No in step S106), the process proceeds to step S116.

[0126] The cooking appliances 30 registered by the user are, for example, the cooking appliances included in the registered cooking appliance list shown in Figure 11 or Figure 12. The registered cooking appliance list is generated, for example, when the server 10 receives registration of the cooking appliances 30 owned by the user via the terminal 20, and is stored in the storage unit 12.

[0127] The registered cooking appliance list shown in Figure 11 shows oven range A and a frying pan as cooking appliances 30 registered by the user. The registered cooking appliance list shown in Figure 12 shows oven range B, toaster oven B and a frying pan as cooking appliances 30 registered by the user. The registered cooking appliance list shown in Figure 13 shows oven range B as cooking appliances 30 registered by the user.

[0128] Although Figure 11 or Figure 12 does not show whether or not device-linked control is possible, the possibility of device-linked control may be managed in conjunction with a number indicating the model of the cooking appliance.

[0129] In step S107, the analysis unit 111 refers to the registered cooking equipment list and determines whether the cooking equipment generates equipment control information. If it is determined that the cooking equipment generates equipment control information (Yes in step S107), the process proceeds to step S108; otherwise (No in step S107), the process proceeds to step S116.

[0130] In step S107, when the analysis unit 111 determines whether or not the cooking appliance generates appliance control information, it can make the determination by referring to, for example, the table shown in Figure 14.

[0131] Figure 14 shows the control information generated by the analysis unit 111 for each cooking appliance corresponding to the appliance word. The control information generated by the analysis unit 111 is either appliance control information or time management control information.

[0132] As shown in Figure 14, for oven toasters or microwave ovens, the control information generated by the analysis unit 111 is defined for each model number. For example, oven toaster A and oven toaster B are oven toasters with different model numbers. Note that the analysis unit 111 can generate device control information for only some products; therefore, for products for which the analysis unit 111 cannot generate device control information, it generates time management control information. Also, a frying pan may be a cooking appliance for which the analysis unit 111 cannot generate device control information. In that case, the analysis unit 111 can only generate time management control information and cannot generate device control information.

[0133] In step S108, the generation unit 112 generates equipment control information by referring to, for example, the cooking equipment list shown in Figure 11. A specific example of the equipment control information generated by the generation unit 112 corresponds to the equipment control information 41 shown in Figure 4(c).

[0134] In step S116, the generation unit 112 generates time management control information, for example, by referring to the cooking equipment list shown in Figure 12. A specific example of the time management control information generated by the generation unit 112 corresponds to the time management control information 42 shown in Figure 4(d). The time management control information includes information to activate timers that measure the time required for one or more cooking processes performed in each step. For example, the time management control information may include a "1-minute timer" that manages the 1 minute required for one cooking process performed in step #1, and a "12-minute timer" that manages the 12 minutes required for the total time required for three cooking processes performed in step #2 (see the "Time Management Control Information Pattern 1" column in Figure 9).

[0135] The time management information may also include information to activate timers that measure the time required for each of the one or more cooking processes performed in each step. For example, the generation unit 112 may include, as time management control information, a "1-minute timer" that manages the 1 minute required for one cooking process performed in step #1, and a "2-minute timer," a "7-minute timer," and a "3-minute timer" that manage the time required for each of the three cooking processes performed in step #2: "medium heat, heat," "stir-fry," and "stir-fry" (see the "Time Management Control Information Pattern 2" column in Figure 9).

[0136] In step S109, the processor 11 performs the termination process for loop A. Specifically, the processor 11 determines whether the processes in steps S104 to S108 have been executed focusing on each cooking process word extracted in step S102. If not, it controls the process to execute focusing on cooking process words that have not yet been processed. If the processor 11 determines that processing has been executed for all cooking process words, it terminates the series of processes shown in Figure 5.

[0137] Note that the series of processes shown in Figure 5 may be performed step by step or in groups by phrase.

[0138] The processes in steps S103 to S109 may be performed before the series of cooking processes are carried out, or they may be performed sequentially as the cooking processes progress in parallel with the progress of the cooking processes.

[0139] The following describes how terminal 20 displays time information (step S13 or S13A).

[0140] Figure 15 is an explanatory diagram showing recipe information 51 and time information 515 as examples of recipe information and time information displayed by the recipe display system 1 according to this embodiment. Recipe information 51 and time information 515 are displayed on the display screen of the terminal 20 based on control by the generation unit 112. Figure 15 is an example in which time management control information is generated for each of the four cooking process words extracted by the analysis unit 111, as shown in Figures 6 and 9.

[0141] The content of recipe information 51 is the same as that of recipe information R1. In recipe information 51, icons 511, 512, 513, and 514 indicating time management are shown to the right of the time words corresponding to the cooking process (specifically, "1 minute", "2 minutes", "7 minutes", and "3 minutes").

[0142] Icons 511 to 514 can be operated by the user. When an operation is performed on icons 511 to 514, the processor 21 acquires operation information indicating that operation via the operation unit 25. Based on the acquired operation information, if the processor 21 determines that an operation has been performed on icons 511 to 514, it starts measuring the elapsed time using the timer unit 212 and also displays the time information 515.

[0143] For example, if icon 511 is operated, time information 521 is displayed, which includes the message "Start 1-minute timer" indicating that a timer measuring the time required for the cooking process, "1 minute," will be started. Time information 521 is command information, which is time management control information, and is a display object that can be operated by the user. Similarly, if icons 512, 513, and 514 are operated, the timer unit 212 starts measuring 2 minutes, 7 minutes, and 3 minutes, respectively.

[0144] Figure 16 is an explanatory diagram showing an example of time information displayed by the recipe display system 1 according to this embodiment. Figure 16 shows time information 521, 522, and 523, which are display objects displayed by the processor 21 for the cooking process of the "bleaching" cooking process in step #1.

[0145] Before starting the cooking process, the timer unit 212 displays time information 521, which includes the message "Start 1-minute timer," indicating that a timer measuring the time required for the cooking process, "1 minute," is being started. The time information 521 is command information, which is time management control information, and is a display object that can be operated by the user.

[0146] Similarly, when icons 512, 513, and 514 are operated, the timer unit 212 starts measuring 2 minutes, 7 minutes, and 3 minutes, respectively.

[0147] When an operation is performed on the time information 521, the processor 21 acquires operation information indicating that operation via the operation unit 25. Based on the acquired operation information, the processor 21 determines that an operation has been performed on the time information 521 and starts measuring the elapsed time.

[0148] The processor 21 displays time information 522 when the timer unit 212 is measuring time. The time information 522 indicates the remaining time for the cooking process. The remaining time for the cooking process is calculated by the processor 21 using the elapsed time measured by the timer unit 212. The processor 21 updates the remaining time included in the time information 522 as time passes.

[0149] The "x" marks included in the time information 522 can be manipulated by the user. When an operation is performed on an "x" mark, the processor 21 acquires operation information indicating that operation via the operation unit 25. Based on the acquired operation information, the processor 21 determines that an operation has been performed on the "x" mark and can hide the time information 522. The same applies to other "x" marks.

[0150] When one minute has elapsed since the operation on time information 521, the remaining time becomes 0, and the processor 21 displays time information 523. Time information 523 shows that the remaining time is "0:00", indicating that the time measurement has ended.

[0151] Figure 17 is an explanatory diagram showing an example of time information displayed by the recipe display system 1 according to this embodiment. Figure 17 shows time information 531, 532, and 533, which are display objects that the processor 21 sequentially displays for a cooking process that includes three cooking processes included in step #2 of the time management control information pattern 1.

[0152] Processor 21 performs the same processing on the cooking step of procedure #2 as on the cooking step of cooking process #1 described above.

[0153] Specifically, the processor 21 displays time information 531, which includes the message "Start 12-minute timer," indicating that it is starting a timer to measure the time required for the cooking process, which is "12 minutes." When an operation is performed on time information 531, the timer unit 212 starts measuring the elapsed time, and the processor 21 displays time information 532. After 12 minutes have elapsed since the operation on time information 531, the processor 21 displays time information 533. Here, time information 531, 532, and 533 have the same functions as time information 521, 522, and 523, respectively.

[0154] Figure 18 is an explanatory diagram showing an example of time information displayed by the recipe display system 1 according to this embodiment. Figure 18 shows time information 541 to 549, which are display objects that the processor 21 sequentially displays for each of the three cooking processes included in step #2 of the time management control information pattern 2.

[0155] First, before starting the cooking process corresponding to the first cooking step "medium heat, heat" included in step #2, the processor 21 displays time information 541, which includes the message "Start 2-minute timer," indicating that it will start a timer to measure the time "2 minutes" required for the cooking process. The time information 541 is a display object that can be manipulated by the user.

[0156] When an operation is performed on the time information 541, the processor 21 acquires operation information indicating that operation via the operation unit 25. Based on the acquired operation information, the processor 21 determines that an operation has been performed on the time information 541 and starts measuring the elapsed time using the timer unit 212.

[0157] When the timer unit 212 is measuring time, the processor 21 displays time information 542. The time information 542 indicates the remaining time for the cooking process. The remaining time for the cooking process is calculated by the processor 21 using the measured elapsed time. The processor 21 updates the remaining time included in the time information 542 as time passes.

[0158] Two minutes after an operation is performed on time information 541, the remaining time becomes 0, and the processor 21 displays time information 543. Time information 543 indicates that the remaining time is "0:00" and that the time measurement has ended.

[0159] Next, the processor 21 performs the same processing on the cooking step corresponding to the second cooking step "stir-fry" included in step #2 as it does on the cooking step corresponding to the cooking step "heat over medium heat" described above.

[0160] Specifically, the processor 21 displays time information 544, which includes the message "Start 7-minute timer" indicating that it will start a timer to measure the time required for the cooking process, which is "7 minutes". If an operation is performed on time information 544, the timer unit 212 starts measuring the elapsed time, and the processor 21 displays time information 545. After 7 minutes have elapsed since the operation on time information 544, the processor 21 displays time information 546. Here, time information 544, 545, and 546 have the same functions as time information 541, 542, and 543, respectively.

[0161] Next, processor 21 performs the same processing on the third cooking step, "sautéing," included in step #2, as it does on the cooking step corresponding to "heat over medium heat" mentioned above.

[0162] Specifically, the processor 21 displays time information 547, which includes the message "Start 3-minute timer" indicating that it will start a timer to measure the time required for the cooking process, which is "3 minutes". When an operation is performed on time information 547, the timer unit 212 starts measuring the elapsed time, and the processor 21 displays time information 548. After 3 minutes have elapsed since the operation on time information 548, the processor 21 displays time information 549. Here, time information 547, 548, and 549 have the same functions as time information 541, 542, and 543, respectively.

[0163] The following sections will explain variations in time information.

[0164] Figure 19 is an explanatory diagram showing an example of time information displayed by the recipe display system 1 according to this embodiment. The time information shown in Figure 19 is a modified version of the time information shown in Figures 16 and 18.

[0165] The time information 521A shown in Figure 19(a) is a modified version of the time information 521 (see Figure 16). The time information 521A includes "1 minute," the time required for the cooking process in which time measurement begins, and "bleaching," a cooking process included in that cooking process. Since the time information 521A includes the details of the cooking processes included in the cooking process, a user who sees the time information 521A can easily recognize which cooking process the time information 521A corresponds to.

[0166] The same applies to the time information 541A, 544A, or 547A shown in Figures 19(b) to (d).

[0167] In other words, the time information 541A shown in Figure 19(b) is a modified version of the time information 541 (see Figure 18). The time information 541A includes the time required for the cooking process in which the time measurement begins, "2 minutes," and the cooking process included in the cooking process, "medium heat, heated."

[0168] Furthermore, the time information 544A shown in Figure 19(c) is a modified version of time information 544 (see Figure 18). Time information 544A includes the time required for the cooking process in which time measurement begins, "7 minutes," and the cooking process "stir-frying" included in that cooking process.

[0169] Furthermore, the time information 547A shown in Figure 19(d) is a modified version of time information 547 (see Figure 18). Time information 547A includes the time required for the cooking process in which time measurement begins, "3 minutes," and the cooking process included in the cooking process, "stir-frying."

[0170] Since the time information 541A, 544A, or 547A includes the details of the cooking process included in the cooking process, a user who views the time information 521A can easily recognize which cooking process corresponds to the time information 541A, 544A, or 547A.

[0171] Figure 20 is an explanatory diagram showing an example of time information displayed by the recipe display system 1 according to this embodiment.

[0172] The time information 544B shown in Figure 20 is an example of time information displayed on the screen in place of time information 544. Time information 544B includes "Add potatoes and sauté for 7 minutes" as supplementary information 5441 indicating the content of the cooking process for that procedure included in recipe information R1. Time information 544B also includes time information 5442 indicating the time to be managed. Since time information 544B includes text indicating the content of the cooking process, a user who sees time information 544B can easily recognize which cooking process it corresponds to.

[0173] Figure 21 is an explanatory diagram showing an example of time information displayed by the recipe display system 1 according to this embodiment.

[0174] The time information 544C shown in Figure 21 is an example of time information displayed on the screen in place of time information 544. Time information 544C includes the time to be managed, along with the text "Add potatoes" and "Sauté for 7 minutes," which describe the cooking process of the procedure included in recipe information R1, as display objects. Since time information 544C includes text describing the cooking process, a user who views time information 544C can easily recognize which cooking process it corresponds to.

[0175] Figure 22 is an explanatory diagram showing recipe information 55 and time information 551 as examples of recipe information and time information displayed by the recipe display system 1 according to this embodiment. The recipe information 55 and time information 551 are displayed on the display screen of the terminal 20 based on control by the generation unit 112.

[0176] In Figure 22, the content of recipe information 55 is the same as that of recipe information R1. In Figure 22, icons 511, 512, 513, and 514 (icon 511, etc.) indicating time management are shown to the right of the time words (specifically, "1 minute", "2 minutes", "7 minutes", and "3 minutes"). Icon 511, etc. is the same as icon 511, etc. shown in Figure 15.

[0177] When an operation is performed on icon 511, the processor 21 acquires operation information indicating that operation via the operation unit 25. Based on the acquired operation information, if the processor 21 determines that an operation has been performed on icon 511, it displays time information 551.

[0178] The time information 551 has a progress bar 551A that shows the elapsed time in the cooking process currently underway. The time information 551 and the progress bar 551A show the elapsed time of the cooking process corresponding to the time word written to the left of the operated icon 511, etc.

[0179] The progress bar 551A's longitudinal dimension, or in other words, the area of ​​the filled portion, indicates the current elapsed time in the cooking process currently underway. The area of ​​the filled portion of the progress bar 551A is calculated by the processor 21 using the measured elapsed time. The processor 21 updates the display so that the area of ​​the filled portion of the progress bar 551A increases as time progresses. The time information 551 may also include the time word "1 minute". Furthermore, the display mode of the icon 511 may be changed to make it possible to determine that the icon 511 is selected.

[0180] Figure 23 is an explanatory diagram showing an example of recipe information and time information displayed by the recipe display system 1 according to this embodiment, including recipe information 56 and progress bars 561, 562, 563, and 564 (also referred to as progress bar 561, etc.). The recipe information 56 and progress bars 561, etc. are displayed on the display screen of the terminal 20 based on control by the generation unit 112.

[0181] In Figure 23, the content of recipe information 56 is the same as that of recipe information R1. In Figure 23, icons 511, 512, 513, and 514 (icon 511, etc.) indicating time management are shown to the right of the time words (specifically, "1 minute", "2 minutes", "7 minutes", and "3 minutes"). Icon 511, etc. is the same as icon 511, etc. shown in Figure 15.

[0182] When an operation is performed on icon 511, the processor 21 acquires operation information indicating that operation via the operation unit 25. Based on the acquired operation information, if the processor 21 determines that an operation has been performed on icon 511, the appearance of the progress bar 561 begins to change.

[0183] Progress bar 561 indicates the current elapsed time in the associated cooking process and is displayed in accordance with the string representing that cooking process. Progress bar 561 indicates the elapsed time of the cooking process corresponding to the time word written to the left of the operated icon 511, etc. Processor 21 updates the display so that the area of ​​the filled portion of progress bar 561 increases as time passes. Here, an example is shown where the string representing the cooking process corresponding to the cooking process word "soaking" is "Peel the potatoes, cut them into strips, and soak them in water for 1 minute."

[0184] Furthermore, if the cooking process associated with the progress bar 561 has not yet started, the progress bar 561 will be shown without a filled area, and if the associated cooking process has already finished, the entire area will be shown filled.

[0185] Icons 512, 513, and 514 are the same as icon 511. That is, when an operation is performed on icon 512, 513, or 514, the processor 21 displays progress bars 562, 563, or 564, respectively.

[0186] Progress bars 562, 563, and 564 are similar to progress bar 561. That is, progress bars 562, 563, or 564 each indicate the elapsed time of the cooking process corresponding to the time word written to the left of the operated icon 512, 513, or 514. The processor 21 updates the display so that the area of ​​the filled portion of progress bar 562, 563, or 564 increases over time.

[0187] The following will explain the types of time displayed by the recipe display system 1.

[0188] Figure 24 is an explanatory diagram of a time type time table showing the types of time displayed by the recipe display system 1 according to this embodiment. The time type table shown in Figure 24 shows an example in which the type of time to be displayed is defined for each type of cooking process.

[0189] In Figure 24, cooling and heating are shown as examples of cooking processes. For the cooling process words (i.e., "expose," "cool," "let cool"), "remaining time" is defined as the time type. Similarly, for the heating process words (i.e., "grill," "heat," "stir-fry," "heat"), "elapsed time" is defined as the time type.

[0190] Figure 25 is an explanatory diagram showing an example of time information displayed by the recipe display system 1 according to this embodiment. Figure 25 shows time information 571, 572, and 573, which are display objects that the processor 21 sequentially displays for the cooking process "medium heat, heat" in step #2. Time information 571, 572, and 573 indicate the remaining time for the cooking process. Time information 571, 572, and 573 can be used in place of time information 541, 542, and 543 shown in Figure 18, respectively.

[0191] The processor 21 refers to the time type table in Figure 24 and displays time information 571 containing the message "2 minutes: medium heat, heat" to indicate that it will start a timer to measure the time "2 minutes" required for the cooking process "medium heat, heat" included in the cooking process. If an operation is performed on time information 571, the timer unit 212 starts measuring the elapsed time, and the processor 21 displays time information 572 showing the remaining time calculated from the elapsed time. After 2 minutes have elapsed since the operation on time information 571, the processor 21 displays time information 573 containing "0:00" as the remaining time. Here, time information 571, 572, and 573 have the same functions as time information 521, 522, and 523, respectively.

[0192] Figure 26 is an explanatory diagram showing an example of time information displayed by the recipe display system 1 according to this embodiment. Figure 26 shows time information 581, 582, and 583, which are display objects that the processor 21 sequentially displays for the cooking process "medium heat, heat" in step #2. Time information 581, 582, and 583 indicate the elapsed time of the cooking process. Time information 581, 582, and 583 can be used in place of time information 541, 542, and 543 shown in Figure 18, respectively.

[0193] The processor 21 displays time information 581, which includes the message "2 minutes: medium heat, heat" indicating the start of a timer to measure the time "2 minutes" required for the cooking process "medium heat, heat" included in the cooking process. If an operation is performed on time information 581, the timer unit 212 starts measuring the elapsed time, and the processor 21 displays time information 582 indicating the elapsed time. After 2 minutes have elapsed since the operation on time information 581, the processor 21 displays time information 583, which includes "2:00" as the elapsed time. Here, time information 581, 582, and 583 have the same functions as time information 521, 522, and 523, respectively.

[0194] The following section will explain the time notification performed by the processor 21.

[0195] In addition to displaying the elapsed time or remaining time as described above, the processor 21 can also display a time notification. The time notification is issued when the elapsed time or remaining time of the cooking process meets predetermined conditions.

[0196] Figure 27 is an explanatory diagram showing a condition table that indicates the conditions for time notification according to this embodiment.

[0197] Figure 27 shows the conditions for time notifications for each type of time. The conditions for time notifications include "time range" and "timing of notification."

[0198] The time range indicates the elapsed or remaining time to which the condition applies.

[0199] The notification timing indicates when processor 21 will issue a time notification.

[0200] For example, the second row of the condition table shown in Figure 27 indicates that if the elapsed time is between 5 minutes and 30 minutes, the processor 21 will send a notification every 5 minutes. This notification will include the string "x minutes have passed" (where x is a number indicating the elapsed time), more specifically, a string such as "5 minutes have passed" or "10 minutes have passed". The third and fourth rows of the condition table are similar.

[0201] The first row of the condition table indicates that if the elapsed time is less than 5 minutes, the processor 21 will not send a notification.

[0202] Furthermore, the sixth row of the condition table indicates that if the remaining time is between 1 minute and 10 minutes, the processor 21 will send a notification when there is 1 minute remaining. This notification will include the string "x minutes remaining" (where x is a number indicating the elapsed time), and more specifically, a string such as "1 minute remaining" or "10 minutes remaining". The seventh row of the condition table is similar.

[0203] Note that the fifth row of the condition table indicates that if the remaining time is less than one minute, the processor 21 will not send a notification.

[0204] Figure 28 is an explanatory diagram showing patterns of time management control information including time notification according to this embodiment. Figure 28 shows time management control information for time management of the cooking process and time management control information for time notification for each of the time management control information patterns 1 and 2 shown in Figure 9.

[0205] The time management control information for time management is the same as that shown in Figure 9.

[0206] The time management control information for time notification indicates the control information for time notification performed by the processor 21 in the cooking process according to the condition table shown in Figure 27.

[0207] For example, in time management control information pattern 1, the total time required for the three cooking processes performed in step #2, which is 12 minutes, includes time notification control information for "5 minutes elapsed," "10 minutes elapsed," "10 minutes remaining," and "1 minute remaining."

[0208] Furthermore, in time management control information pattern 2, the 7 minutes required for the "stir-fry" cooking process performed in step #2 includes time notifications of "5 minutes elapsed" and "10 minutes remaining." In addition, the 3 minutes required for the "stir-fry" cooking process performed in step #2 includes a time notification of "1 minute remaining."

[0209] Figure 29 is an explanatory diagram showing an example of time information displayed by the recipe display system 1 according to this embodiment. Figure 29 shows time information 591 to 598, which are display objects displayed sequentially by the processor 21 for a cooking process that includes three cooking processes included in step #2.

[0210] The processor 21 displays time information 591, which includes the message "Start 12-minute timer," indicating that it will start a timer to measure the time required for the cooking process, which is "12 minutes." If an operation is performed on the time information 591, the timer unit 212 starts measuring the elapsed time, and the processor 21 displays time information 592 indicating the elapsed time.

[0211] When the remaining time for the cooking process is 10 minutes (in other words, 2 minutes have passed since the operation on time information 591 was performed), the processor 21 displays time information 593, which includes the time notification "10 minutes remaining," and then displays time information 594, which indicates the elapsed time.

[0212] The processor 21 displays time information 595, which includes the time notification "5 minutes have elapsed," when 5 minutes have elapsed since the operation was performed on time information 591. The processor 21 also displays time information 596, which includes the time notification "10 minutes have elapsed," when 10 minutes have elapsed since the operation was performed on time information 591.

[0213] The processor 21 displays time information 597, which includes the time notification "1 minute remaining," when there is 1 minute remaining in the cooking process (in other words, 11 minutes have elapsed since the operation on time information 591 was performed).

[0214] Twelve minutes have passed since the operation on time information 591, and the remaining time becomes 0, and the processor 21 displays time information 598. Time information 598 shows that the remaining time is "0:00", indicating that the time measurement has ended.

[0215] The following sections will explain the conversion of range representations.

[0216] Figure 30 is an explanatory diagram showing an example of range representation conversion according to this embodiment.

[0217] The analysis unit 111 can convert the recipe information so that it does not include range expressions if the recipe information includes range expressions.

[0218] The table shown in Figure 30 shows the correspondence between range expressions and their converted representations.

[0219] For example, a time range is associated with a lower limit of that range. Similarly, a range for a control parameter is associated with a recommended value within that range, or with a lower limit of that range.

[0220] For example, if the recipe information includes a time range expression, the analysis unit 111 can convert that time range expression into the lower limit of that range.

[0221] Furthermore, if the recipe information includes a range expression for control parameters, the analysis unit 111 can convert that range expression for control parameters into the lower limit of that range.

[0222] The following sections will explain the corrections to recipe descriptions.

[0223] Figure 31 is an explanatory diagram showing an example of a table illustrating the method for adjusting the substitute time according to this embodiment.

[0224] Figure 31 shows how to adjust the substitute time (see Figure 10).

[0225] For example, as adjustment method (1), it is indicated that the substitute time "10 minutes" corresponding to the cooking process word for the type of cooling should be changed to "5 minutes" if the phrase "with cold water" is included.

[0226] Furthermore, regarding the substitute time of "5 minutes" corresponding to the cooking processing words for the type of heating, it is indicated that if the word "tablespoon" or "teaspoon" is included, it should be changed to "2 minutes" (Adjustment Method (2-1)), if the word "until the liquid is gone" is included, it should be increased by "1 minute" (Adjustment Method (2-2)), and if "until cooked through" is included, it should be increased by "3 minutes" (Adjustment Method (2-3)).

[0227] Figure 32 is an explanatory diagram showing recipe information R2, which is an example of recipe information to be processed according to this embodiment. Figure 33 is an explanatory diagram showing an example of time correction for the cooking process according to this embodiment.

[0228] Figure 33 shows the words extracted from each cooking step in step #2 of recipe information R2 shown in Figure 32.

[0229] As shown in Figure 33, the time required for the cooking process corresponding to the cooking step "heating" is not extracted from the recipe information R2. Therefore, the analysis unit 111 sets a substitute time of "5 minutes" as the time required for the cooking process. Subsequently, since the analysis unit 111 finds that the extracted word contains the word "tablespoon", it applies correction rule (2-1) to correct the time required for the cooking process to 2 minutes.

[0230] Furthermore, the cooking process corresponding to the "stir-fry" step includes a range expression of "6 to 7 minutes." Therefore, the analysis unit 111 converts the time required for the cooking process to the lower limit of that range, which is 6 minutes. Since the cooking process in question does not meet the conditions of any correction rule, no time correction is performed.

[0231] Furthermore, the specific time required for the cooking process corresponding to the cooking step "stir-fry" is not extracted from the natural language text of the recipe information R2. Therefore, the analysis unit 111 sets a substitute time of "5 minutes" as the time required for the cooking process. Subsequently, since the extracted words include the word "tablespoon," the analysis unit 111 applies the correction rule (2-1) shown in Figure 31 to change the time required for the cooking process to 2 minutes. Furthermore, since the extracted words include the phrase "until the liquid is gone," the analysis unit 111 applies the correction rule (2-2) to change the time required for the cooking process to 3 minutes.

[0232] Figure 34 is an explanatory diagram showing recipe information 60 as an example of recipe information displayed by the recipe display system 1 according to this embodiment. The recipe information 60 is displayed on the display screen of the terminal 20 based on control by the generation unit 112.

[0233] The content of recipe information 60 is the same as that of recipe information R2. In Figure 34, icons indicating time management (icons 601 and 603, respectively) are shown to the right of time words (specifically, "1 minute" and "6-7 minutes"). In addition, for cooking processes in which no time words were extracted, icons indicating time management (icons 602 and 604, respectively) are shown to the right of cooking process words (specifically, "heat" and "stir-fry").

[0234] Icons 601-604, like icon 511 (see Figure 15), can be operated by the user. When an operation is performed on icons 601-604, the timer unit 212 starts measuring the elapsed time, and the processor 21 displays the time information.

[0235] When icon 601 is operated, the timer unit 212 starts measuring 1 minute.

[0236] Similarly, when icons 602, 603, and 604 are operated, the timer unit 212 starts measuring 2 minutes, 6 minutes, and 3 minutes, respectively (see Figure 33).

[0237] The following sections will explain variations in substitution time.

[0238] Figure 35 is an explanatory diagram showing an example of a substitute time table illustrating an example of substitute time according to this embodiment.

[0239] Figure 35 shows the boiling time for various ingredients, "potatoes" and "pumpkins," in different states.

[0240] Here, for whole potatoes with the skin on, the substitute cooking time when cooking in a pot is indicated as 25 minutes, and the substitute cooking time when cooking in a microwave is indicated as 4 minutes per potato.

[0241] Figure 36 is an explanatory diagram showing recipe information R3, which is an example of recipe information to be processed according to this embodiment.

[0242] Figure 37 shows an example of recipe information 61 and equipment control information 611 displayed by the recipe display system 1 according to this embodiment. The recipe information 61 and equipment control information 611 are displayed on the display screen of the terminal 20 based on control by the generation unit 112.

[0243] The content of recipe information 61 is the same as that of recipe information R3.

[0244] The device control information 611 is control information including combinations of cooking operations (pressurization, stirring, heating / cooling) and parameters (power, pressure, temperature, rotation speed, duration). The device control information 611 may further include time management control information. For example, when displaying a timer on the terminal, time management control information is required.

[0245] More specifically, the device control information 611 is control information indicating cooking for 4 minutes in the "simmering" mode on the range which is the cooking device 30. When the device control information 611 is operated, the terminal 20 transmits the device control information 611 to the range which is the cooking device 30.

[0246] In this way, the cooking device 30 can be controlled using the substitute time shown in FIG. 35. Also, since the time for cooking using the range (i.e., 4 minutes) is shorter than the time for cooking using a pot (i.e., 25 minutes), there is an effect of saving time for the user.

[0247] Also, the analysis unit 111 performs clause conversion processing on the recipe information.

[0248] An example of the clause conversion processing will be described while referring to FIG. 38.

[0249] FIG. 38 is an explanatory diagram showing an example of the rules of the clause conversion processing according to the present embodiment. In FIG. 38, the rule content of the clause conversion processing according to the present embodiment and the content of the clause conversion processing are shown.

[0250] For example, as rule #1, the rule content that oil is not required on the grill plate is shown. Also, as the content of the clause conversion processing of rule #1, it includes deleting descriptions such as salad oil and deleting complement words such as "a little".

[0251] FIG. 39 is an explanatory diagram showing recipe information R4 which is an example of the recipe information that is the processing target according to the present embodiment.

[0252] Figure 40 is an explanatory diagram showing recipe information 63 and equipment control information 631 as examples of recipe information and equipment control information displayed by the recipe display system 1 according to this embodiment. The recipe information 63 and equipment control information 631 are displayed on the display screen of the terminal 20 based on control by the generation unit 112.

[0253] The content of recipe information 63 was generated by the analysis unit 111, which converted the description of "frying pan" in recipe information R4 to "grill plate," and then applied the conversion process shown in Figure 38. The processing performed by the analysis unit 111 is, for example, the process shown below.

[0254] (1) Remove the phrase "a little salad oil" from recipe information R4 (Rule #1) (2) Remove the phrase "Flip over once a nice golden brown color is achieved" from recipe information R4 (Rule #3) (3) Remove the phrase "turn off the heat temporarily" from recipe information R4 (Rule #3) (4) Remove the instruction "Wipe off any excess fat from the chicken thighs with a paper towel" from recipe information R4 (Rule #4) (5) Move the instruction "Add 200ml of water, 2 tablespoons of mirin, 2 tablespoons of sake, and 2 tablespoons of sugar" from recipe information R4 to step #0 (Rule #7). (6) Remove the phrases "bring to a boil" and "simmer, stirring occasionally, until the sauce thickens" from recipe information R4 (Rule #4). (7) Remove the phrases "put the lid on" and "remove the lid" from the recipe information R4 (Rule #5) (8) Remove the phrase "turn off the heat" from recipe information R4 (Rule #3)

[0255] The device control information 631 is control information that indicates to the cooking appliance 30, the oven range, to cook for 15 minutes in "grill" mode. When the device control information 631 is accessed, the terminal 20 transmits the device control information 631 to the cooking appliance 30, the oven range.

[0256] If the user has not registered an oven range, or has only registered oven ranges that cannot generate device control information, the analysis unit 111 will generate and display time management control information instead of the device control information 631 mentioned above.

[0257] Figure 41 is an explanatory diagram showing time information 632 as an example of time management control information displayed by the recipe display system 1 according to this embodiment.

[0258] The time information 632 is a user-operable display object that includes the message "Start 15-minute timer" indicating the start of a timer that measures the time required for the cooking process, which is "15 minutes".

[0259] Furthermore, the substitute cooking times shown in Figure 31 can be calculated from the cooking words "bake," "grill," and "heat" included in recipe information R4. Also, since step 1 specifies 5 minutes, and steps 2 and 3 each specify 5 minutes of baking / heating, a 15-minute timer can be used.

[0260] Figure 42 is an explanatory diagram showing an example of time information displayed by the recipe display system 1 according to this embodiment. Figure 42 shows time information 641 to 644, which are display objects that the processor 21 sequentially displays for a cooking process in which ingredients are chilled for 30 minutes. The interiors of time information 641 to 644 are filled with predetermined colors. The interior colors of time information 641 to 644 are cool colors (more specifically, for example, purple, blue, green, indigo or navy blue, or mixtures of the above colors), in other words, colors that make the viewer feel cool or cold. Note that the color scheme does not have to be a single color, and multiple colors such as gradients may be used and reflected.

[0261] The processor 21 displays time information 641, which includes the message "30 minutes: Cooling" indicating that a timer will be started to measure the time required for the cooking process, which is "30 minutes". Time information 641 is a display object that can be manipulated by the user.

[0262] When an operation is performed on time information 641, the timer unit 212 starts measuring the elapsed time, and the processor 21 displays time information 642 showing the remaining time calculated from the elapsed time. After 30 minutes have elapsed since the operation on time information 641, the processor 21 displays time information 643, which includes "0:00" as the remaining time. Subsequently, the processor 21 displays time information 644, which includes a link to the app screen containing the recipe information. When the link included in time information 644 is operated, the display transitions to the app screen of the recipe in question, which is the destination of that link.

[0263] Figure 43 is an explanatory diagram showing time information 641A as an example of time information displayed by the recipe display system 1 according to this embodiment. The time information 641A shown in Figure 43 can be used in place of time information 641.

[0264] Time information 641A displays time information 641, which includes the message "30 minutes: Cool (-5°C)" indicating that a timer will be started to measure the time required for the cooking process, "30 minutes," in an environment with a target temperature of "-5°C."

[0265] Figure 44 is an explanatory diagram showing an example of time information displayed by the recipe display system 1 according to this embodiment. Figure 44 shows time information 651 to 654, which are display objects that the processor 21 sequentially displays for a cooking process in which ingredients are frozen for 8 hours. The interiors of time information 651 to 654 are filled with predetermined colors. The interior colors of time information 651 to 654 are cool colors (more specifically, for example, purple, blue, green, indigo or navy blue, or mixtures of the above colors), and are colors that make the viewer feel even cooler or colder than the interior colors of time information 641 to 644 shown in Figure 42. Note that the color scheme does not have to be a single color, and multiple colors such as gradients may be used and reflected.

[0266] The processor 21 displays time information 651 including a message "8 hours: Freezing" indicating that it starts a timer to measure the time "8 hours" required for the cooking process. The time information 651 is a display object that can be operated by the user.

[0267] When an operation is performed on the time information 651, the timer unit 212 starts measuring the elapsed time, and the processor 21 displays time information 652 indicating the elapsed time. When 8 hours have elapsed since an operation was performed on the time information 652, the processor 21 displays time information 653 including "8:00:00" as the elapsed time. Thereafter, the processor 21 displays time information 654 including a link to an app screen including recipe information.

[0268] FIG. 45 is an explanatory diagram showing an example of time information displayed by the recipe display system 1 according to the present embodiment. In FIG. 45, for a cooking process of baking ingredients in an oven for 20 minutes, time information 661 to 665 and an app screen 666 sequentially displayed by the processor 21 are shown. The interiors of the time information 661 to 665 are filled with a predetermined color. The color inside the time information 661 to 665 is a warm color (more specifically, for example, red, orange, yellow, or brown, etc., or a mixed color of two or more of the above colors). Note that the color inside the time information 661 to 665 may be configured to gradually change in the order of yellow, orange, and brown as it progresses from the time information 661 to the time information 665. By imitating the change in the color of the ingredients when they are heated and the process in which the charring gradually increases as the ingredients are heated, it may have the effect of making the user feel that the ingredients are being heated.

[0269] The processor 21 displays time information 661 including a message "20 minutes: Bake" indicating that it starts a timer to measure the time "20 minutes" required for the cooking process. The time information �61 is a display object that can be operated by the user.

[0270] When an operation is performed on time information 661, the timer unit 212 starts measuring the elapsed time, and the processor 21 displays time information 662 showing the remaining time calculated from the elapsed time. Twenty minutes have passed since the operation on time information 661 was performed, and the timer unit 212 displays time information 663, which includes "0:00" as the elapsed time. After heating is complete, the processor 21 displays time information 664, which includes a link to the app screen containing recipe information, and after an estimated time has elapsed, displays time information 665, which includes the message to the user, "Please check the inside of the oven!".

[0271] If a user interacts with a link included in the time information 664 or 665, terminal 20 can display a pop-up app screen 666 containing recipe information on terminal 20.

[0272] In the following section, we will describe an example in which the recipe display system 1 displays time information, notification information and icons, and outputs sound.

[0273] Figure 46 is an explanatory diagram showing an example of time information displayed by the recipe display system 1 according to this embodiment. Figure 46 shows time information 671 to 676 that the processor 21 sequentially displays for a series of cooking steps. Here, we will explain the case where it is necessary for the user to perform an action during the cooking process in which the cooking process "boiling" is executed. If the generated instruction information is time management control information, it is sufficient to simply generate a timer or to send a notification.

[0274] The processor 21 displays time information 671, which includes the message "40 minutes: boiling," indicating that it will start a timer to measure the time required for the cooking process of "boiling," which is "40 minutes." If an operation is performed on the time information 671, the timer unit 212 starts measuring the elapsed time. The processor 21 also displays time information 672, which includes the time until the user should perform the task.

[0275] When it is time for the user to perform a task, the processor 21 displays notification information 673 to inform the user that it is time to perform the task. The display of notification information 673 may include the display of an icon 673A. The icon 673A may include, for example, a graphic indicating the content of the task. More specifically, the icon 673A shown in Figure 46 includes a graphic that means putting ingredients or seasonings into the cooking appliance 30. At this time, the processor 21 may also notify the user that it is time to perform the task by outputting the voice message "It's time to work."

[0276] The processor 21 displays notification information 673, and then displays notification information 674. Notification information 674 indicates that the measurement of elapsed time has been interrupted and that the measurement of elapsed time can be resumed by pressing the "START" button provided on the housing of the cooking appliance 30. When the user presses the "START" button, the timer unit 212 resumes measuring the elapsed time, and the processor 21 displays time information 675.

[0277] When the cooking process, which involves boiling, is completed, the processor 21 displays time information 676, which includes "0:00" as the remaining time. The time information 676 also includes information to notify the user that the cooking process is complete and the dish is finished.

[0278] The display of time information 676 may include the display of icon 676A. Icon 676A may include, for example, a graphic indicating the content of the work, and more specifically, the icon 676A shown in Figure 46 includes a graphic indicating the removal of ingredients from the cooking appliance 30. At this time, the processor 21 may notify that the cooking process is finished and the dish is complete by outputting a voice message saying, "Finished. Please check if it is cooked through and remove it." The processor 21 may also display a link to a screen containing recipe information.

[0279] Figure 47 is an explanatory diagram showing time information 68 as an example of time information displayed by the recipe display system 1 according to this embodiment.

[0280] The time information 68 shows the current elapsed time in the cooking process currently underway as a progress bar 681. The progress bar 681 has an arc shape. The left end 682 of the progress bar 681 corresponds to the start timing of the cooking process, and the right end 683 corresponds to the end timing of the cooking process. The processor 21 updates the filled portion of the progress bar 681 so that it extends from left to right along the arc as time progresses.

[0281] Progress bar 681 is accompanied by icons 685 and 686, which indicate the timing of the operation. Icons 685 and 686 are the same as icons 673A and 676A in Figure 46, respectively.

[0282] Furthermore, the time information 68 may include information 687 indicating the remaining time for the cooking process, or information 688 indicating the time until the next task should be performed.

[0283] The following sections will explain how to adjust the cooking process. Adjusting the cooking process includes, for example, adjusting the cooking time according to the user's preferences.

[0284] Figure 48 is an explanatory diagram showing an example of a method for adjusting the cooking process time according to this embodiment.

[0285] Figure 48 shows how to adjust the cooking time according to the desired firmness of the ingredients after cooking.

[0286] For example, if the word representing an ingredient (also called an ingredient word) included in the extracted cooking process word is pasta, penne, udon, soba, or ramen, then it is possible to select "firm," "standard," or "soft" as the firmness of the cooked ingredient. The analysis unit 111 determines the time required for the cooking process by adjusting the time corresponding to the extracted time word (also called the extracted time) according to the selection of the firmness of the cooked ingredient.

[0287] For example, if you want the cooked ingredients to be "firm," you would multiply the extraction time by 0.8 and round the result to an integer value in minutes to determine the cooking time. Note that the above multiplier for extraction time is just an example, and you can use a value between approximately 0.5 and less than 1.

[0288] Furthermore, if the desired texture of the cooked ingredients is "softer," the extraction time is multiplied by 1.3, and the result is rounded to an integer value in minutes to determine the cooking time. Note that the above multiplier for extraction time is merely an example; a value greater than 1 and approximately 1.5 or less can be used. Alternatively, calculation methods using exponential functions or other methods besides multipliers may also be used.

[0289] Figure 49 is an explanatory diagram showing an example of recipe information 69 and time information 691, 692, and 693 displayed by the recipe display system 1 according to this embodiment.

[0290] Recipe information 69 includes the cooking process of boiling pasta. The analysis unit 111 can extract "pasta" as an ingredient word and "7 minutes" as a time word from recipe information 69.

[0291] Time information 691, 692, and 693 are display objects that can be manipulated by the user.

[0292] Time information 691 is control information that initiates the measurement of the time required for cooking, which is "6 minutes," when the cooked food is to be "firm." The cooking time of "6 minutes" is obtained by using the extraction time of 7 minutes and rounding 7 minutes × 0.8 (i.e., 5.6 minutes) to an integer value in minutes.

[0293] Time information 692 is control information that initiates the measurement of the cooking process, which takes "7 minutes," assuming the firmness of the cooked food is "standard." The cooking process, which takes "7 minutes," is the same as the extraction time.

[0294] Time information 693 is control information that initiates the measurement of the 9-minute cooking time required when the cooked food is to be "soft". The 9 minutes required for cooking is obtained by using the extraction time of 7 minutes and rounding 7 minutes × 1.3 (i.e., 9.1 minutes) to an integer value in minutes.

[0295] When an operation is performed on the time information 691, the processor 21 acquires operation information indicating that operation via the operation unit 25. Based on the acquired operation information, the processor 21 determines that an operation has been performed on the time information 691, and the timer unit 212 starts measuring the elapsed time for the 6-minute cooking process.

[0296] Similarly, when time information 692 or 693 is accessed, the timer unit 212 starts measuring the elapsed time for a cooking process of 7 minutes or 9 minutes, respectively.

[0297] In the following sections, we will explain that the time information indicates the completion time of the cooking process as a time in hours, minutes, and seconds format (more precisely, an absolute time).

[0298] Figure 50 is an explanatory diagram showing an example of time information displayed by the recipe display system 1 according to this embodiment.

[0299] Figure 50(a) shows the time information 701 displayed by the processor 21 for a cooking process in which the ingredients are chilled for 30 minutes. The time information 701 indicates the end time of the cooking process as "completion time 18:15".

[0300] Figure 50(b) shows the time information 702 displayed by the processor 21 for a cooking process in which ingredients are frozen for 8 hours. The time information 702 indicates the end time of the cooking process as "completion time 7:35".

[0301] Figure 50(c) shows the time information 703 displayed by the processor 21 for a cooking process in which the ingredients are baked for 20 minutes. The time information 703 indicates the end time of the cooking process as "completion time 17:50".

[0302] Figure 51 is an explanatory diagram showing an example of time information 71 displayed by the recipe display system 1 according to this embodiment.

[0303] The time information 71 shows the current elapsed time in the cooking process currently underway as a progress bar 711 with an arc shape.

[0304] Furthermore, the time information 71 includes information 712 indicating the end time of the cooking process and information 713 indicating the time when the next task should be performed.

[0305] The following section will explain an example of how terminal 20 displays recipe information.

[0306] Figures 52 and 53 are explanatory diagrams showing examples of recipe information displayed by the recipe display system 1 according to this embodiment.

[0307] Figure 52 shows recipe information corresponding to step #1, "Seasoning," of the multiple steps involved in the cooking process. In the recipe steps shown in Figure 52, the time information 721 is located slightly below the center in the vertical direction.

[0308] Figure 53 shows recipe information corresponding to step #2, "Browning," of the multiple steps. In the recipe steps shown in Figure 53, the time information 731 is located slightly below the center in the vertical direction.

[0309] The relative positions of time information 721 and time information 731 on the display screen are the same. In other words, in terminal 20, which displays recipe information sequentially, the display of time information (specifically, time information 721 and 731) is maintained in the same position as the recipe information progresses. In this way, terminal 20 can keep time information permanently present within the recipe information.

[0310] The following section describes the adjustment of recipe information based on user feedback. Adjusting recipe information based on user feedback includes registering the adjusted recipe information as a user when the user has cooked using the adjusted recipe information. The information displayed on the screen for the purpose of adjusting recipe information is also referred to as interactive information.

[0311] Figure 54 is an explanatory diagram showing examples of time information and dialogue information displayed by the recipe display system 1 according to this embodiment. Figure 54 shows time information 741, 743, and 744, as well as dialogue information 742, 745, and 746, which are sequentially displayed by the processor 21.

[0312] Time information 741 is time information that the processor 21 displays when a certain cooking process is completed. Time information 741 includes time information 7411 which includes "0:00" as the remaining time.

[0313] Additionally, time information 741 includes supplementary information 7412, 7413, and 7414. Supplementary information 7412 includes an icon indicating the cooking appliance 30. Supplementary information 7413 includes the message "Finished!" which notifies the user that the cooking process is complete and the dish is ready. Supplementary information 7414 includes a link and icon to the app screen showing recipe information.

[0314] Furthermore, the time information 741 includes dialogue information 7415, which includes the message "How is the cooking done?" prompting the user to input feedback (specifically, feedback on the doneness of the cooking) to the recipe display system 1. The dialogue information 7415 further includes operable buttons for feedback options: "Not enough," "Just right," and "Overcooked."

[0315] When the user presses the "Missing" button, the processor 21 displays the interaction information 742.

[0316] At this point, the processor 21 may also notify the user that the cooking process is complete and the dish is finished by outputting a voice message saying, "It's finished. Please check that it's cooked through and remove it."

[0317] Interaction information 742 includes a message prompting the user to input the heating time if extending the heating time is required, "Please select the extended heating time," and includes operable buttons for feedback options: "5 minutes," "10 minutes," "15 minutes," and "Custom setting."

[0318] When the user presses the "10 minutes" button, the processor 21 displays the message "Extended heating: 10 minutes remaining" to start measuring the elapsed time for the 10 minutes of extended heating, and displays the time information 743. At this time, the processor 21 may also notify the user that extended heating will be performed for 10 minutes by outputting the voice message "Extended heating for 10 minutes."

[0319] When 10 minutes have elapsed since the "10 minutes" button was pressed in response to the dialogue information 742, the processor 21 displays time information 744, which includes "0:00" as the elapsed time. Time information 744 includes the message "How is the cooking done?" prompting the user to provide feedback to the recipe display system 1, and includes operable buttons for feedback options: "Not cooked enough," "Just right," and "Overcooked." Time information 744 also includes the message "Extended heating is finished" to notify the user that the extended heating cooking process has ended. At this time, the processor 21 may also notify the user of the completion of the extended heating process by outputting the voice message "Extended heating is finished."

[0320] When the user presses the "just right" button, the processor 21 displays the interaction information 745.

[0321] Dialogue information 745 includes a message prompting the user to enter whether or not to register the adjusted recipe information, "Do you want to register my recipe?", and includes operable buttons as feedback options: "Register", "Register including extension", and "Do not register".

[0322] When the user clicks the "Register including extension" button, the processor 21 registers the adjusted recipe information and displays the dialogue information 746. The dialogue information 746 includes the message "Will be reflected next time" indicating that the adjustments will be reflected in the recipe information next time. At this time, the processor 21 may also notify the user by outputting the voice message "Will be reflected next time".

[0323] Figure 55 is an explanatory diagram showing examples of time information and dialogue information displayed by the recipe display system 1 according to this embodiment. Figure 55 shows time information 751 and dialogue information 752 that are sequentially displayed by the processor 21.

[0324] Time information 751 is the same as time information 741 in Figure 54.

[0325] When the user presses the "just right" button, the processor 21 displays the interaction information 752.

[0326] Dialogue information 752 includes a message prompting the user to enter whether or not to register the adjusted recipe information, "Do you want to register this recipe?", and includes operable buttons for "Register" and "Do not register" as feedback options.

[0327] When the user clicks the "Register" button, the processor 21 registers the recipe information.

[0328] Figure 56 is an explanatory diagram showing an example of time information and dialogue information displayed by the recipe display system 1 according to this embodiment. Figure 56 shows the time information 761 and dialogue information 762 to 764 that the processor 21 displays sequentially.

[0329] Time information 761 is the same as time information 741 in Figure 54.

[0330] When the user presses the "overdoing it" button, the processor 21 displays the interaction information 762.

[0331] Dialogue information 762 includes a message prompting the user to input information about the state of the ingredients when the cooking process is complete, or about the actions taken by the user, and includes operable buttons as feedback options: "Vegetables or meat were overcooked," "It was burnt," "Fewer ingredients were added than specified in the recipe," "The ingredients were cut too finely than specified in the recipe," and "None of the above apply."

[0332] When the user presses the button indicating "The vegetables and meat have fallen apart," the processor 21 displays the dialogue information 763.

[0333] Dialogue information 763 includes a message prompting the user to enter whether or not to register the recipe information, "Do you want to register this recipe?", and includes operable buttons as feedback options: "Register", "Adjust and register", and "Do not register".

[0334] When the user clicks the "Adjust and Register" button, the processor 21 displays the interaction information 764.

[0335] Dialogue information 764 includes options for how to adjust the recipe information, namely "Reduce overcooking (shorten cooking time)" and "Reduce overcooking (less stirring)," and also includes operable buttons for "Register" and "Do not register" as feedback options.

[0336] The following sections will explain the adjustments made during the cooking process.

[0337] This section describes an example where, given multiple possible means of performing a cooking process, the user selects the method that will be used to perform the cooking process.

[0338] First, we will explain an example where, in a case where there are multiple possible means of performing a cooking process to cool an object, the object is cooled using a method selected by the user.

[0339] Figure 57 is an explanatory diagram showing an example of a cooling means according to this embodiment.

[0340] As shown in Figure 57, in a cooking process that involves cooling 100 ml of liquid, several candidate methods for cooling the liquid include "leaving it at room temperature," "cooling it with cold water," "cooling it with a cooling pack," "cooling it in a refrigerator," and "cooling it in a freezer."

[0341] For example, when cooling an object by "leaving it at room temperature," if the initial temperature of the object is 80°C, the time required for the cooking process can be set to 30 minutes, and if the initial temperature of the object is 50°C, the time required for the cooking process can be set to 20 minutes.

[0342] Furthermore, when cooling an object using the cooling method "cooling with cold water," if the initial temperature of the object is 80°C, the cooking time can be reduced to 20 minutes, and if the initial temperature of the object is 50°C, the cooking time can be reduced to 15 minutes.

[0343] Furthermore, if the refrigerator or freezer owned by the user is unsuitable for cooling objects with relatively high initial temperatures (e.g., 50°C or higher) inside the refrigerator or freezer, or does not have the function to cool such objects inside the refrigerator or freezer, then the use of a refrigerator or freezer as a cooling method may be excluded.

[0344] Figure 58 is an explanatory diagram showing time information 771 to 775 as an example of time information displayed by the recipe display system 1 according to this embodiment.

[0345] Time information 771-775 are display objects that can be manipulated by the user.

[0346] Time information 771 is control information that initiates the measurement of the time required for the cooking process, which is "30 minutes," when the object is cooled using the cooling method "leaving at room temperature."

[0347] Time information 772 is control information that initiates the measurement of the time required for the cooking process, which is "20 minutes," when the object is cooled using the cooling method "cooling with cold water."

[0348] Time information 773 is control information that initiates the measurement of the time required for the cooking process, which is "15 minutes," when the object is cooled using the cooling method "cooling with a cooling pack."

[0349] Time information 774 is control information that initiates the measurement of the time required for the cooking process, which is "10 minutes," when the object is cooled using the cooling method "cooling in a refrigerator."

[0350] Time information 775 is control information that initiates the measurement of the time required for the cooking process, which is "5 minutes," when the object is cooled using the cooling method "cooling in a freezer."

[0351] When an operation is performed on the time information 771, the processor 21 acquires operation information indicating that operation via the operation unit 25. Based on the acquired operation information, the processor 21 determines that an operation has been performed on the time information 771 and starts measuring the elapsed time for the 30-minute cooking process.

[0352] Similarly, when an operation is performed on time information 772, 773, 774, or 775, the timer unit 212 starts measuring the elapsed time for a cooking process of 20 minutes, 15 minutes, 10 minutes, or 5 minutes, respectively.

[0353] In the following sections, we will describe variations of the time information display shown in Figure 58.

[0354] Figure 59 is an explanatory diagram showing time information 781 and 782 as examples of time information displayed by the recipe display system 1 according to this embodiment. Figure 59 also shows an icon 783 for switching the display.

[0355] Time information 781 and 782, as well as icon 783, are display objects that can be manipulated by the user.

[0356] Time information 781 is control information that starts measuring the time required for the cooking process, which is "10 minutes," when the object is cooled using the cooling method "cooling in a refrigerator." Time information 781 is one of the time information 771 to 775 shown in Figure 59.

[0357] Time information 782 is control information that displays a cooling method different from the cooling method shown in time information 781, in other words, a method other than the cooling method shown in time information 781. In other words, time information 782 is an icon that unfolds the folded time information (i.e., time information 784-787 in Figure 60). Time information 782 can also be said to represent time information 784-787 (see Figure 60) in a folded state.

[0358] Icon 783, like time information 782, is an icon that displays a cooling method different from the cooling method shown in time information 781, in other words, an alternative method to the cooling method shown in time information 781.

[0359] When an operation is performed on time information 781, the processor 21 acquires operation information indicating that operation via the operation unit 25. Based on the acquired operation information, the processor 21 determines that an operation has been performed on time information 771, and the timer unit 212 starts measuring the elapsed time for the 10-minute cooking process.

[0360] If an operation is performed on time information 782 or icon 783, the processor 21 determines that an operation has been performed on time information 782, as described above, and changes the display to include a cooling means that cools in a different way than the cooling means shown in time information 781 (see, for example, Figure 60).

[0361] Figure 60 is an explanatory diagram showing time information 781 and 784-787 as an example of time information displayed by the recipe display system 1 according to this embodiment. Figure 60 also shows an icon 788 for switching the display.

[0362] Time information 781 and 784-787 are display objects that can be manipulated by the user.

[0363] Time information 781 is the same as time information 781 in Figure 59.

[0364] Time information 784 is control information that initiates the measurement of the time required for the cooking process, which is "30 minutes," when the object is cooled using the cooling method "leaving at room temperature."

[0365] Time information 785 is control information that initiates the measurement of the time required for the cooking process, which is "20 minutes," when the object is cooled using the cooling method "cooling with cold water."

[0366] Time information 786 is control information that initiates the measurement of the time required for the cooking process, which is "15 minutes," when the object is cooled using the cooling method "cooling with a cooling pack."

[0367] Time information 787 is control information that initiates the measurement of the time required for the cooking process, which is "5 minutes," when the object is cooled using the cooling method "cooling in a freezer."

[0368] Icon 788 collapses the time information display 784-787. In other words, icon 788 collapses the time information from its uncollapsed state to its collapsed state (i.e., time information 782 in Figure 59).

[0369] When an operation is performed on time information 781, 784, 785, 786, or 787, the timer unit 212 starts measuring the elapsed time for a cooking process of 10 minutes, 30 minutes, 20 minutes, 15 minutes, or 5 minutes, respectively.

[0370] When an operation is performed on icon 788, the processor 21 determines that an operation has been performed on icon 788, as described above, and changes the display of time information 784-787 to a collapsed display (see, for example, Figure 59). By changing to a collapsed display in this way, information overload can be avoided on the small screen, and the effect of making selection easier for the user is achieved.

[0371] First, we will explain an example where, given multiple possible means of performing the cooking process of boiling an object, the method chosen by the user is selected for the boiling process.

[0372] An example of a method for boiling the target object is shown in Figure 35. Here, the target object is assumed to be two potatoes, whole and with the skin on.

[0373] As shown in Figure 35, in the cooking process of boiling potatoes, there are several possible methods for boiling the potatoes, including using a pot and using a microwave oven.

[0374] For example, if you boil potatoes in a pot, you can refer to "Substitute time (for pot)" of "25 minutes" (Figure 35) to set the cooking time to 25 minutes.

[0375] Furthermore, if the target ingredient, potatoes, is to be boiled in a microwave oven, the cooking time can be reduced to 8 minutes by referring to "4 minutes (per potato)" in "Substitute cooking time (microwave)" (Figure 35).

[0376] Figure 61 is an explanatory diagram showing time information 791 and 792 as examples of time information displayed by the recipe display system 1 according to this embodiment.

[0377] Time information 791 and 792 are display objects that can be manipulated by the user.

[0378] Time information 791 is control information that starts measuring the time required for "pre-boiling in the microwave (for 2 potatoes)," that is, the time of "8 minutes" required for cooking potatoes in the microwave.

[0379] Time information 792 is control information that starts measuring the time required for "parboiling in a pot (for 2 potatoes)," that is, the time "25 minutes" required for the cooking process when boiling potatoes in a pot.

[0380] When an operation is performed on the time information 791, the processor 21 acquires operation information indicating that operation via the operation unit 25. Based on the acquired operation information, the processor 21 determines that an operation has been performed on the time information 791, and the timer unit 212 starts measuring the elapsed time for the 8-minute cooking process.

[0381] Similarly, if an operation is performed on the time information 792, the timer unit 212 starts measuring the elapsed time for the 25-minute cooking process.

[0382] In the following sections, we will explain specific examples of how the recipe display system 1 obtains recipe information.

[0383] The following are some examples of how the recipe display system 1 can acquire recipe information.

[0384] (1) Obtain recipe information using the text box on the app screen.

[0385] (2) Recipe information is obtained through the text boxes for each step on the app screen.

[0386] (3) Obtain recipe information from the image of the recipe.

[0387] (4) Obtain recipe information from the source code of the web page that contains the recipe information.

[0388] The above points (1) to (4) will be explained in detail below.

[0389] (1) Obtain recipe information using the text box on the app screen.

[0390] In this method, the recipe display system 1 provides an application screen with a text box for entering recipe information. The recipe display system 1 then acquires the recipe information entered by the user in the text box on the application screen.

[0391] Figure 62 is an explanatory diagram illustrating an example of how the recipe display system 1 according to this embodiment acquires recipe information. Figure 62 shows an example of an application screen 81 provided by the recipe display system 1. The application screen 81 may be a web page display screen from a browser or a display screen from a cooking appliance. The same applies hereafter.

[0392] The application screen 81 has text boxes 811, 812, 813, 814, and 815, and an analysis button 816.

[0393] Text box 811 is the input field for the title of the recipe information.

[0394] Text box 812 is the input field for the title of the recipe information, written in kana.

[0395] Text box 813 is the input field for the introductory text of the recipe information.

[0396] Text box 814 is a field for entering information about the ingredients and quantities included in the recipe.

[0397] Text box 815 is the input field for the cooking instructions included in the recipe information. The recipe information entered in text box 815 is written in natural language.

[0398] The analysis button 816 is a button that accepts an operation from the user to have the recipe display system 1 analyze the information entered in text boxes 811 to 815. When the analysis button 816 is operated, the recipe display system 1 (more specifically, the analysis unit 111) can obtain at least the recipe information entered in text box 815.

[0399] (2) Recipe information is obtained through the text boxes for each step on the app screen.

[0400] In this method, the app screen provided by the recipe display system 1 is equipped with text boxes for entering recipe information step by step. The recipe display system 1 then acquires the step-by-step recipe information entered by the user in the text boxes on the app screen. The recipe display system 1 also acquires the complete recipe information by integrating the step-by-step recipe information.

[0401] Figure 63 is an explanatory diagram illustrating an example of how the recipe display system 1 according to this embodiment acquires recipe information. Figure 63 shows an example of an application screen 82 provided by the recipe display system 1.

[0402] The application screen 82 has text boxes 821, 822, and 823, and an analysis button 824.

[0403] Text box 821 is the input field for step #1 of the recipe information. The recipe information entered in text box 821 is written in natural language.

[0404] Text boxes 822 and 823 are input fields similar to text box 821, and are input fields for steps #2 and #3 of the recipe information, respectively.

[0405] In addition to the text boxes 821-823 mentioned above, input fields for the title or description of the recipe information (text boxes 811-814 in Figure 62) may also be included.

[0406] The analysis button 824 is the same as the analysis button 816 in Figure 62. That is, the analysis button 824 is a button that accepts an operation from the user to have the recipe display system 1 analyze the information entered in text boxes 821 to 823. When the analysis button 824 is operated, the recipe display system 1 (more specifically, the analysis unit 111) can acquire at least the recipe information entered in text boxes 821 to 823.

[0407] (3) Obtain recipe information from the image of the recipe.

[0408] In this method, recipe information is displayed on a display medium (such as a book, newspaper, or information terminal). Then, the recipe information (more specifically, the textual information of the recipe) is obtained by applying OCR processing to an image of the recipe information displayed on the display medium.

[0409] Figure 64 is an explanatory diagram illustrating an example of how the recipe display system 1 according to this embodiment acquires recipe information. Figure 64 shows an example of a book 83 as a display medium on which recipe information written in natural language is displayed.

[0410] Terminal 20 obtains an image of book 83 by taking a picture of it. Then, by applying OCR processing to the obtained image, recipe information can be acquired. Although not shown in the diagram, terminal 20 can also extract and acquire recipe information such as ingredients or cooking utensils used, in addition to the procedure or instructions.

[0411] (4) Obtain recipe information from the source code of the web page that contains the recipe information.

[0412] This method utilizes recipe information published on general web pages. Recipe display system 1 obtains the recipe information by acquiring the source code of the web page and extracting it from the source code.

[0413] Figure 65 is an explanatory diagram illustrating an example of how the recipe display system 1 according to this embodiment acquires recipe information. Figure 65 shows information 84 (specifically, the information in step #13) contained in a web page where recipe information is posted.

[0414] Information 84 includes an import button 841. The import button 841 is a button that accepts an operation from the user to import the recipe information contained in Information 84, which is included in the web page containing the recipe information. When the import button 841 is operated, the recipe display system 1 can obtain source code 842, which corresponds to Information 84. Then, the analysis unit 111 can obtain a series of recipe information written in natural language contained in source code 842 (specifically, the description "All that's left is to put the sliced ​​meat on a plate, heat the gravy sauce that the meat has been marinated in in the microwave, and pour it over the meat to finish.").

[0415] (Modified example of the embodiment) Figure 66 is a block diagram showing an example of the configuration of a recipe display system 1A according to a modified example of this embodiment. In the recipe display system 1A, the terminal 20A is equipped with the functions of the server 10 in the above embodiment.

[0416] As shown in Figure 66, the recipe display system 1A comprises a terminal 20A and a cooking appliance 30. The terminal 20A and the cooking appliance 30 are communicated together via a network N.

[0417] Terminal 20A is a terminal device, such as a computer, used by a user. Examples of terminal 20A include smartphones, tablets, or personal computers.

[0418] Terminal 20, like terminal 20A in the above embodiment, includes a processor 21, a storage unit 22, a communication IF 23, an input IF 24, an operation unit 25, and a display unit 26.

[0419] The processor 21 enables the terminal 20A to perform software functions by executing software programs. The processor 21 is, for example, a CPU. The processor 21 also realizes the function control unit 211 and the timer unit 212 by enabling the terminal 20A to perform software functions. The function control unit 211 and the timer unit 212 are the same as the function control unit 211 and timer unit 212 in the above configuration.

[0420] Furthermore, the processor 21 realizes the analysis unit 111A and the generation unit 112A by enabling the terminal 20A to perform software functions. The analysis unit 111A and the generation unit 112A are the same as the analysis unit 111 and the generation unit 112 realized by the processor 11 of the server 10 in the above embodiment.

[0421] Furthermore, the analysis unit 111A may be configured to include semantic interpretation of natural language processing based on large-scale processing technology. Also, the generation unit 112A may have the ability to generate arbitrary sentences based on semantic interpretation of natural language processing based on large-scale processing technology, and may be configured to adjust or transform sentences within a known scope.

[0422] This configuration allows the terminal 20A to generate information for controlling or configuring cooking equipment, etc., from recipe information without requiring a server 10, thereby reducing the user's workload.

[0423] (Embodiment 2) In this embodiment, another example of a recipe display system that reduces user effort by enabling the generation of information for controlling or setting cooking equipment, etc., from recipe information. The recipe display system of this embodiment reduces user effort by converting cooking equipment in recipe information and enabling the generation of information for controlling or setting cooking equipment, etc., using the converted cooking equipment in the recipe information.

[0424] Specifically, the analysis unit 111 determines that the cooking process in the cooking step can be performed using one or more cooking devices registered by the user, if the cooking process in the cooking step can be performed using an alternative cooking device that is different from the cooking device that performs the cooking process in the cooking step, and is included in one or more cooking devices registered by the user (also called registered cooking devices). Furthermore, if the analysis unit 111 determines that the cooking process in the cooking step can be performed using one or more cooking devices, it performs a conversion process to recipe information. Here, the conversion process includes converting the cooking device in the recipe information before conversion to an alternative cooking device, and converting the second information to the time it would take for the alternative cooking device to perform the cooking process. The generation unit 112 then controls the display screen to display the converted recipe information.

[0425] This allows the recipe display system to operate alternative cooking equipment registered by the user and execute the converted cooking process, even if the user has not registered the cooking equipment used in the original recipe information. The recipe display system may also prioritize the execution of the above cooking processes.

[0426] In this embodiment, components or processes that are the same as those in Embodiment 1 are denoted by the same reference numerals, and detailed descriptions may be omitted.

[0427] The configuration of the recipe display system 1 according to this embodiment is the same as the configuration of the recipe display system 1 in Embodiment 1 (see Figure 1).

[0428] An example of the processing of the recipe display system 1 according to this embodiment is similar to the processing shown in Figures 2 and 3, but differs in that it includes processing for converting cooking equipment in the recipe information. This point will be explained below.

[0429] When the server 10 analyzes the recipe information and generates instruction information in step S12, the server 10 can also convert the recipe information. If the server 10 converts the recipe information, it sends the converted recipe information to the terminal 20. The terminal 20 receives the transmitted recipe information. If the recipe information has been converted by the server 10, the recipe information displayed by the terminal 20 in step S13 is the converted recipe information received in step S12.

[0430] Figure 67 is an explanatory diagram showing an example of recipe information and control information displayed by the recipe display system according to this embodiment.

[0431] Figures 67(a) and 67(b) are the same as Figures 4(a) and 67(b) in Embodiment 1.

[0432] Examples of recipe information and command information displayed by terminal 20 are shown in Figures 67(e) and (f). In Figure 67(e), when using the registered cooking appliance list shown in Figure 13, the appliance control information 43 for controlling the oven range (oven range B), which is cooking appliance 30, is shown together with the recipe information.

[0433] Furthermore, in Figure 67(f), the time management control information 44 (also called time information) is shown together with the recipe information when using the registered cooking equipment list shown in Figure 11.

[0434] Figure 68 is a flowchart showing the processing of the server 10 according to this embodiment.

[0435] The processing of server 10 in this embodiment differs from the processing of server 10 in Embodiment 1 (see Figure 5) in that it includes a conversion process for equipment words in recipe information (step S106B). This point will be explained in detail. Other points are the same as in Figure 5, so a detailed explanation will be omitted.

[0436] If the analysis unit 111 determines in step S106 that cooking can be performed using the cooking equipment 30 (Yes in step S106), then in step S106A, the analysis unit 111 determines whether the equipment word matches the registered cooking equipment. If it determines that the equipment word matches the registered cooking equipment (Yes in step S106A), the process proceeds to step S107; otherwise (No in step S106A), the process proceeds to step S106B.

[0437] Although not shown in the diagram, a priority system may be implemented for the registered cooking equipment list, with the highest priority equipment being designated as the registered cooking equipment first. Priority may be assigned by the user, or it may be determined by the order of registration or the number of times the equipment has been used.

[0438] If no priority is set as shown in Figure 12, the cooking equipment in the original recipe information may be evaluated first, followed by other cooking equipment in the original recipe information. Alternatively, the system may be set so that evaluation is not possible if it is known that the equipment is in use. In this case, the priority may be lowered.

[0439] Furthermore, if the analysis unit 111 determines in step S106 that cooking can be performed using the cooking appliance 30 (Yes in step S106), the process may always proceed to step S106B (in other words, without performing the determination in step S106A). In that case, the process will be to replace the oven toaster with another oven toaster. At this time, if a priority is set in the cooking appliance list, the process may proceed to S106 and beyond for the registered cooking appliance that is capable of performing cooking and has the highest priority.

[0440] In step S106B, the analysis unit 111 performs a process to convert equipment words and time. Specifically, the analysis unit 111 converts the equipment word into an equipment word that indicates the cooking equipment 30 registered by the user. The analysis unit 111 also converts the cooking process word of interest into a cooking process word that corresponds to a cooking process that can be performed with the cooking equipment 30 registered by the user. Furthermore, the analysis unit 111 converts the time word extracted in step S104, or the substitute time obtained in step S111, into a time word that corresponds to the converted cooking process word. After completing the processing in step S106B, the process proceeds to step S107.

[0441] The following section will describe the recipe information conversion process performed by the analysis unit 111.

[0442] Figure 69 is an explanatory diagram showing an example of a table that shows the control information generated by the recipe display system 1 according to this embodiment and the conversion of device words.

[0443] The table shown in Figure 69 shows the cooking equipment corresponding to the equipment word, the control information, and the cooking equipment corresponding to the converted equipment word.

[0444] The analysis unit 111, using the table shown in Figure 69, can convert the equipment word to the equipment word of an alternative cooking device if the user has registered an alternative cooking device (also called an alternative cooking device) that can perform the cooking process, even if the user has not registered the cooking device used in the cooking process. The equipment registered by the user can be obtained by referring to the registered cooking device list (see Figure 9).

[0445] In addition, if a cooking appliance is not registered (i.e., the user has not registered the cooking appliance), as shown in Figure 69, the "(Not Registered)" column will be referenced.

[0446] The analysis unit 111 extracts equipment words, which represent cooking equipment, from the cooking process words extracted from the recipe information.

[0447] For example, if the device word is "oven toaster" and "oven range" is registered in the device list (see Figure 12), the analysis unit 111 generates device control information by referring to the table shown in Figure 69. At this time, the analysis unit 111 can convert the device word "oven toaster" to "oven".

[0448] Furthermore, if the device word is "range" and "Oven Range B" is registered in the device list (see Figure 12), the analysis unit 111 generates device control information by referring to the table shown in Figure 69.

[0449] Furthermore, if the device word is "frying pan" and "Oven Range B" is registered in the device list (see Figure 12), the analysis unit 111 generates device control information by referring to the table shown in Figure 69. At this time, the analysis unit 111 can convert the device word "frying pan" to "grill plate".

[0450] Alternatively, the converted device word may be the name of the registered cooking appliance (e.g., Oven Range B) or the type of registered cooking appliance (e.g., Oven Range).

[0451] The following sections will explain the conversion of control commands.

[0452] The analysis unit 111 can convert the control commands of the cooking equipment when converting the cooking equipment.

[0453] Figure 70 is an explanatory diagram showing an example of a conversion table for a cooking appliance according to this embodiment.

[0454] The table shown in Figure 70 shows the correspondence between device words and command information.

[0455] For example, if the device registered by the user is a microwave oven (microwave oven B) and the device word is "oven", and no temperature is specified, the analysis unit 111 generates command information to heat at 200°C as device control information.

[0456] The analysis unit 111 can determine, for example, that there is no temperature specified, as shown below.

[0457] The analysis unit 111 obtains "oven toaster" as the device word by analyzing the recipe information in Figure 67(b). By referring to the registered cooking device list shown in Figures 13 and 69, the analysis unit 111 can determine that the user has not registered an oven toaster and has registered oven range B, which is an alternative cooking device for an oven toaster. The fact that oven range is an alternative cooking device for an oven toaster can be obtained by referring to Figure 70. From this information, the analysis unit 111 can determine to perform the conversion shown at the top of Figure 70. Then, by analyzing the recipe information in Figure 67(b), the analysis unit 111 can determine that no temperature is specified. Therefore, the analysis unit 111 can generate the command information "If no temperature is specified: Heat at 200°C (no preheating)" as device control information.

[0458] Furthermore, if a temperature of "170°C" is specified in the recipe information, the analysis unit 111 can set the oven range to 170°C.

[0459] Furthermore, if the device registered by the user is an oven range (oven range B), and the device word is "oven," and a temperature is specified, the analysis unit 111 generates command information to heat at the specified temperature as device control information.

[0460] For example, the analysis unit 111 can convert recipe information such as "Place A in a heat-resistant dish, top with cheese, and sprinkle with 1 tablespoon of breadcrumbs. Bake in an oven at 180°C for 5-6 minutes, or until golden brown," into "Place A in a heat-resistant dish, top with cheese, and sprinkle with 1 tablespoon of breadcrumbs. Bake in a microwave oven at 180°C for 5 minutes, or until golden brown." Furthermore, if the device registered by the user is a microwave oven A, the unit can generate time management control information and convert it into similar recipe information.

[0461] Furthermore, the processor 11 may learn the characteristics of a recipe or cooking method from the presented content such as recipe information, process information, instruction information, notification information, supplementary information, and dialogue information using LLM (Large Language Model) technology, and generate utterances or feedback acceptance expressions in accordance with those characteristics. The same applies to the presented content of the voice output. In addition, the processor 11 may acquire or generate information based on recipe information, process information, or instruction information using LLM technology.

[0462] As described above, according to the recipe display system of this embodiment, if the user has not registered a cooking appliance capable of performing the cooking process, the system can operate an alternative cooking appliance registered by the user to perform the converted cooking process. The recipe display system can contribute to performing the cooking process even when the user has not registered a cooking appliance capable of performing the cooking process. Therefore, the recipe display system can further reduce the effort required of the user.

[0463] As described above, embodiments have been explained as examples of the technology in this disclosure. For this purpose, accompanying drawings and a detailed description have been provided.

[0464] Therefore, the components described in the attached drawings and detailed descriptions may include not only those components essential for solving the problem, but also components that are not essential for solving the problem, provided that the above implementation is illustrated. For this reason, the mere presence of these non-essential components in the attached drawings and detailed descriptions should not immediately be interpreted as meaning that they are essential.

[0465] Furthermore, since the embodiments described above are for illustrative purposes of the technology described herein, various modifications, substitutions, additions, omissions, etc., can be made within the scope of the claims or their equivalents. [Industrial applicability]

[0466] This disclosure can be used in cooking support systems that assist in cooking using cooking equipment. [Explanation of symbols]

[0467] 1. 1A Recipe Display System 10 servers 11, 21, 31 processors 12, 22, 32 storage section 13, 23, 33 Communication IF 20, 20A terminal 24 Input IF 25, 35 Operation section 26, 36 display section 30 Cooking equipment 34 Cooking Department 41, 43, 611, 631 Equipment control information Recipe information for 51, 55, 56, 60, 61, 63, 69, R1, R2, R3, R4 42, 44, 68, 71, 515, 521, 521A, 522, 523, 531, 532, 533, 541, 541A, 542, 543, 544, 544A, 544B, 544C, 545, 546, 547, 547A, 548, 549, 551, 571, 572, 573, 581, 582, 583, 591, 592, 593, 594, 595, 596, 597, 598, 632, 641, 641A ,642,643,644,651,652,653,654,661,662,663,664,665,671,672,675,676,691,692,693,701,702,703,721,731,741,743,744,751,761,771,772,773,774,775,781,782,784,785,786,787,791,792,5442,7411 Time information 81, 82, 666 App screen 83 Books Information 84, 687, 688, 712, 713 111, 111A analysis section 112, 112A generation section 211 Function Control Unit 212 Timer section Icons 511, 512, 513, 514, 601, 602, 603, 604, 673A, 676A, 685, 686, 783, 788 Progress bars 551A, 561, 562, 563, 564, 681, 711 673, 674 Notification Information 682 Leftmost 683 Rightmost 742, 745, 746, 752, 762, 763, 764, 7415 Dialogue Information 811, 812, 813, 814, 815, 821, 822, 823 Text boxes 816, 824 Analysis button 841 Import button 842 Source Code 5441, 7412, 7413, 7414 Supplementary Information N Network

Claims

1. An input interface for obtaining recipe information written in natural language, The analysis unit analyzes the recipe information acquired by the input interface to acquire process information including first information indicating the cooking process in the cooking process and second information indicating the time required for the cooking process. The analysis unit uses the process information acquired by the analysis unit to provide a time management function for managing the elapsed time in the cooking process, or a generation unit that generates command information for operating the cooking functions of cooking equipment that performs the cooking process, and controls the display of the generated command information together with the recipe information on the display screen. Recipe display system.

2. The generating unit is Control information is output to display the command information on the display screen as a display object that can be operated by the user. The aforementioned recipe display system further, An operation unit that receives operations on the display object displayed on the display screen, The operating unit, upon receiving the operation, includes a function control unit that activates the time management function or the cooking function according to the command information associated with the display object that is the target of the operation. The recipe display system according to claim 1.

3. The aforementioned recipe display system further, The cooking process includes a timer unit for measuring the elapsed time, The aforementioned function control unit, When the aforementioned time management function is activated, the timer unit is activated. The recipe display system according to claim 2.

4. The timer unit is The display screen displays time information including the measured elapsed time, or the remaining time in the cooking process calculated using the measured elapsed time. The recipe display system according to claim 3.

5. When the timer unit displays time information on the display screen, The figure indicating the elapsed time or the remaining time is displayed on the display screen in accordance with the string indicating the cooking process included in the recipe information. The recipe display system according to claim 4.

6. The aforementioned analysis unit, By analyzing the recipe information using natural language processing, process information is obtained, which includes first information including third information indicating the cooking equipment that performs the cooking process in the cooking process. The aforementioned recipe display system further, It is equipped with a communication interface that can communicate with the aforementioned cooking appliance, The aforementioned function control unit, When activating the cooking function, the device control information for activating the cooking function of the cooking appliance is transmitted to the cooking appliance indicated by the third information via the communication interface. A recipe display system according to any one of claims 2 to 5.

7. The aforementioned recipe display system further, It has a storage unit that stores device information indicating one or more cooking appliances registered by the user, The aforementioned analysis unit, Determine whether the cooking process in the cooking step can be performed by the one or more cooking devices. If it is determined that it is feasible, first control information is generated as command information to operate the cooking device among the one or more cooking devices that will perform the cooking process. If it is determined that the process is not feasible, second control information is generated as command information to activate the time management function that manages the elapsed time in the cooking process. The recipe display system according to claim 1.

8. The aforementioned analysis unit, If the cooking process in the cooking step can be performed by an alternative cooking device that is different from the cooking device used to perform the cooking process in the cooking step, and is included in the one or more cooking devices, then it is determined that the cooking process in the cooking step can be performed using the one or more cooking devices. If it is determined that the cooking process in the cooking step can be carried out using one or more cooking devices, the recipe information is converted into a recipe. The aforementioned conversion process is: The process includes converting the cooking equipment to the alternative cooking equipment and converting the second information to the time it takes for the alternative cooking equipment to perform the cooking process, The generating unit is The system controls the display screen to show the recipe information that has undergone the conversion process. The recipe display system according to claim 7.

9. The aforementioned recipe display system is a terminal device, The aforementioned terminal device further comprises the aforementioned display screen. The recipe display system according to claim 1.

10. The aforementioned recipe display system is A server having the analysis unit and the generation unit, The terminal device comprises the input interface and the display screen. The recipe display system according to claim 1.

11. The aforementioned recipe display system further, The cooking equipment The recipe display system according to claim 10.

12. A recipe display method that is executed by a recipe display system having an input interface using at least one processor, The aforementioned input interface acquires recipe information written in natural language, By analyzing the recipe information acquired by the input interface, process information is obtained that includes first information indicating the cooking process in the cooking process and second information indicating the time required for the cooking process. Using the acquired process information, the system generates command information to activate a time management function that manages the elapsed time in the cooking process, or a cooking function of a cooking appliance that performs the cooking process, and controls the system to display the generated command information together with the recipe information on the display screen. Recipe display method.

13. A program that causes at least one computer to execute the recipe display method described in claim 12.

Images