Cooking assistance work management system

Abstract

This invention provides a cooking assistance task management system that can eliminate feelings of unfairness regarding cooking assistance within families and eliminate imbalances in the types of tasks performed by those who help. [Solution] The management device 20 receives a voice input request from the wife, who is the one doing the cooking, to assist with the task of "shredding cabbage" via the microphone 31. The management device 20 identifies the person who can shred the cabbage from among the husband, eldest daughter, and second daughter. The management device selects the person who has helped the least number of times from the identified persons as the candidate to be asked to help. The management device transmits the name of the task, "shredding cabbage," and the name of the cooking utensil to be used for "shredding cabbage" to the communication terminals 42, 43, and 44 held by the candidate. The application 56 on the communication terminals 42, 43, and 44 displays the received name of the task and the name of the cooking utensil to be used on the touch panel 54.

Description

Technical Field

[0001] The present invention relates to a system for managing cooking assistance work that helps with cooking.

Background Art

[0002] Patent Document 1 discloses a management system for a robot that helps with housework including cooking. The person responsible for housework instructs the robot to perform housework via the management system. The robot performs housework according to the instruction.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] For example, a cook asks one of the family members to help with cutting cabbages. The person who is asked helps with cutting cabbages. The next day or after several days, when the cook asks the family member to cut cabbages again, since there was no problem when asking the person to cut cabbages before, the cook asks the previously asked person again. Due to this repetition, in the cook's mind, an image of asking a specific person to cut cabbages is formed. Then, among the family members, those who help with cooking become biased, and also the types of tasks to help with become biased. When those who help with cooking become biased, a sense of unfairness occurs within the family. Also, when the types of tasks to help with become biased, the person who helps may get bored, or it may prevent the person who helps from acquiring new skills.

[0005] The management system disclosed in Patent Document 1 cannot eliminate the sense of unfairness in helping with cooking within the family and the bias in the types of tasks to help with among those who help.

[0006] This invention has been made in view of the circumstances described above, and its purpose is to provide a means that can eliminate feelings of unfairness regarding helping with cooking within the family, and eliminate the bias in the types of tasks that those who help with cooking perform. [Means for solving the problem]

[0007] (1) The cooking assistance work management system according to the present invention comprises a controller, memory, an input interface, and an output interface. The memory stores performance information that associates member identification information that individually identifies family members who constitute a family, assistance work identification information that individually identifies assistance work related to cooking, and count information that indicates the number of times the assistance work has been performed. The controller performs a first acquisition process to acquire the assistance work identification information from the cooking executor through the input interface; a second acquisition process to acquire the member identification information and count information associated with the acquired assistance work identification information from the performance information; an assistance worker determination process that determines one of the multiple member identification information as assistance worker identification information indicating the assistance worker to be requested to perform the assistance work based on the acquired count information; a notification process that outputs the name of the assistance work indicated by the assistance work identification information acquired in the first acquisition process through the output interface, in association with the assistance worker identification information; and an update process that updates the assistance worker identification information and the count information associated with the assistance work identification information.

[0008] Assistance tasks are those related to cooking. When an assistance task is performed, the update process updates the member identification information and the number of times the assistance task is performed, associating them with the member identification information and the assistance task identification information. For example, when the assistance task of "shredding cabbage" is performed, the member identification information of the family member who performed the assistance task and the number of times the assistance task identification information for "shredding cabbage" is updated. When the person performing the cooking inputs the assistance task of "shredding cabbage" to the controller, the controller determines the assistant worker based on the updated number of times information is used in the assistant worker determination process. The determined assistant worker is notified of the name of the assistance task. In other words, the assistant worker who will be asked to help is determined based on the number of times the assistance task specified by the person performing the cooking task, such as "shredding cabbage," has been performed. Therefore, the cooking assistance task management system according to the present invention can eliminate feelings of unfairness regarding helping with cooking within a family, and can eliminate bias in the types of assistance tasks that those helping do help with.

[0009] (2) In the cooking assistance work management system described in (1) above, the assistant worker determination process may be a process that determines the member identification information of the family member who has performed the assistance work the fewest times as indicated by the count information above as the assistant worker identification information.

[0010] The cooking assistance work management system according to the present invention can request the assistance work specified by the cooking executor to be performed by the person who has performed that assistance work the fewest times.

[0011] (3) In the cooking assistance work management system described in (1) or (2) above, the memory may further store member management information that associates member identification information, assistance work identification information, and feasibility information indicating whether or not the assistance work can be performed. The assistance worker determination process is a process that determines the assistance worker identification information based on the number of times information as well as the feasibility information.

[0012] For example, if one family member is unable to shred cabbage, but several others are, and the cook designates someone to assist with shredding cabbage, then one of the family members capable of shredding cabbage is designated as the assistant based on the number of times the task has been performed. Therefore, the cooking assistance management system according to the present invention can request the assistance task designated by the cook to be performed by a person who is capable of performing that task.

[0013] (4) In the cooking assistance work management system described in any of (1) to (3) above, the memory may further store cooking utensil information which associates the assistance work identification information with cooking utensil identification information which individually identifies the cooking utensils used for the assistance work indicated by the assistance work identification information. The controller further executes a third acquisition process which acquires the cooking utensil identification information associated with the assistance work identification information acquired in the first acquisition process from the cooking utensil information. The notification process is a process which outputs the cooking utensil identification information acquired in the third acquisition process in addition to the assistance work identification information.

[0014] The cooking assistance work management system according to the present invention can enable assistant workers to recognize what cooking utensils to use and what kind of assistance work to perform.

[0015] (5) In the cooking assistance work management system described in (4) above, the assistance work identification information may include the name of the food ingredient. The cooking equipment information has food ingredient size information associated with the cooking equipment identification information. The controller further executes a food ingredient size acquisition process to acquire food ingredient size information indicating the size of the food ingredient indicated by the food ingredient name. The third acquisition process is a process of acquiring the cooking equipment identification information associated with the food ingredient size information and the assistance work identification information acquired in the food ingredient size acquisition process from the cooking equipment information.

[0016] The cooking utensils used may vary depending on the size of the ingredients. The cooking assistance work management system according to the present invention can enable the assistant worker to recognize the appropriate cooking utensils according to the size of the ingredients.

[0017] (6) The cooking assistance work management system described in (4) above may further include a first spotlight capable of changing the illumination area within a range that includes the storage location of the cooking utensils. The cooking utensil information is information that further associates the assistance work identification information and the cooking utensil identification information with storage location information indicating the storage location of the cooking utensils. The third acquisition process is a process of acquiring the storage location information associated with the assistance work identification information in addition to the cooking utensil identification information. The controller further performs a first lighting process that drives the first spotlight based on the storage location information acquired in the third acquisition process.

[0018] Cooking utensils used by assistant workers, which are stored in a designated storage area, are illuminated by a first spotlight. Therefore, the cooking assistance work management system according to the present invention can prevent assistant workers from mistakenly using other cooking utensils.

[0019] (7) The cooking assistance work management system described in any of (1) to (6) above may further include a second spotlight capable of changing the illumination area within a range including the cooking area, and a first camera whose imaging area is the cooking area. The assistance work identification information includes the name of the food ingredient. The controller further performs a food ingredient location acquisition process, which acquires food ingredient location information, which is the location of the food ingredient indicated by the food ingredient name acquired in the first acquisition process, based on the first captured image data generated by the first camera, and a second lighting process, which drives the second spotlight based on the acquired food ingredient location information.

[0020] Based on the first image data captured by the first camera, the location of the food ingredient is identified, and light is shone on the identified location to illuminate the food ingredient. Therefore, the cooking assistance work management system according to the present invention can prevent an assistant worker from mistakenly cooking the wrong food ingredient.

[0021] (8) The cooking assistance work management system described in (6) above may further include a second spotlight capable of changing the illumination area within a range including the cooking area, a first camera whose imaging area is the cooking area, and a second camera whose imaging area is the storage area. The controller further performs a determination process to determine whether the cooking utensils are present in the storage area based on the second image data generated by the second camera, and performs the first lighting process if the cooking utensils are present in the storage area. If the cooking utensils are not present in the storage area, the controller further performs a fourth acquisition process to acquire usage position information indicating the location of the cooking utensils based on the first image data generated by the first camera, and a third lighting process to drive the second spotlight based on the acquired usage position information.

[0022] If cooking utensils are in their storage location, the utensils in the storage location are illuminated. If cooking utensils are not in their storage location but in the cooking area, the utensils in the cooking area are illuminated. Therefore, the cooking assistance work management system according to the present invention allows the assistant worker to immediately find the cooking utensils they use, even if those utensils have been moved from their storage location to the cooking area.

[0023] (9) In the cooking assistance work management system described in any of (1) to (8) above, the controller may further perform a fifth acquisition process to acquire home information indicating whether the family member indicated by the member identification information is at home or not. The assistant worker determination process is a process that determines the assistant worker identification information based on the home information in addition to the number of times information.

[0024] The cooking assistance work management system according to the present invention can determine an assistant worker from among the family members at home.

[0025] (10) The cooking assistance work management system according to (4) above may further include the communication terminal possessed by the family member, and the communication terminal having a display. The controller further executes a display process of displaying, on the display, the assistance work indicated by the assistance work identification information output in the notification process and the cooking appliance indicated by the cooking appliance identification information.

[0026] On the display of the communication terminal possessed by the family member, the assistance work designated by the cook and the cooking appliance used for the assistance work are displayed. Therefore, the cook does not need to explain to the person who helps what kind of cooking appliance should be used, and the burden on the cook is reduced. In addition, the person who helps can easily recognize what kind of cooking appliance should be used.

Effect of the Invention

[0027] The cooking assistance work management system according to the present invention can eliminate the sense of unfairness in helping with cooking within the family and eliminate the bias in the types of work to be done by the person who helps.

Brief Description of the Drawings

[0028] [Figure 1] FIG. 1 is a configuration diagram and a functional block diagram of the cooking assistance work management system 10. [Figure 2] FIG. 2 is a perspective view of the kitchen 60. [Figure 3] FIG. 3 is a cross-sectional view of the kitchen 60. [Figure 4] FIG. 4 is a front view of the sink storage 68 with the doors 101 and 102 open. [Figure 5] FIG. 5 is a diagram showing the user management database. [Figure 6] FIG. 6 is a diagram showing the cooking appliance management database. [Figure 7] Figure 7 shows the performance management database. [Figure 8] Figure 8 is a flowchart showing the registration process. [Figure 9] Figure 9 is a flowchart showing the assistance management process. [Figure 10] Figure 10(A) shows the main registration screen, and Figure 10(B) shows the first detailed cooking item registration screen. [Figure 11] Figure 11(A) shows the registration details screen, and Figure 11(B) shows the cooking appliance registration screen. [Figure 12] Figure 12(A) shows the assistance request screen, and Figure 12(B) shows the cooking utensil notification screen. [Modes for carrying out the invention]

[0029] Embodiments of the present invention will be described below. It goes without saying that the embodiments described below are merely examples of the present invention, and the embodiments of the present invention can be modified as appropriate without changing the gist of the invention. In addition, the execution order of each process (each step) in the flowcharts shown in Figures 8 and 9 may be changed as appropriate without changing the gist of the present invention, some may be omitted, other processes may be added, or other equivalent processes may be substituted.

[0030] [Overview of Cooking Assistant Work Management System 10] The cooking assistance management system 10 (see Figure 1) described in this embodiment is a system that provides a resident with a service that allows them to request assistance with cooking-related tasks from other residents on behalf of the resident who is cooking in their home. This assistance is what is commonly known as "helping out."

[0031] The cooking assistance work management system 10 provides services to residents of a residence, for example, by utilizing a management device for equipment installed in the residence. Examples of equipment installed in a residence include air conditioning systems, lighting systems, and intercom systems. Alternatively, the cooking assistance work management system 10 provides services to residents using personal computers or communication terminals owned by the residents. The service provider provides the service to residents by implementing the program related to the cooking assistance work management system 10 on the management device, personal computer, or communication terminal.

[0032] The service provider is, for example, a company that built a house. The service provider offers services using the cooking assistance work management system 10 as one of the various services offered to the homeowner and their family. These various services include, for example, services related to home maintenance and services that support comfortable living in the home. The cooking assistance work management system 10 is operated in conjunction with other systems that provide other services. For example, the cooking assistance work management system 10 provides data used by other systems to those other systems. Alternatively, the cooking assistance work management system 10 acquires data necessary for operation from other systems. In other words, the cooking assistance work management system 10 also functions as a data collection system for other systems.

[0033] However, the cooking assistance work management system 10 may be operated as a standalone system, or it may be provided to residents by a business other than the business that built the house.

[0034] In this embodiment, a cooking assistance work management system 10 that utilizes a management device 20 of an intercom system 12, which is an attached facility in a house, is described.

[0035] The intercom system 12 includes a front door camera 13 and a management device 20. The front door camera 13 and the management device 20 are connected to a local area network 11 (hereinafter also referred to as LAN 11) attached to the house. LAN 11 is a so-called wired LAN or wireless LAN. LAN 11 includes a switching hub or router (not shown). The management device 20 controls the operation of the front door camera 13 via LAN 11 and receives the captured image data output by the front door camera 13.

[0036] The entrance camera 13 is installed in the entrance (not shown). The entrance camera 13 captures images of visitors and residents leaving and returning home, and outputs the captured image data.

[0037] The management device 20 individually identifies each resident who has left or returned home based on the image data captured by the entrance camera 13 and sample image data (not shown) of each resident's face pre-stored in the management memory 22, which will be described later. The management device 20 stores information indicating whether a resident is at home or out in the management memory 22. In other words, the intercom system 12 has a function to manage whether residents are at home or out.

[0038] The intercom system 12 may also have a touch panel installed at the entrance. When a resident leaves the house, they input their name and an indication that they are leaving via the touch panel into the intercom system 12. When a resident returns home, they input their name and an indication that they have returned home via the touch panel into the intercom system 12. Based on this input, the intercom system 12 manages whether the resident is home or not.

[0039] [Configuration of Cooking Assistance Work Management System 10] The cooking assistance work management system 10 includes a management device 20, a microphone 31, a speaker 32, a first camera 33, multiple second cameras 34, a spotlight 35, a spotlight 36, and multiple spotlights 37. The cooking assistance work management system 10 also includes a first communication terminal 41, a second communication terminal 42, a third communication terminal 43, and a fourth communication terminal 44. The first communication terminal 41, the second communication terminal 42, the third communication terminal 43, and the fourth communication terminal 44 are incorporated into the cooking assistance work management system 10 by downloading the application program 56 described later.

[0040] The microphone 31 and speaker 32 are installed in the kitchen 60 shown in Figure 2. The kitchen 60 includes a sink 61, a stovetop 62, a gas stove 63, a workbench 64, overhead cabinets 65, a range hood 66, and an overhead rack 67. The sink 61, stovetop 62, and workbench 64 are installed facing the wall 91 of the kitchen 60. The microphone 31 and speaker 32 are mounted on the wall 91. The microphone 31 and speaker 32 are connected to the LAN 11 shown in Figure 1. The microphone 31 and speaker 32 communicate with the management device 20 via the LAN 11.

[0041] Microphone 31 converts the voice of the resident cooking in the kitchen 60 (hereinafter also referred to as the "cooking operator") into audio data and outputs it. The output audio data is input to the management device 20 via LAN 11. Microphone 31 is used to input voice instructions from the cooking operator to the management device 20. Microphone 31 is an example of an input interface.

[0042] Speaker 32 outputs audio corresponding to the audio data input from the management device 20 via the LAN 11. Speaker 32 is used to notify the cooking operator of information from the management device 20. Speaker 32 is an example of an output interface.

[0043] The first camera 33 and the multiple second cameras 34 are connected to the LAN 11. The first camera 33 and the second cameras 34 perform imaging based on control signals input from the management device 20 via the LAN 11. The image data generated by the first camera 33 and the second cameras 34 is input to the management device 20 via the LAN 11. The first camera 33 and the multiple second cameras 34 are individually identified by camera identification IDs. These camera identification IDs are input to the management device 20 along with the image data. The management device 20 determines which camera the input image data originated from based on the camera identification IDs attached to the image data.

[0044] As shown in Figure 3, the first camera 33 is installed on the ceiling 92 of the kitchen 60. The first camera 33 images the area including the sink 61, stovetop 62, workbench 64, and hanging rack 67 from above. The first camera 33 images cooking utensils such as a large cutting board 73, a large deba knife 75, a small bowl 78, a small colander 80, and a frying pan 88 placed on the sink 61, gas stove 63, workbench 64, and hanging rack 67. The first camera 33 also images ingredients such as cabbage 95 and potatoes 96 placed on the sink 61 and workbench 64. The image data generated by the first camera 33 is used to determine the position of cooking utensils and ingredients in the control device 20. The image data is also used to determine the size of the ingredients in the control device 20. More details will be described later. The first camera 33 may be a so-called stereo camera consisting of two cameras arranged at a predetermined distance apart so as to be able to identify the size of the food ingredients, or it may be a three-dimensional laser sensor camera.

[0045] One of the multiple second cameras 34 is installed in a storage area for cooking utensils, such as inside the sink cabinet 68 or drawer 69 shown in Figure 4. The sink cabinet 68 has double doors, left 101 and right 102, a bottom plate 103, a lower shelf 104, an upper shelf 105, a top plate 106, a knife rack 107, and a cutting board rack 108. The knife rack 107 accommodates various knives, such as a small deba knife 74, a large deba knife 75, a Chinese cleaver 76, and a sashimi knife 77. The cutting board rack 108 accommodates cutting boards of various sizes, such as a small cutting board 71, a medium cutting board 72, and a large cutting board 73.

[0046] The second camera 34 is attached to the front end of the top plate 106. The second camera 34 installed inside the sink storage unit 68 has the front of the upper shelf 105 and lower shelf 104, and the front of the bottom plate 103 as its imaging area. The second camera 34 images the small bowl 78, large bowl 79, small colander 80, and large colander 81 placed on the upper shelf 105, a portion of the small frying pan 82, medium frying pan 83, and large frying pan 84 placed on the lower shelf 104, and a portion of the milk pan 85, small pot 86, large pot 87, and steamer 89 placed on the bottom plate 103. In addition, three second cameras 34 may be installed inside the sink storage unit 68: a second camera 34 for imaging the bottom plate 103, a second camera 34 for imaging the lower shelf 104, and a second camera 34 for imaging the upper shelf 105. Alternatively, a mirror may be attached to the left door 101 or the right door 102. The second camera 34 captures images of each stored cooking utensil through the mirror.

[0047] A second camera 34, installed in another storage location such as drawer 69, captures images of cooking utensils such as peelers and slicers stored in that location.

[0048] The image data generated by the second camera 34 is used to determine whether cooking utensils are present in each storage area. More details will be provided later.

[0049] As shown in Figure 3, spotlights 35 and 36 are mounted on the ceiling 92 of the kitchen 60. The ignition devices (not shown) for spotlight 35 and spotlight 36 are connected to the commercial power supply and LAN 11 installed in the house. Spotlights 35 and 36 are turned on and off based on control signals input from the management device 20 via LAN 11.

[0050] Spotlights 35 and 36 have the function of changing the direction of the light they emit. Spotlights 35 and 36 emit light in a direction corresponding to the specified direction information included in the control signal input from the control device 20. Spotlight 35 is used to illuminate cooking utensils placed on the sink 61, gas stove 63, and workbench 64. Spotlight 36 is used to illuminate food ingredients placed on the sink 61 and workbench 64. More details will be described later. Spotlight 36 is an example of a second spotlight.

[0051] The spotlight 37 has a function to change the direction of the light it emits. The spotlight 37 emits light in a direction corresponding to the specified direction information included in the control signal input from the control device 20.

[0052] Multiple spotlights 37 are installed in storage areas for cooking utensils, such as inside the sink cabinet 68 and drawers 69 shown in Figure 4. Spotlights 37 installed inside the sink cabinet 68 illuminate the cooking utensils placed on the bottom plate 103, the lower shelf 104, and the upper shelf 105 individually. Alternatively, three spotlights 37 may be installed inside the sink cabinet 68: one spotlight 37 to illuminate the cooking utensils on the bottom plate 103, one spotlight 37 to illuminate the cooking utensils on the lower shelf 104, and one spotlight 37 to illuminate the cooking utensils on the upper shelf 105 individually. Spotlight 37 is an example of a first spotlight.

[0053] Spotlights 37 installed in other storage areas, such as drawer 69, illuminate individual cooking utensils such as peelers and slicers stored in those areas.

[0054] [Communication terminals 41, 42, 43, 44] The communication terminals 41, 42, 43, and 44 shown in Figure 1 are communication terminals owned by family members (residents) who are members of the family to whom the cooking assistance work management system 10 provides services. Communication terminals 41, 42, 43, and 44 are, for example, smartphones (registered trademark), tablets (registered trademark), or personal computers.

[0055] In this embodiment, an example is described in which the family consists of a wife, husband, eldest daughter, second daughter, and eldest son. The wife possesses the first communication terminal 41, the husband possesses the second communication terminal 42, the eldest daughter possesses the third communication terminal 43, and the second daughter possesses the fourth communication terminal 44. The eldest son is too young to possess a communication terminal.

[0056] Communication terminals 41, 42, 43, and 44 are used for various registrations, including the registration of cooking performers, the registration of those who perform auxiliary tasks related to cooking (hereinafter also referred to as auxiliary workers), the registration of auxiliary tasks that auxiliary workers can perform, and the registration of the correspondence between auxiliary tasks and cooking equipment. Furthermore, communication terminals 41, 42, 43, and 44 are used for notifying requests for auxiliary tasks. Further details will be described later.

[0057] The first communication terminal 41 comprises a central processing unit (CPU) 51, terminal memory 52, communication interface 53, touch panel 54, and a communication bus (not shown). The communication bus connects the CPU 51 to the terminal memory 52, communication interface 53, and touch panel 54 in a communicative manner.

[0058] The terminal memory 52 is composed of, for example, ROM, RAM, and EEPROM, and other memory elements. The terminal memory 52 may be composed of any type of memory element.

[0059] Terminal memory 52 stores the operating system OS 55, the downloaded application program 56 (hereinafter also referred to as "app 56"), and the resident ID. App 56 is provided to each family member by the service provider. Family members download App 56 to communication terminals 41, 42, 43, and 44, for example, from a website. The resident ID is an example of member identification information that identifies each family member individually. The resident ID is downloaded together with App 56 and stored in terminal memory 52. ​​App 56, together with the management program 26 described later, executes the processes (flows) shown in Figures 8 and 9.

[0060] The communication interface 53 is, for example, a short-range wireless communication module such as Wi-Fi. The first communication terminal 41 communicates with the management device 20 via the LAN 11.

[0061] The touch panel 54 has a display and a transparent film-like touch sensor superimposed on the display. The touch panel 54 is an example of an input interface and an output interface. The first communication terminal 41 may also have a microphone that accepts voice input as an input interface. The first communication terminal 41 may also have a speaker that outputs voice as an output interface. The touch panel 54 is an example of a display.

[0062] The second communication terminal 42, the third communication terminal 43, and the fourth communication terminal 44, like the first communication terminal 41, are equipped with a CPU 51, terminal memory 52, a communication interface 53, and a touch panel 54. The terminal memory 52 of the second communication terminal 42, the third communication terminal 43, and the fourth communication terminal 44 stores the OS 55, applications 56, and resident IDs, just like the first communication terminal 41.

[0063] [Management device 20] The management device 20 comprises a central processing unit (CPU) 21, a management memory 22, a communication interface 23, and a communication bus (not shown). The communication bus connects the CPU 21, the management memory 22, and the communication interface 23 in a communicative manner. The CPU 21 is an example of a controller. The CPU 21 and CPU 51 are also examples of controllers. The management memory 22 is an example of memory. The management memory 22 and terminal memory 52 are also examples of memory.

[0064] The communication interface 23 is connected to the LAN 11 by a communication cable or short-range wireless communication. The management device 20 communicates with the microphone 31, speaker 32, cameras 33, 34, spotlights 35, 36, 37, and communication terminals 41, 42, 43, 44 through the communication interface 23 and the LAN 11. The communication interface 23 is an example of an output interface.

[0065] The management memory 22 is composed of, for example, ROM, RAM, EEPROM, hard disk drives, solid-state drives, USB memory, and other memory elements and storage devices.

[0066] The management memory 22 stores the operating system OS 25, management programs 26, control programs 27, a management database, various screen formats, various sample image data, various audio data, various reference video data, and various thresholds.

[0067] Various screen formats are format data for generating screen data. A screen format is, for example, a class that generates screen data as an object by receiving input information. The generated screen data is, for example, HTML data containing JavaScript. A screen format can also be the screen data itself.

[0068] The various sample image data includes image data generated by pre-imagering cooking utensils. The sample image data is used to identify cooking utensils that appear in the images captured by the first camera 33 and the second camera 34. The various sample image data also includes image data showing images of ingredients such as cabbage 95 and potatoes 96. The sample image data is used to identify ingredients that appear in the images captured by the first camera 33 and to determine the size of those ingredients.

[0069] Various audio data include audio data input to speaker 32 installed in kitchen 60. The audio output from this audio data is, for example, "Sakura Yamada will be doing the julienne cutting of cabbage."

[0070] The various reference video data includes videos of shredding cabbage and stir-frying ingredients, which are useful for assistant workers who lack cooking skills. The reference video data is transmitted from the management device 20 to the notification terminal held by the assistant worker. Further details will be provided later.

[0071] The control program 27 is a program that manages the intercom system 12. The control program 27 determines whether a family member is leaving or returning home based on the image of the family member captured by the entrance camera 13. The control program 27 stores information indicating whether each family member is at home or not in the management memory 22.

[0072] The management program 26, together with the application 56, executes the processing (flow) shown in Figures 8 and 9 based on the captured image data generated by the first camera 33 and the second camera 34 and the information registered in the management database. Further details will be described later.

[0073] The management database includes the user management database shown in Figure 5, the cooking equipment management database shown in Figure 6, and the performance management database shown in Figure 7. The management database has data that displays tables, and programs that register information into and read information from the tables. The management program 26 instructs the program to read and register information through the OS 25. The program may be part of the management program 26.

[0074] [User Management Database] The user management database shown in Figure 5 is a database that manages information about family members.

[0075] The user management database has multiple columns and records named "Resident ID," "Name," "Gender," "Age," "Cook Flag," "Assistant Flag," "Number of Cooking Sessions," "Total Number of Assistance Sessions," "Communication Address," "Home Flag," "Permission / Rejection Flag," and "Cooking Item."

[0076] The field in the column named "Resident ID" will be used to register the aforementioned Resident ID. Each record, i.e., each family member, is individually identified by the Resident ID. The Resident ID is registered in the user management database by the management program 26, which receives input from the service provider or family member.

[0077] The field in the column named "Name" registers the name of each family member. The field in the column named "Gender" registers the gender of each family member. The field in the column named "Age" registers the age of each family member. The name, gender, and age are registered in the user management database by the management program 26, which receives input from the service provider or family member. The name of each family member is an example of member identification information that identifies each family member individually.

[0078] Columns named "Cook Flag" are assigned either a "1" cook flag indicating that the cook is the one who performed the cooking, or a "0" cook flag indicating that the cook is not the one who performed the cooking. In the example shown in Figure 5, a "1" cook flag is registered for the wife, "Yamada Hanako," while a "0" cook flag is registered for the husband, "Yamada Taro," the eldest daughter, "Yamada Kazumi," the second daughter, "Yamada Sakura," and the eldest son, "Yamada Ichiro." In other words, the wife, "Yamada Hanako," is registered as the one who performed the cooking. The cook flag is registered in the user management database by the management program 26, which receives input from the family members.

[0079] Columns named "Assistant Worker Flag" are assigned either a "1" flag indicating that the person is capable of performing the assisting task, or a "0" flag indicating that the person is not capable of performing the assisting task. In the example shown in Figure 5, the wife, husband, eldest daughter, and second daughter are assigned an "1" flag, while the eldest son, "Ichiro Yamada," is assigned an "0" flag. This indicates that the wife, husband, eldest daughter, and second daughter are capable of assisting with cooking, while the eldest son is not. The management program 26 selects an assisting family member from among those assigned an "1" flag, excluding the person performing the cooking. More details will be provided later.

[0080] The column named "Cooking Count" records the number of times a cook has performed a task. The period for which the Cooking Count is counted is one month, one year, the period from January 1st to the present, or the period from when the service was provided to the present. For example, if the period for which the Cooking Count is counted is one month, the Cooking Count for the previous month will be reset at the end of the month.

[0081] The column named "Total Number of Helping Assistances" registers the total number of helping assistances, which is the sum of the number of times the person assisted as a cook and the number of times they assisted as an assistant. The period for which the total number of helping assistances is counted is one month, one year, the period from January 1st to the present, or the period from when the service was provided to the present. The total number of helping assistances is used by the management program 26 when deciding who to request assistance from. If there are multiple candidates for those to be requested to assist, the management program 26 will select the person with the fewest total helping assistances to be requested to assist. Note that the number of times the person assisted as a cook is added to the total number of helping assistances to prevent a person who frequently cooks from being selected as a request for assistance if they occasionally step away from cooking duties and their number of helping assistances is low. The total number of helping assistances is an example of the number of times assistance work is performed.

[0082] The column named "Communication Address" registers the communication addresses of communication terminals 41, 42, 43, and 44. Specifically, the communication address of the first communication terminal 41 owned by the wife is registered in association with the wife's resident ID, the communication address of the second communication terminal 42 owned by the husband is registered in association with the husband's resident ID, the communication address of the third communication terminal 43 owned by the eldest daughter is registered in association with the eldest daughter's resident ID, and the communication address of the fourth communication terminal 44 owned by the second daughter is registered in association with the second daughter's resident ID. The communication addresses are transmitted to the management device 20 by the application 56 downloaded to communication terminals 41, 42, 43, and 44, and registered in the user management database by the management program 26.

[0083] A column named "At Home Flag" registers either a "1" flag indicating that the user is at home, or a "0" flag indicating that the user is absent. The At Home Flag is registered in the user management database by the management program 26, which reads the at-home information from the management memory 22. The At Home Flag is used by the management program 26 when determining which assistant worker should be asked to provide assistance. The At Home Flag is an example of at-home information.

[0084] Columns named "Approval / Rejection Flag" register either an approval / rejection flag of "1" indicating that the requested assistance has been refused, or an approval / rejection flag of "0" which is the initial value. The approval / rejection flag prevents further requests for assistance from being made to family members who have refused the requested assistance. The management program 26 determines which assistant to request assistance from among the family members who have registered an assistant flag of "1", a home-based flag of "1", and an approval / rejection flag of "0".

[0085] The column named "Cooking Item" includes multiple sub-columns named "Preparation," "Main Cooking," "Intermediate Cleanup," and "Post-Cleaning" (not shown).

[0086] The sub-column labeled "Preparation" further contains several sub-columns labeled with ingredient names such as "Cabbage," "Potato," and "Fish."

[0087] The sub-column labeled "Cabbage" further comprises several sub-columns labeled with processing method names such as "Chopped" and "Shredded." The column labeled "Potato" further comprises several sub-columns labeled with processing method names such as "Peeled," "Round / Half-moon / Ginkgo," "Minced," "Wedge-cut," and "Sliced." The sub-column labeled "Peeled" further comprises two sub-columns labeled "Large" and "Small." The name "Large" indicates that the potato is large. The name "Small" indicates that the potato is small. Sub-columns are provided for each size of ingredient because the cooking utensils used may vary depending on the size of the ingredient. For example, the skin of a large potato is peeled with a peeler. The skin of a small potato is peeled with a knife.

[0088] The names "ring," "half-moon," and "ginkgo" refer to slices cut into rings, half-moons, and ginkgo leaves, respectively. The name "minced" refers to minced food. The name "wedge cut" refers to cut food into wedges. The name "sliced" refers to thinly slicing the potato, which is an ingredient.

[0089] The subcolumn labeled "Fish" further comprises several subcolumns labeled with names of processing methods such as "Scale Removal" and "Filleting." "Scale Removal" means removing the scales from a fish. "Filleting" means cutting a fish into three pieces. Furthermore, the subcolumns labeled "Scale Removal" and "Filleting" further comprise two subcolumns labeled "Large" and "Small." For example, a scale remover is used to remove the scales from large fish such as sea bream, while a knife is used to remove the scales (scuttlefish bones) from small fish such as small horse mackerel. A large deba knife is used to fillet a large fish, and a small deba knife is used to fillet a small fish.

[0090] The column labeled "Main Cooking" has multiple sub-columns labeled with names of cooking methods such as "Stir-fry," "Grill," "Heating," "Boil," and "Steam." "Stir-fry" means stir-frying ingredients using a frying pan or other cooking utensil. "Grill" means grilling or roasting ingredients using a grill, oven, or roaster. "Boil" means boiling ingredients using a pot or other cooking utensil. "Steam" means steaming ingredients using a steamer or other cooking utensil.

[0091] The column labeled "Intermediate Cleanup" includes multiple sub-columns labeled with cleanup names such as "Ball Washing" and "Knife Washing." "Ball Washing" means washing the balls and storing them in their designated storage places. "Knife Washing" means washing the knives and storing them in their designated storage places.

[0092] Examples of auxiliary tasks related to cooking, and auxiliary task identification information that identifies each of these auxiliary tasks, include "shredding cabbage" or "shredding," "peeling potatoes" or "peeling potatoes," "scaling fish," "filleting fish," "stir-frying," and "washing bowls."

[0093] The fields in the column named "Cooking Item" are assigned a "0" or "1" feasibility flag. A "1" feasibility flag indicates that the person has the ability to perform the auxiliary task. A "0" feasibility flag indicates that the person does not have the ability to perform the auxiliary task. In the example shown in Figure 5, for the husband, "Yamada Taro," a "0" feasibility flag is assigned to the fields in the sub-columns named "Filleting" and "Large," while a "1" feasibility flag is assigned to the other fields. This indicates that the husband, "Yamada Taro," does not have the ability to perform the auxiliary task of filleting a large fish, but does have the ability to perform other auxiliary tasks. Similarly, for the eldest daughter, "Yamada Kazumi," a "0" feasibility flag is assigned to the fields in the sub-columns named "Filleting" and "Stir-fry," while a "1" feasibility flag is assigned to the other fields. The eldest daughter, Kazumi Yamada, is shown to be unable to perform tasks such as filleting fish and assisting with stir-frying, but is capable of performing other assisting tasks.

[0094] The availability flag is used to determine who will be asked to provide assistance. The management program 26 selects family members who have registered the "1" assistant flag, "1" home-based flag, "0" permission / denial flag, and "1" availability flag as candidates. From the selected candidates, the management program 26 determines the person with the fewest total assistance requests to be the assistant who will be asked to provide assistance. More details will be provided later. The availability flag is an example of information on whether something can be done. The user management database is an example of member management information.

[0095] [Cooking Utensil Management Database] The cooking equipment management database shown in Figure 6 is a database that associates the aforementioned cooking items with cooking equipment.

[0096] The cooking equipment management database consists of multiple columns (rows) labeled with names such as "Equipment ID," "Equipment Name," "Storage Location Information," and "Cooking Item."

[0097] The field in the column named "Equipment ID" registers the equipment ID. The field in the column named "Equipment Name" registers the name of the equipment, such as a large cutting board, a small deba knife, a large peeler, or a slicer. Each cooking utensil is individually identified by either the equipment ID or the equipment name. The equipment ID, or the equipment name which is the name of the cooking utensil, is an example of cooking utensil identification information. The cooking utensil management database is an example of cooking utensil information.

[0098] The field in the column named "Storage Location Information" registers storage location information indicating the storage location of cooking utensils in the kitchen 60. This storage location information is, for example, a 3D coordinate system with the corner of the kitchen floor 60 as the origin. Alternatively, it may be information indicating the sink storage unit 68 and a 3D coordinate system with the corner of the bottom plate 103 of the sink storage unit 68 as the origin. Or, it may be information indicating the drawer 69 and a 3D coordinate system with the corner of the drawer 69 as the origin. This storage location information is used for lighting cooking utensils with spotlights 35 and 37. Further details will be provided later.

[0099] A column named "Cooking Item" has multiple sub-columns with names similar to those in the user management database. Each field in these sub-columns is assigned a cooking utensil flag of "0" or "1". A cooking utensil flag of "0" indicates that no cooking utensils are used. A cooking utensil flag of "1" indicates that cooking utensils are used. For example, a cooking utensil flag of "1" is assigned to "Chopped Cabbage" and "Large Cutting Board" and "Large Deba Knife". This indicates that "Chopped Cabbage" is done using a large cutting board and a large deba knife. Similarly, a cooking utensil flag of "1" is assigned to "Shredded Cabbage" and "Large Peeler" and "Large Colander / Bowl". This indicates that "Shredded Cabbage" is done using a large peeler, a large colander, and a large bowl.

[0100] Cooking utensils registered in the cooking utensil management database are pre-registered as format data. Furthermore, new cooking utensils may be added or registered cooking utensils may be deleted by inputting data into the management device 20 by family members. Storage location information for cooking utensils is also entered into the management device 20 by family members and registered in the cooking utensil management database. Cooking utensil flags are also pre-registered in the cooking utensil management database as format data, or entered into the management device 20 by family members and registered in the cooking utensil management database. Further details will be described later.

[0101] [Performance Management Database] The performance management database shown in Figure 7 is a database that registers the detailed number of times each family member has performed auxiliary tasks as a helper.

[0102] The performance management database consists of multiple columns (rows) labeled with names such as "Resident ID," "Name," and "Cooking Item," as well as records (rows).

[0103] The column named "Cooking Item" has multiple sub-columns with the same names as the user management database. The fields in these sub-columns register the number of times each family member has performed a chore. In other words, the detailed number of times each family member has performed a chore is registered for each detailed item, such as "shredding cabbage." Note that the performance management database does not have sub-columns named "large" and "small" to indicate the size of the ingredients. For example, the detailed number of times a small potato was peeled and the detailed number of times a large potato was peeled are added together and registered in the performance management database.

[0104] The detailed number of times each person has helped with an action, registered in the performance management database, is used by the management program 26 to determine who should be asked to help. For example, if the cooking executor inputs the instruction to "shred cabbage" through the speaker 32, the management program 26 will determine that the second daughter, "Sakura Yamada," who has the fewest detailed number of times she has helped with "shred cabbage," should be asked to help. If the detailed number of times each person has helped with an action is the same, the management program 26 will determine that the person with the fewest "total number of times" registered in the user management database should be asked to help. The detailed number is an example of the number of times an auxiliary task has been performed. The performance management database is an example of performance information.

[0105] [Operation (processing) of management program 26 and application 56] The management program 26 and application 56 cause CPU 21 and CPU 51 to execute the registration process shown in Figure 8 and the assistance management process shown in Figure 9. The processes that management program 26 causes CPU 21 to execute are processes that CPU 21 executes and processes that management device 20 executes. The processes that application 56 causes CPU 51 to execute are processes that CPU 51 executes and processes that communication terminals 41, 42, 43, and 44 execute. The processes that CPU 21 and CPU 51 execute are processes that the controller of the cooking assistance work management system 10 executes. Note that in the flowcharts shown in Figures 8 and 9, the database is abbreviated as DB. Also, "acquisition" in the processes described below includes storage in management memory 22 or terminal memory 52.

[0106] The wife or husband (hereinafter also referred to as the user) operates the first communication terminal 41 or the second communication terminal 42 that they possess to launch the application 56 (S11). The following describes an example in which the wife, "Yamada Hanako," launches the application 56 on the first communication terminal 41 that she possesses to perform registration. The wife, "Yamada Hanako," inputs a command to the communication terminal 41 to display the registration screen (S12).

[0107] Based on the user input received, application 56 transmits the resident ID and registration screen request stored in terminal memory 52 to the management device 20 via LAN 11 (S13). The registration screen request is, for example, a command that includes screen specification information indicating the registration screen.

[0108] The management program 26 receives the resident ID and the registration screen request (S13). The management program 26 reads the screen format specified by the received registration screen request from the management memory 22. The management program 26 also reads the information associated with the resident ID from the user management database. This information includes the name of the user indicated by the resident ID, "Yamada Hanako," and the names of other family members, "Yamada Taro," "Yamada Kazumi," "Yamada Sakura," and "Yamada Ichiro." The management program 26 inputs the information read from the user management database into the screen format to generate the registration screen data (S14). The registration screen data is HTML data including JavaScript. The registration screen data includes screen data showing the main registration screen (see Figure 10(A)), screen data showing multiple types of detailed cooking item registration screens, including the first detailed cooking item registration screen (see Figure 10(B)), screen data showing the registration details screen (see Figure 11(A)), and screen data showing the cooking equipment registration screen (see Figure 11(B)).

[0109] The management program 26 transmits the generated registration screen data to the first communication terminal 41 via the LAN 11 (S15).

[0110] App 56 receives registration screen data (S15). App 56 displays the main registration screen indicated by the received registration screen data on the touch panel 54 (S16).

[0111] As shown in Figure 10(A), the main registration screen has a pull-down menu 121 associated with the words "Hanako Yamada" and the words "Cook". The pull-down menu 121 has options with the words "Hanako Yamada", "Taro Yamada", "Kazumi Yamada", "Sakura Yamada", and "Ichiro Yamada". Hanako Yamada, the wife, selects the option in the pull-down menu 121 that has the name of the family member to be registered as the cook. In the example shown in Figure 10(A), Hanako Yamada, the wife, selects the option with her own name.

[0112] The main registration screen has the words "Persons who can help" and checkboxes corresponding to the names of family members. Specifically, the main registration screen has checkbox 122 corresponding to the words "Yamada Taro", checkbox 123 corresponding to the words "Yamada Hanako", checkbox 124 corresponding to the words "Yamada Kazumi", checkbox 125 corresponding to the words "Yamada Sakura", and checkbox 126 corresponding to the words "Yamada Ichiro". The wife, "Yamada Hanako", checks the checkboxes corresponding to the names of persons who can help. In the example shown in Figure 10(A), "Yamada Hanako" checks checkbox 122 corresponding to the words "Yamada Taro", checkbox 123 corresponding to the words "Yamada Hanako", checkbox 124 corresponding to the words "Yamada Kazumi", and checkbox 125 corresponding to the words "Yamada Sakura".

[0113] The main registration screen further includes a "Skill Settings" icon 127, a "Cooking Utensil Settings" icon 128, and a "Register" icon 129. After the wife, "Yamada Hanako," specifies the person who will perform the cooking using the pull-down menu 121 and the people who can assist using checkboxes 122 to 126, she selects either the "Skill Settings" icon 127 or the "Cooking Utensil Settings" icon 128.

[0114] As shown in Figure 8, app 56 accepts the selection of either the "skill setting" icon 127, the "cooking utensil setting" icon 128, or the "register" icon 129 (S17). App 56 determines the type of icon selected (S18). Based on the fact that the selected icon is the "skill setting" icon 127 (S18: skill setting), app 56 displays the first detailed cooking item registration screen on the touch panel 54 according to the JavaScript contained in the registration screen data (S19).

[0115] The first detailed cooking item registration screen shown in Figure 10(B) is a screen for registering the cooking skills of the wife, "Yamada Hanako". The first detailed cooking item registration screen has the text "Yamada Hanako's Settings" and the text "Please select what she can do". The first detailed cooking item registration screen also has a checkbox 131 associated with the text "Can cook all dishes", a checkbox 132 and an "Advanced Settings" icon 133 associated with the text "All types of knives", a checkbox 134 and an "Advanced Settings" icon 135 associated with the text "Slicer", a checkbox 136 and an "Advanced Settings" icon 137 associated with the text "Peeler", a checkbox 138 and an "Advanced Settings" icon 139 associated with the text "Grater", a checkbox 140 and an "Advanced Settings" icon 141 associated with the text "Blender", and a checkbox 142 and an "Advanced Settings" icon 143 associated with the text "Hand mixer". Although not shown in Figure 10(B), the first detailed cooking item registration screen has checkboxes and an "Advanced Settings" icon that correspond to the names of other cooking appliances. These checkboxes and the "Advanced Settings" icon are displayed on the touch panel 54 when the first detailed cooking item registration screen is slid open.

[0116] If your wife, Hanako Yamada, has the skills to use all of the cooking utensils she owns, check check box 131. If your wife, Hanako Yamada, has the skills to use each of the cooking utensils she owns fully, check check box 132, etc. If your wife, Hanako Yamada, can only use some of the cooking utensils she owns, select the "Advanced Settings" icon 133, etc.

[0117] As shown in Figure 8, app 56 accepts the selection of the "Advanced Settings" icon 133, etc., by the wife, "Yamada Hanako" (S20). Based on the acceptance of the selection of the "Advanced Settings" icon 133, etc. (S20), app 56 displays the registration details screen on the touch panel 54 according to the JavaScript contained in the registration screen data (S21).

[0118] Figure 11(A) shows the registration details screen displayed on the touch panel 54 when the "Advanced Settings" icon 133, which is associated with the text "General Knives," is selected. The registration details screen shown in Figure 11(A) has the text "General Knives Advanced Settings" and ingredient names such as "Onion," "Potato," and "Radish." The registration details screen also has checkboxes associated with text indicating various cutting methods. In the example shown in Figure 11(A), the registration details screen has a checkbox 150 associated with the text "Minced," a checkbox 151 associated with the text "Wedge Cut," a checkbox 152 associated with the text "Slice," a checkbox 153 associated with the text "Julienne," a checkbox 154 associated with the text "Round, Half-moon, Ginkgo," and a checkbox 155 associated with the text "Katsura Peeling." Note that when the registration details screen is slid, other checkboxes associated with text indicating other cutting methods are displayed on the touch panel 54.

[0119] If the wife, Hanako Yamada, is capable of performing tasks such as "peeling a daikon radish," she checks checkbox 155.

[0120] Although not shown in Figure 11(A), the registration details screen has an "OK" icon. After checking checkbox 150 and other items, the wife, "Yamada Hanako," selects the "OK" icon. As shown in Figure 8, based on the selection of the "OK" icon on the registration details screen, the app 56 displays the first detailed cooking item registration screen again on the touch panel 54 according to the above JavaScript.

[0121] Although not shown in Figure 10(B), the first detailed cooking item registration screen also has a "Next" icon. After the detailed settings for the cooking items are complete, the wife, Hanako Yamada, selects the "Next" icon.

[0122] As shown in Figure 8, app 56 accepts the selection of the "Next" icon on the first detailed cooking item registration screen (S22). Based on the acceptance of the selection of the "Next" icon, app 56 displays the second detailed cooking item registration screen (not shown) on the touch panel 54 (S23). The second detailed cooking item registration screen accepts registration of the cooking skills of the husband, "Yamada Taro," who is an assistant worker. The second detailed cooking item registration screen has the text "Yamada Taro's settings" instead of "Yamada Hanako's settings" on the first detailed cooking item registration screen (see Figure 10(B)). The wife, "Yamada Hanako," inputs the settings for her husband, "Yamada Taro's" cooking skills by selecting checkboxes.

[0123] Similarly, on the third detailed cooking item registration screen, the wife, Hanako Yamada, registers the cooking skills of her eldest daughter, Kazumi Yamada, and then on the fourth detailed cooking item registration screen, she registers the cooking skills of her second daughter, Sakura Yamada. The fourth detailed cooking item registration screen has an "OK" icon instead of a "Next" icon. After setting the cooking skills of herself, her husband, her eldest daughter, and her second daughter, Hanako Yamada selects the "OK" icon.

[0124] As shown in Figure 8, app 56 accepts the selection of the "OK" icon on the fourth detailed cooking item registration screen (S24). Based on the acceptance of the "OK" icon selection (S24), app 56 displays the main registration screen again on the touch panel 54 (S16).

[0125] After setting the cooking techniques, his wife, Hanako Yamada, selects the "Cooking Utensil Settings" icon 128 on the main registration screen (see Figure 10(A)).

[0126] As shown in Figure 8, when the app 56 determines that the icon selected in step S17 is the "Cooking Utensil Settings" icon 128 (S18: Cooking Utensil Settings), it displays the cooking utensil registration screen on the touch panel 54 (S25).

[0127] As shown in Figure 11(B), the cooking utensil registration screen has the words "Cooking Utensil Settings". The cooking utensil registration screen also has pull-down menus 161 and 162, and an "Add" icon 163, which are associated with the words "Cabbage: Shredded".

[0128] The pull-down menus 161 and 162 have multiple options, each containing the names of cooking utensils such as knives, cutting boards, large peelers, medium colanders / bowls, and slicers. The wife, "Yamada Hanako," selects the cooking utensils to use for shredding cabbage from the pull-down menus 161 and 162. If "Yamada Hanako" determines that she needs more than three cooking utensils for shredding cabbage, she selects the "Add" icon 163. Based on the selection of the "Add" icon 163, app 56 adds a pull-down menu similar to pull-down menus 161 and 162, according to the JavaScript contained in the registration screen data.

[0129] The cooking utensil registration screen further includes pull-down menus 161 and 162, and an "Add" icon 163, which are associated with text indicating the names of auxiliary tasks such as "Cabbage: roughly chopped" and "Potatoes: cut into wedges." The wife, "Yamada Hanako," registers the cooking utensils to be used for each auxiliary task using the pull-down menus 161 and 162 and the "Add" icon 163. The cooking utensil registration screen also has an "OK" icon (not shown). This "OK" icon is displayed on the touch panel 54 by sliding the cooking utensil registration screen. After setting the cooking utensils, the wife, "Yamada Hanako," selects the "OK" icon.

[0130] As shown in Figure 8, based on the fact that the app 56 has received the selection of the "OK" icon on the cooking appliance registration screen (S26), it displays the main registration screen again on the touch panel 54 (S16).

[0131] After setting the cooking techniques and cooking utensils, his wife, Hanako Yamada, selects the "Register" icon 129 on the main registration screen (see Figure 10(A)).

[0132] As shown in Figure 8, when the app 56 determines that the icon selected in step S17 is the "Register" icon 129 (S18: Registration), it transmits the resident ID and registration information stored in the terminal memory 52 to the management device 20 via the LAN 11 (S27). The registration information includes information indicating the type of icons and checkboxes selected by the wife, "Yamada Hanako," on the main registration screen, multiple detailed cooking item registration screens, and cooking utensil registration screens.

[0133] App 56 receives registration information (S27). App 56 registers the received registration information in the user management database and the cooking utensil management database (S28). App 56 reads the registration completion notification screen data stored in the management memory 22 and transmits it via LAN 11 to the first communication terminal 41 owned by his wife, "Yamada Hanako" (S29), and terminates the registration process (end).

[0134] The application 56 of the first communication terminal 41 receives registration completion notification screen data (S29). The application 56 displays a registration completion notification screen (not shown) indicated by the received registration completion notification screen data on the touch panel 54 (S30), and terminates the registration process (end). The registration completion notification screen has the text, for example, "Yamada Hanako's registration has been completed."

[0135] Next, the assistance management process performed by the management program 26 of the management device 20 and the applications 56 of the communication terminals 42, 43, and 44 will be explained with reference to Figure 9. The assistance management process is the process by which the wife, Hanako Yamada, who is the one who performs the cooking, requests one of her husband, eldest daughter, or second daughter to perform the auxiliary tasks she has specified. A detailed explanation follows.

[0136] The cook, Hanako Yamada, performs the cooking in kitchen 60. Hanako Yamada, the cook, speaks instructions into microphone 31, including the names of the auxiliary tasks that assist in cooking. Specifically, Hanako Yamada, the cook, speaks into microphone 31, such as "Help, shred the cabbage," "Help, slice the potatoes," "Help, wash the bowls and colanders," and "Help, steam the fish."

[0137] Microphone 31 converts the voice spoken by "Yamada Hanako," the person performing the cooking, into audio data and inputs it to the management device 20 (S32).

[0138] The management program 26 of the management device 20 waits until it receives audio data indicating a specific voice (S31: No). The specific voice is the voice for "Help". In other words, the voice for "Help" is the trigger to start the assistance management process.

[0139] When the management program 26 determines that a specific voice has been input (S31: Yes), it obtains the name of the ingredient or cooking utensil and the name of the auxiliary task from the input voice data in step S32 (S33). For example, if the cooking executor, "Yamada Hanako," specifies "shredded cabbage," the management program 26 obtains the ingredient name "cabbage" and the auxiliary task name "shredded." If the cooking executor, "Yamada Hanako," specifies "wash bowls and strainers," the management program 26 obtains the cooking utensil names "bowl" and "strainer" and the auxiliary task name "washing." The processing in steps S31, S32, and S33 is an example of the first acquisition process.

[0140] Next, the management program 26 drives the first camera 33 and the second camera 34, and acquires the first image data generated by the first camera 33 through imaging, and the second image data generated by the second camera 34 through imaging (S34).

[0141] The management program 26 acquires food location information indicating the location of the food item acquired in step S33 and food size information indicating the size of the food item, based on the first captured image data and the sample image data stored in the management memory 22 (S35). For example, an existing image analysis program is used to calculate the food location information and food size. If the food size is less than a threshold size, the management program 26 stores food size information of "0" indicating "small" in the management memory 22, and if the food size is equal to or greater than the threshold size, it stores food size information of "1" indicating "large" in the management memory 22. The threshold size is one of various thresholds and is pre-stored in the management memory 22. The processing in step S35 is an example of food location acquisition processing and food size acquisition processing.

[0142] Although not shown in the flowchart, if the management program 26 cannot obtain the location information and size of the ingredients specified by the cooking operator based on the first image data, it notifies the cooking operator via speaker 32 that the specified ingredients are not in the kitchen 60. Upon receiving the notification, the cooking operator takes the specified ingredients out of the refrigerator and places them on the work table 64. The cooking operator inputs an instruction to the management device 20 via microphone 31 indicating that the specified ingredients have been taken out. Based on the receipt of this instruction, the management program 26 repeats the processes of steps S34 and S35.

[0143] The management program 26 reads and obtains the names of cooking utensils and their storage locations, which are associated with the ingredient name, auxiliary task name, and ingredient size information acquired in step S33, from the cooking utensil management database (S36). For example, if the auxiliary task specified by the cook, "Yamada Hanako," is "peeling potatoes," and the size of the potato captured by the first camera 33 is "small," then the names of the cooking utensils "cutting board (small)" and "deba knife (small)" are obtained from the cooking utensil management database shown in Figure 6. If the size of the potato captured by the first camera 33 is "large," then the names of the cooking utensils "peeler (small)" and "colander / bowl (small)" are obtained from the cooking utensil management database shown in Figure 6. In other words, the type of cooking utensil obtained changes depending on the size of the ingredient. The process in step S36 is an example of the third acquisition process.

[0144] The management program 26 determines, based on the acquired second image data and the sample image data stored in the management memory 22, whether the cooking utensil indicated by the cooking utensil name acquired in step S36 is in the storage location indicated by the storage location information acquired in step S36 (S37, S38). For this determination, for example, an existing image analysis program is used. The processing in step S38 is an example of the determination process.

[0145] If the management program 26 determines that the cooking utensil is not in its storage location (S38: No), it obtains usage location information indicating the current location of the cooking utensil based on the first image data acquired in step S34 and the sample image data stored in the management memory 22 (S39). The management program 26 then discards the storage location information read from the cooking utensil management database in step S36 and temporarily stores the usage location information in the management memory 22 (S39). The process in step S39 is an example of the fourth acquisition process.

[0146] Next, the management program 26 reads and retrieves information such as resident ID, name, various flags, total number of assistance sessions, communication address, and permission flag registered in the user management database (S40). The management program 26 also reads and retrieves detailed information on the number of assistance sessions registered in the performance management database (S40). The processing in step S40 is an example of the second and fifth retrieval processes.

[0147] The management program 26 selects residents who are not the cook, are at home, and can perform the specified auxiliary tasks, based on the information read from the user management database and the ingredient size information obtained in step S35 (S41). Whether or not a person is the cook is determined by the cook flag. Whether or not a person is at home is determined by the home flag. Whether or not a person can perform the specified auxiliary tasks is determined by the auxiliary worker flag, the feasibility flag, and the ingredient size information. In the example shown in Figure 5, those who are not the cooks are the husband, "Yamada Taro," the eldest daughter, "Yamada Kazumi," the second daughter, "Yamada Sakura," and the eldest son, "Yamada Ichiro." Of these four, the eldest son, "Yamada Ichiro," is associated with the auxiliary worker flag of "0" and is therefore excluded from the candidates. Also, the eldest daughter, "Yamada Kazumi," is associated with the home flag of "0" and is therefore absent and is therefore excluded from the candidates. Furthermore, if the assistant task designated by the cook, Hanako Yamada, is "shredding cabbage," then both her husband, Taro Yamada, and her second daughter, Sakura Yamada, have a feasibility flag of "1" associated with that task. Therefore, neither is excluded, and both Taro Yamada and Sakura Yamada are selected as candidates who can perform the designated assistant task. If the assistant task designated by the cook, Hanako Yamada, is "peeling potatoes" and the ingredient size is "small," then Taro Yamada has a feasibility flag of "1" associated with that task, while Sakura Yamada has a feasibility flag of "0." Therefore, Sakura Yamada is excluded from the candidates, and Taro Yamada is selected as a candidate who can perform the designated assistant task. In other words, the selected candidates change depending on the content of the assistant task designated by the cook and the size of the ingredients. The process in step S41 is an example of the assistant worker determination process. The candidate is an example of an assistant worker. The candidate's name or resident ID is an example of assistant worker identification information.

[0148] As shown in Figure 9, the management program 26 determines whether or not there are any candidates selected in step S41 (S42). If the management program 26 determines that there are no candidates (S42: No), it inputs the first notification voice data stored in the management memory 22 to the speaker 32 via the LAN 11 (S43), and terminates the helper management process (end). The first notification voice data, for example, indicates the voice message, "There is no one who can help." In other words, the person performing the cooking, "Yamada Hanako," is notified by voice that there are no family members who can perform the help specified by the person performing the cooking.

[0149] If the management program 26 determines that there are candidates (S42: Yes), it provisionally determines the assistant worker who will be asked to provide assistance based on the detailed count read from the performance management database in step 40 and the total number of times assistance was provided read from the user management database (S44). More specifically, the management program 26 provisionally determines the assistant worker from among multiple candidates who has the fewest detailed counts of the number of times the assistant task specified by the cooking executor has been performed. If the detailed counts of multiple candidates are the same, the management program 26 provisionally determines the assistant worker who has the fewest total number of times assistance was provided. If the detailed counts and total number of times assistance was provided are the same for multiple candidates, the management program 26 provisionally determines the assistant worker, for example, the younger candidate. In the example shown in Figure 5, the husband, "Yamada Taro," one of the candidates, has a detailed count of "3 times" for shredding cabbage, and the second daughter, "Yamada Sakura," another candidate, has a detailed count of "1 time" for shredding cabbage, so the second daughter, "Yamada Sakura," is provisionally determined to be the assistant worker. If there is only one candidate, the management program 26 will tentatively designate that candidate as an assistant worker.

[0150] As shown in Figure 9, the management program 26 generates assistance request screen data (S45). Specifically, the management program 26 reads the screen format stored in the management memory 22, inputs the names of ingredients such as cabbage, cooking utensils such as slicers, and auxiliary tasks such as shredding, obtained in steps S33 and S34, along with the ingredient sizes obtained in steps S38 and S39, and the names of family members obtained in step S40, into the screen format to generate assistance request screen data. The management program 26 transmits the generated assistance request screen data to the fourth communication terminal 44 indicated by the communication address of "Yamada Sakura" obtained in step S40 via the LAN 11 (S46). The process in step S46 is an example of notification processing. The communication address of the fourth communication terminal 44 owned by "Yamada Sakura," or the name of "Yamada Sakura," is an example of "assistant worker identification information" in notification processing.

[0151] The application 56 of the fourth communication terminal 44 receives assistance request screen data (S46). The application 56 displays the assistance request screen indicated by the received assistance request screen data on the touch panel 54 (S47). The process in step S47 is an example of a display process.

[0152] As shown in Figure 12, the help request screen displays the name "Sakura Yamada," the words "We have a request for your help with cooking," the words "Details of the help," and the words indicating the name of the ingredients, the size of the ingredients, and the name of the auxiliary task, such as "Large cabbage: shredded" and "Small potato: peeled." The help request screen also has an "OK" icon 171 and a "Not now" icon 172. Sakura Yamada, the second daughter who is asked to help, selects the "OK" icon 171 if she accepts the request, or selects the "Not now" icon 172 if she is not feeling well or is busy with another task and cannot accept the request.

[0153] As shown in Figure 9, app 56 accepts a selection by the second daughter, "Yamada Sakura," between the "OK" icon 171 and the "Not Now" icon 172 (S48). App 56 transmits the resident ID and selection information to the management device 20 via LAN 11 (S49). The selection information indicates whether the icon selected by the second daughter, "Yamada Sakura," is the "OK" icon 171 or the "Not Now" icon 172.

[0154] The management program 26 of the management device 20 receives the resident ID and selection information (S49). Based on the selection information, the management program 26 determines whether the icon selected by the second daughter, "Yamada Sakura," is the "OK" icon 171 or the "Not Now" icon 172 (S50). If the management program 26 determines that the selected icon is the "Not Now" icon 172 (S50: Not Now), it registers a permission / denial flag of "1" in the user management database, associated with the resident ID of the second daughter, "Yamada Sakura" (S51). The initial value of the permission / denial flag is "0". Residents with a permission / denial flag of "1" registered are excluded from the candidates in step S41.

[0155] After executing step S51, the management program 26 inputs the second notification voice data read from the management memory 22 to the speaker 32 via the LAN 11 (S52). The second notification voice data, for example, indicates the voice message, "Sakura Yamada is unable to help." In other words, the cooking executor, Hanako Yamada, is notified by voice that her second daughter, Sakura Yamada, who is capable of performing the chores specified by Hanako, is at home, but Sakura Yamada is unable to help.

[0156] After executing step S52, the management program 26 executes the processes from step S40 onward again.

[0157] In step S50, if the management program 26 determines that the selected icon is the "OK" icon 171 (S50: OK), it updates the value of the permission / denial flag registered in the user management database to its initial value of "0" and performs an update process that increases the detailed count registered in the performance management database, which is associated with the auxiliary work specified by the cooking executor, by "1" (S53).

[0158] Next, the management program 26 reads from the management memory 22 the voice data corresponding to the ingredient name and auxiliary work name obtained in step S33 and the name of the second daughter, "Yamada Sakura," obtained in step S40, to generate third notification voice data, and inputs it to the speaker 32 via LAN 11 (S54). The third notification voice data is, for example, voice data indicating "Yamada Sakura will be cutting cabbage into thin strips."

[0159] The management program 26 drives the spotlight 36 based on the food ingredient position acquired in step S35, and illuminates the food ingredient specified by the cook with the spotlight 36 (S55). This process is an example of the second lighting process.

[0160] Furthermore, the management program 26 drives the spotlight 37 based on the storage location information of the cooking utensils obtained in step S36, and illuminates the cooking utensils that are used for auxiliary tasks specified by the cooking operator and are stored in their designated storage locations with the spotlight 37 (S55). This process is an example of the first lighting process.

[0161] Furthermore, the management program 26 drives the spotlight 35 based on the usage location information acquired in step S39, and illuminates the cooking utensils that are used for auxiliary tasks specified by the cooking operator and have been taken out of storage with the spotlight 35 (S55). This process is an example of the third lighting process.

[0162] Next, the management program 26 generates cooking utensil notification screen data (S56). Specifically, the management program 26 inputs the ingredient name obtained in step S33, the cooking utensil name obtained in step S33 or S36, and the name of "Yamada Sakura" obtained in step S40 into a screen format read from the management memory 22 to generate cooking utensil notification screen data. The management program 26 transmits the generated cooking utensil notification screen data to the fourth communication terminal 44 owned by "Yamada Sakura" via the LAN 11 (S57).

[0163] The application 56 of the fourth communication terminal 44 receives cooking appliance notification screen data (S57). The application 56 displays the cooking appliance notification screen indicated by the received cooking appliance notification screen data on the touch panel 54 (S58). The process in step S58 is an example of a display process.

[0164] As shown in Figure 12(B), the cooking utensil notification screen includes the text "Sakura Yamada", the text "Cooking utensils used", the text "Shredded cabbage (large) - Bowl / colander (large) - Peeler (large)", and the text "Peeling potatoes (large) - Bowl / colander (small) - Peeler (small)". In other words, the name of the auxiliary task and the name of the cooking utensil used for that auxiliary task are associated and displayed on the touch panel 54.

[0165] Furthermore, the cooking utensil notification screen displays the message "The cooking utensil is in its designated storage location" if the cooking utensil is in its storage location. Although not shown in Figure 12(B), if the cooking utensil is not in its storage location, the cooking utensil notification screen displays a message such as "The bowl / colander is in use" instead of "The cooking utensil is in its designated storage location." If the management program 26 fails to find the cooking utensil in step S39, the cooking utensil notification screen displays the message "The cooking utensil is not found in the storage location or in the kitchen" instead of "The cooking utensil is in its designated storage location."

[0166] The cooking utensil notification screen also has a "Watch" icon 173 and a "Do not watch" icon 174, which are associated with the text "Do you want to watch the reference video?". The second daughter, Sakura Yamada, will select the "Watch" icon 173 if she wants to watch a reference video on shredding cabbage using a peeler or peeling potatoes using a peeler, and the "Do not watch" icon 174 if she does not want to watch it.

[0167] As shown in Figure 9, app 56 accepts a selection by the second daughter, "Yamada Sakura," between the "view" icon 173 and the "do not view" icon 174 (S59). App 56 transmits the resident ID and selection information to the management device 20 via LAN 11 (S60). The selection information indicates whether the icon selected by the second daughter, "Yamada Sakura," is the "view" icon 173 or the "do not view" icon 174.

[0168] The management program 26 of the management device 20 receives the resident ID and selection information (S60). The management program 26 determines whether the icon selected by the second daughter, "Yamada Sakura," is the "view" icon 173 or the "do not view" icon 174 (S61). If the management program 26 determines that the icon selected by the second daughter, "Yamada Sakura," is the "view" icon 173 (S61: view), it transmits the reference video data read from the management memory 22 to the fourth communication terminal 44 via the LAN 11 (S62), and terminates the helper management process (end). If the management program 26 determines that the icon selected by the second daughter, "Yamada Sakura," is the "do not view" icon 174 (S61: do not view), it skips the process in step S62 and terminates the helper management process (end).

[0169] The application 56 of the fourth communication terminal 44 receives the reference video data transmitted by the management program 26 (S62). The application 56 displays the reference video indicated by the received reference video data on the touch panel 54 (S63), and then terminates the assistance management process (end).

[0170] Having accepted the request to help, the second daughter, Sakura Yamada, goes to kitchen 60. Sakura Yamada recognizes the illuminated ingredients such as cabbage 95 and potatoes 96, and the illuminated cooking utensils such as a peeler, small bowl 78, large bowl 79, small colander 80, and large colander 81. Sakura Yamada uses the illuminated cooking utensils to process the illuminated ingredients.

[0171] [Effects of the Embodiment] The management program 26 accepts input from the cook specifying the auxiliary tasks, and determines the person with the fewest detailed counts (the number of times the specified auxiliary task has been performed) and the fewest total number of times they have helped as the auxiliary worker to be asked to help. Therefore, the cooking assistance management system 10 can eliminate feelings of unfairness regarding helping with cooking within the family, and can also eliminate imbalances in the types of auxiliary tasks performed by those who help.

[0172] If the person performing the cooking task specifies that the task of shredding cabbage be performed, the person who is capable of shredding cabbage will be determined as the assistant worker. Therefore, the cooking assistance task management system 10 can request the assistance task specified by the person performing the cooking task from a person who is capable of performing that task.

[0173] The management program 26 retrieves the cooking utensils to be used for the auxiliary tasks specified by the cooking operator from the cooking utensil management database and notifies the auxiliary worker of the retrieved cooking utensils. Therefore, the cooking auxiliary work management system 10 can make the auxiliary worker aware of what cooking utensils to use and what auxiliary tasks to perform.

[0174] The management program 26 obtains the names and sizes of ingredients to be used for auxiliary tasks specified by the cooking operator, retrieves the appropriate cooking utensils from the cooking utensil management database according to the ingredient names and sizes, and notifies the auxiliary worker. Therefore, the cooking assistance work management system 10 can make the auxiliary worker aware of the appropriate cooking utensils according to the size of the ingredients.

[0175] The management program 26 illuminates the cooking utensils used by the assistant worker and stored in their designated storage area with a spotlight 37. Therefore, the cooking assistance work management system 10 can prevent the assistant worker from mistakenly using other cooking utensils.

[0176] The management program 26 obtains the names of the ingredients to be used for the auxiliary work specified by the cooking operator, identifies the location of the ingredients, and illuminates the ingredients with a spotlight 36. Therefore, the cooking assistance work management system 10 can prevent the assistant worker from mistakenly cooking the wrong ingredients.

[0177] The management program 26 illuminates the cooking utensils used for auxiliary tasks specified by the cooking operator with a spotlight 37 if they are in storage, and illuminates the cooking utensils in the cooking area with a spotlight 35 if they are not in storage but in the cooking area. Therefore, the cooking assistance work management system 10 can enable the assistant worker to immediately find the cooking utensils they use, even if they have been moved from storage to the cooking area.

[0178] The management program 26 selects an assistant from among the family members who are at home. Therefore, the cooking assistance management system 10 can prevent the request for assistance from being made to a family member who is not present.

[0179] The touch panels 54 of the communication terminals 42, 43, and 44 held by family members display the auxiliary tasks designated by the cook and the cooking utensils to be used for those tasks. Therefore, the cook does not need to explain to the assistant which cooking utensils to use, and the assistant can easily recognize which cooking utensils to use. As a result, the cooking assistance task management system 10 can reduce the burden on both the cook and the assistant. [Differentiation]

[0180] In the embodiment, an example was described in which ingredient size information is determined based on first captured image data generated by the first camera 33 (S35). However, ingredient size information may also be input to the management device 20 by the person performing the cooking. For example, the person performing the cooking inputs the voice command "Help, shred a large cabbage" to the management device 20 via the microphone 31.

[0181] In the embodiment, an example was described in which a request for help from a family member is made through a communication terminal 42, 43, or 44 held by the family member. However, the request for help from a family member may also be made using a speaker installed in the house. For example, the management program 26 may input voice data indicating "Sakura Yamada, your mother would like you to shred some cabbage" to the speaker via the LAN 11.

[0182] In one embodiment, an example was described in which the wife, "Yamada Hanako," is the one who performs the cooking. The cooking may be performed in turns by the wife, "Yamada Hanako," the husband, "Yamada Taro," and the eldest daughter, "Yamada Kazumi."

[0183] In the embodiment, an example was described in which the management program 26 acquires home presence information from the intercom system 12. However, the management program 26 may acquire home presence information based on GPS location information output by communication terminals 41, 42, 43, and 44. Alternatively, the management program 26 may accept input of home presence information from family members who have returned home. Alternatively, the management program 26 may broadcast or unicast to communication terminals 41, 42, 43, and 44 via the LAN 11, determining that the owner of the communication terminal that replies is at home and the owner of the communication terminal that does not reply is absent. Such broadcasts may be performed periodically, or they may be triggered by receiving instructions for auxiliary work from the cook via the microphone 31.

[0184] In the embodiment, an example was described in which the management program 26 receives instructions from the cook through a microphone 31 installed in the kitchen 60. However, the management program 26 may also receive instructions from the cook through communication terminals 41, 42, 43, and 44 held by the cook.

[0185] In the embodiment, an example was described in which the management program 26 notifies the cook through a speaker 32 installed in the kitchen 60 (S43, S52, S54). However, the management program 26 may also notify the cook through a communication terminal 41, 42, 43, 44 held by the cook.

[0186] In one embodiment, an example was described in which, if the ingredients specified by the cook are in a refrigerator or the like and the location information and size of the ingredients cannot be obtained based on the first image data, the cook is notified via speaker 32 that the specified ingredients have not been placed in the kitchen 60. However, if the management program 26 cannot obtain the size of the ingredients based on the first image data, it may read and obtain both the name of the cooking utensil used when the ingredient size is "small" and the name of the cooking utensil used when the ingredient size is "large" from the cooking utensil management database (S36). In that case, both cooking utensil names will be displayed on the cooking utensil notification screen shown in Figure 12(B). In addition, if the management program 26 cannot obtain the location information of the ingredients based on the first image data, text indicating that the ingredients have not been placed in the kitchen 60 will be displayed on the cooking utensil notification screen.

[0187] [Note 1] It includes a controller, memory, input interface, and output interface. The above memory stores performance information that associates individual member identification information, which identifies each family member, with auxiliary task identification information, which identifies each auxiliary task related to cooking, and count information, which indicates the number of times the above auxiliary tasks have been performed. The above controller is A first acquisition process that obtains the above auxiliary work identification information from the cooking operator through the above input interface, A second acquisition process is performed to acquire the above-mentioned component identification information and the above-mentioned number of times information, which are associated with the acquired auxiliary work identification information, from the above-mentioned performance information. Based on the acquired count information, an assistant worker determination process is performed to determine one of the multiple component identification pieces as the assistant worker identification piece indicating the assistant worker to be requested to perform the above-mentioned auxiliary work, A notification process that, in association with the above-mentioned auxiliary worker identification information, outputs the name of the auxiliary work indicated by the above-mentioned auxiliary work identification information obtained in the above-mentioned first acquisition process through the above-mentioned output interface, A cooking assistant work management system that performs an update process to update the above assistant worker identification information and the above number of times information associated with the above assistant work identification information.

[0188] [Note 2] The above-mentioned assistant worker determination process is a process in which the member identification information of the family member with the fewest number of times performing the above-mentioned assistant work, as indicated by the above-mentioned frequency information, is determined as the assistant worker identification information, according to the cooking assistant work management system described in Appendix 1.

[0189] [Note 3] The above memory further stores user management information that associates the above user identification information, the above auxiliary work identification information, and the executable / unexecutable information indicating whether or not the above auxiliary work can be executed. The above-mentioned assistant worker determination process is a process that determines the assistant worker identification information based on the above-mentioned execution feasibility information in addition to the above-mentioned count information, as described in Appendix 1 of the cooking assistant work management system.

[0190] [Note 4] The above memory further stores cooking utensil information, which associates the above auxiliary work identification information with cooking utensil identification information that individually identifies the cooking utensils used for the auxiliary work indicated by the auxiliary work identification information. The above controller is A third acquisition process is further executed to acquire the cooking utensil identification information associated with the auxiliary work identification information acquired in the first acquisition process described above from the cooking utensil information. The cooking assistance work management system described in Appendix 1, wherein the notification process described above outputs the cooking utensil identification information obtained in the third acquisition process described above, in addition to the auxiliary work identification information described above.

[0191] [Note 5] The above auxiliary work identification information includes the name of the food ingredient. The above cooking utensil information includes ingredient size information associated with the above cooking utensil identification information. The above controller is Further, a food size acquisition process is performed to obtain food size information indicating the size of the food item indicated by the above food item name. The above third acquisition process is, The cooking assistance work management system described in Appendix 4, which is a process for obtaining cooking utensil identification information associated with the above-mentioned food size information and the above-mentioned auxiliary work identification information obtained in the above-mentioned food size acquisition process from the above-mentioned cooking utensil information.

[0192] [Note 6] It further includes a first spotlight that can change the illumination area within the range including the storage area for the above-mentioned cooking appliances, The above cooking equipment information is, In addition to the above auxiliary work identification information and cooking utensil identification information, this information further associates storage location information indicating the storage location of the above cooking utensils. The above third acquisition process is, This process involves acquiring the storage location information associated with the above-mentioned auxiliary work identification information, in addition to the above-mentioned cooking utensil identification information. The above controller is The cooking assistance work management system described in Appendix 4 further performs a first lighting process to drive the first spotlight based on the storage location information acquired in the third acquisition process described above.

[0193] [Note 7] A second spotlight whose illumination area can be changed within the range including the cooking area, It further includes a first camera whose imaging area is the cooking area described above, The above auxiliary work identification information includes the name of the food ingredient. The above controller is Based on the first image data generated by the first camera, an ingredient location acquisition process is performed to acquire ingredient location information, which is the location of the ingredient indicated by the ingredient name acquired in the first acquisition process. A cooking assistance work management system as described in Appendix 1, further comprising: a second lighting process that drives the second spotlight based on the acquired food location information.

[0194] [Note 8] A second spotlight whose illumination area can be changed within the range including the cooking area, A first camera whose imaging area is the cooking area described above, It further includes a second camera that uses the above storage location as its imaging area, The above controller is Based on the second image data generated by the second camera, a determination process is further performed to determine whether or not the cooking utensils are present in the storage area. Depending on whether the above cooking utensils are in the above storage location, the above first lighting process is performed. In cases where the above cooking utensils are not in the above storage location, A fourth acquisition process is performed to acquire usage position information indicating the position of the cooking utensil based on the first image data generated by the first camera, The cooking assistance work management system described in Appendix 6 further performs a third lighting process that drives the second spotlight based on the acquired usage location information.

[0195] [Note 9] The above controller is A fifth acquisition process is then performed to acquire information indicating whether the family member is at home or not, as indicated by the above-mentioned member identification information. The above process for determining the assistant worker is as follows: A cooking assistance work management system described in any of Appendix 1 to Appendix 8, which determines the assistant worker identification information based on the above-mentioned attendance information as well as the above-mentioned home information.

[0196] [Note 10] A communication terminal owned by the above-mentioned family member, further comprising a communication terminal having a display, The above controller is The cooking assistance work management system described in Appendix 4, further comprising a display process that displays on the display the auxiliary work indicated by the auxiliary work identification information output in the above notification process and the cooking utensils indicated by the above cooking utensil identification information on the above display. [Explanation of symbols]

[0197] 10. Cooking Assistant Work Management System 11. Local Area Network 20...Management device 21..CPU 22...Management memory 23. Communication Interface 26. Management Program 31. Microphone 32 speakers 33... Camera 1 34...Second Camera 35, 36, 37... Spotlight 41, 42, 43, 44... Communication terminals 51...CPU 52. Terminal Memory 53. Communication Interface 56. Application Program 60... Kitchen 61...Sink 62... Cooktop stand 63. Gas stove 64...work desk 67. Hanging rack 68...Sink storage 69...drawer 71...Cutting board (small) 72... Cutting board (medium) 73. Cutting board (large) 74. Deba knife (small) 75. Deba knife (large) 76... Chinese cleaver 77... Sashimi knife 78... Small ball 79...Large Ball 80... Small colander 81...Large colander 82... Small frying pan 83...Frying pan (medium) 84...Frying pan (large) 85...Milk pan 86... Small pot 87...Large pot 88... flat pot 89... Steamer 95... Cabbage 96. Potato

Claims

1. It includes a controller, memory, input interface, and output interface. The above memory stores performance information that associates individual member identification information, which identifies each family member, with auxiliary task identification information, which identifies each auxiliary task related to cooking, and count information, which indicates the number of times the above auxiliary tasks have been performed. The above controller is A first acquisition process that obtains the above auxiliary work identification information from the cooking operator through the above input interface, A second acquisition process is performed to acquire the above-mentioned component identification information and the above-mentioned number of times information, which are associated with the acquired auxiliary work identification information, from the above-mentioned performance information. Based on the acquired count information, an assistant worker determination process is performed to determine one of the multiple component identification pieces as the assistant worker identification piece indicating the assistant worker to be requested to perform the above-mentioned auxiliary work, A notification process that, in association with the above-mentioned assistant worker identification information, outputs the name of the assistant work indicated by the above-mentioned assistant work identification information obtained in the above-mentioned first acquisition process, through the above-mentioned output interface, A cooking assistant work management system that performs an update process to update the above assistant worker identification information and the above number of times information associated with the above assistant work identification information.

2. The cooking assistance work management system according to claim 1, wherein the above assistance worker determination process is a process of determining the member identification information of the family member who has performed the assistance work the fewest times as indicated by the above frequency information as the assistance worker identification information.

3. The above memory further stores user management information that associates the above user identification information, the above auxiliary work identification information, and the executable / unexecutable information indicating whether or not the above auxiliary work can be executed. The cooking assistance work management system according to claim 1, wherein the above assistance worker determination process is a process that determines the assistance worker identification information based on the above execution feasibility information in addition to the above number of times information.

4. The above memory further stores cooking utensil information, which associates the above auxiliary work identification information with cooking utensil identification information that individually identifies the cooking utensils used for the auxiliary work indicated by the auxiliary work identification information. The above controller is A third acquisition process is further executed to acquire the cooking utensil identification information associated with the auxiliary work identification information acquired in the first acquisition process described above from the cooking utensil information. The cooking assistance work management system according to claim 1, wherein the notification process is a process that outputs the cooking utensil identification information obtained in the third acquisition process in addition to the auxiliary work identification information.

5. The above auxiliary work identification information includes the name of the food ingredient. The above cooking utensil information includes ingredient size information associated with the above cooking utensil identification information. The above controller is Further, a food size acquisition process is performed to obtain food size information indicating the size of the food item indicated by the above food item name. The above third acquisition process is, The cooking assistance work management system according to claim 4, wherein the process involves obtaining cooking utensil identification information associated with the above-mentioned food size information and the above-mentioned auxiliary work identification information obtained in the above-mentioned food size acquisition process from the above-mentioned cooking utensil information.

6. The system further includes a first spotlight capable of changing the illumination area within a range that includes the storage area for the above-mentioned cooking appliances. The above cooking equipment information is, In addition to the above auxiliary work identification information and cooking utensil identification information, this information further associates storage location information indicating the storage location of the above cooking utensils. The above third acquisition process is, This process involves acquiring the storage location information associated with the above-mentioned auxiliary work identification information, in addition to the above-mentioned cooking utensil identification information. The above controller is The cooking assistance work management system according to claim 4, further comprising: a first lighting process that drives the first spotlight based on the storage position information acquired in the third acquisition process described above.

7. A second spotlight whose illumination area can be changed within the range including the cooking area, It further includes a first camera whose imaging area is the cooking area described above, The above auxiliary work identification information includes the name of the food ingredient. The above controller is Based on the first image data generated by the first camera through imaging, a food location acquisition process is performed to acquire food location information, which is the location of the food item indicated by the food item name acquired in the first acquisition process. The cooking assistance work management system according to claim 1, further comprising: a second lighting process that drives the second spotlight based on the acquired food location information.

8. A second spotlight whose illumination area can be changed within the range including the cooking area, A first camera whose imaging area is the cooking area described above, It further includes a second camera that uses the above storage location as its imaging area, The above controller is Based on the second image data generated by the second camera, a determination process is further performed to determine whether or not the cooking utensils are present in the storage area. Depending on whether the above cooking utensils are in the above storage location, the first lighting process is performed. In cases where the above cooking utensils are not in the above storage location, A fourth acquisition process is performed to acquire usage position information indicating the position of the cooking utensil based on the first image data generated by the first camera, The cooking assistance work management system according to claim 6, further comprising: a third lighting process that drives the second spotlight based on the acquired usage location information.

9. The above controller is A fifth acquisition process is then performed to acquire information indicating whether the family member is at home or not, as indicated by the above-mentioned member identification information. The above process for determining the assistant worker is as follows: A cooking assistance work management system according to any one of claims 1 to 8, wherein the process determines the assistant worker identification information based on the above-mentioned attendance information as well as the above-mentioned home information.

10. A communication terminal owned by the above-mentioned family member, further comprising a communication terminal having a display, The above controller is The cooking assistance work management system according to claim 4, further comprising a display process that displays on the display the auxiliary work indicated by the auxiliary work identification information output in the above notification process and the cooking utensil indicated by the cooking utensil identification information.

Images