Provision propriety determination system, provision propriety determination method and provision propriety determination program

Abstract

To determine whether or not a meal can be provided in taking into account of a menu provision form.SOLUTION: A provision propriety determination system includes: an image acquisition unit that acquires a meal image of a meal to be provided and a meal card image; a meal condition identification unit that identifies meal condition information corresponding to the meal card on the basis of a preset condition correspondence; a menu identification unit that identifies menu information of a menu included in the meal to be provided represented by the meal image on the basis of a learning target menu correspondence; a content identification unit that identifies form information regarding a provision form of each identified menu on the basis of the learning target form correspondence; and a provision propriety determination unit that determines whether or not the meal to be provided represented by the meal image can be provided on the basis of the identified meal condition information and the form information.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a provision availability determination system, a provision availability determination method, and a provision availability determination program. [Background technology]

[0002] Conventionally, techniques have been known to prevent meals from being served to the wrong person (so-called mis-serving of meals).

[0003] For example, the misidentification prevention system described in Patent Document 1 is a system that uses images to prevent misidentification. The system includes a patient information recording unit that records patient information, an image acquisition unit that acquires image information, and a comparison unit that compares the patient information with the image information. The comparison unit in the system compares the treatment to be performed or the item to be supplied obtained from the patient information with the image information and displays a match and / or a mismatch. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Publication No. 2023-47459 Summary of the Invention [Problem to be solved by the invention]

[0005] Incidentally, when providing a meal to a subject, it is sometimes important to consider not only allergenic ingredients but also the form of the menu (for example, bite-sized, chopped, extra chopped, blended, mousse, etc.) However, the misidentification prevention system described in Patent Document 1 is only able to prevent incorrect serving of food by taking into consideration the patient's allergies, and does not consider the form of the menu.

[0006] Therefore, an object of the present invention is to determine whether or not a meal can be served, taking into consideration the manner in which the menu is served. [Means for solving the problem]

[0007] A serving eligibility determination system according to one aspect of the present invention comprises an image acquisition unit that acquires a meal image of the served meal to be served to a subject and a meal card image of a meal card that is served to the subject along with the served meal and that contains identification information that identifies the subject and at least one of the conditions for the serving format of the served meal; a meal condition identification unit that identifies the meal condition information corresponding to the meal card based on a pre-set condition correspondence relationship between the identification information and meal condition information related to the conditions for the serving format; a menu identification unit that identifies menu information related to the menu included in the served meal shown by the meal image based on a menu correspondence relationship learned based on multiple combinations of learning images of learning menus and learning menu information related to the learning menus; a content identification unit that identifies form information related to the serving format of each identified menu based on form correspondence relationships learned based on multiple combinations of each of multiple serving formats and learning images of the learning menu cooked in each of the multiple serving formats; and a serving eligibility determination unit that determines whether the served meal shown by the meal image can be served based on the identified meal condition information and form information. [Effects of the Invention]

[0008] According to the present invention, it is possible to determine whether or not a meal can be served, taking into consideration the manner in which the menu is served. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 1 is a diagram showing an overview of processing in a provision availability determination system 100 according to an embodiment of the present invention. [Figure 2] 1 is a diagram showing the configuration of a provision availability determination system 100 according to an embodiment of the present invention. [Figure 3] FIG. 10 is a diagram showing an example of a food image. [Figure 4] FIG. 10 is a diagram showing an example of a meal card. [Figure 5] 10 is a diagram showing an example of subject information stored in a storage unit 110. FIG. [Figure 6A]FIG. 10 is a diagram showing an outline of menu correspondence relationships. [Figure 6B] FIG. 10 is a diagram showing an outline of a morphological correspondence relationship. [Figure 6C] FIG. 1 is a diagram showing an outline of ingredient correspondence relationships. [Figure 7] 10 is a flowchart showing an example of processing in the provision availability determination system 100. [Figure 8] 10 is a flowchart showing an example of processing in the provision availability determination system 100. DETAILED DESCRIPTION OF THE INVENTION

[0010] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Preferred embodiments of the present invention will now be described with reference to the accompanying drawings, in which: Figure 1 is a diagram showing an overview of processing in a provision availability determination system 100 according to one embodiment of the present invention.

[0011] The provision eligibility determination system 100 is an information processing system realized by a provision eligibility determination program. The provision eligibility determination system 100 determines whether or not the provided meal is to be provided based on a meal image of the provided meal to be provided to the subject, and a meal card image of a meal card that is provided to the subject together with the provided meal and that contains identification information that identifies at least one of the subject and the conditions for the form of provision of the provided meal.

[0012] First, the provision acceptability determination system 100 acquires a meal image and a meal ticket image of the meal to be provided to the subject. The provision acceptability determination system 100 identifies the subject's dietary requirements based on the meal ticket image (S101).

[0013] Next, the serving possibility determination system 100 identifies the menu items included in the provided meal based on the meal image (S102). The serving possibility determination system 100 identifies the serving format of the identified menu items (e.g., bite-sized, chopped, extra chopped, blender, mousse, etc.) based on the meal image (S103).

[0014] Then, the provision availability determination system 100 determines whether or not the provided meal can be provided to the subject based on the identified meal conditions and the form of the provided meal (S104).

[0015] For example, the provision admissibility determination system 100 can execute the provision admissibility determination process when providing a meal to a subject at a facility used by the subject. Here, the facility used by the subject may be, for example, a medical facility, a care facility, an accommodation facility, etc.

[0016] 2 is a diagram showing the configuration of a provision possibility determination system 100 according to one embodiment of the present invention. The provision possibility determination system 100 is communicably connected to a menu management device 200, a subject information management device 300, a first camera 400, and a second camera 500 via a network such as the Internet. Details of the provision possibility determination system 100 will be described later.

[0017] The menu management device 200 is an information processing device that manages menu information related to the menu of meals provided to the subject.

[0018] The menu management device 200 can manage, for example, scheduled menu information of a scheduled menu that is scheduled to be provided to a subject (for example, a menu that is scheduled to be provided on the day or in the coming week).

[0019] Furthermore, the menu management device 200 can manage, for example, menu information of meals that have been provided in the past.

[0020] The menu management device 200 can also manage learning menu information used in the learning process by the learning unit 125, which will be described later. The learning menu information may be menu information of meals that have been served in the past, or may be menu information that has been generated for learning purposes and has not been served before.

[0021] In this embodiment, the term "menu" is used to refer to, for example, at least one dish (especially, for example, multiple dishes) served in a single meal (a menu, so to speak). That is, the "menu" includes, for example, "nikujaga" (meat and potatoes) and "hachitousai" (eight treasures dish). Note that the "menu" may also be a "menu" that includes multiple dishes, so to speak, and in this case, "menu" may be read as "menu" as appropriate. In this case, the provision eligibility determination system 100 can execute the processing described in this embodiment for each dish included in the menu (for example, "nikujaga" (meat and potatoes) and "hachitousai" (eight treasures dish)).

[0022] The subject information management device 300 is an information processing device that manages subject information related to subjects. Details of the subject information will be described later.

[0023] The subject information management device 300 can accept registration of subject information in response to, for example, an operation by an administrator of a facility used by the subject. At this time, the administrator of the facility may register the subject information based on, for example, information written on a medical questionnaire or a medical record.

[0024] The first camera 400 is a photographing device that photographs meal images and meal ticket images.

[0025] First camera 400 is installed, for example, in a predetermined space (e.g., a cafeteria) where multiple subjects receive provided meals. First camera 400 may be installed, for example, at a counter in the predetermined space that provides the provided meals to a server who delivers the meals to the subjects, and may capture meal images and meal ticket images when the provided meals are provided to the server.

[0026] Furthermore, first camera 400 may be, for example, a camera installed in a room used by the subject (for example, a private room or a shared room). In this case, first camera 400 may capture a meal image and a meal ticket image when the meal is served to the subject in the room.

[0027] The second camera 500 is a photographing device that photographs an image of the meal card and an image of the face of the target person.

[0028] The second camera 500 is installed, for example, in a predetermined space (e.g., a cafeteria) where multiple subjects receive provided meals, and can detect the provision of provided meals to each of the multiple subjects and capture a meal ticket image and an image of the subject's face. The second camera 500 may detect the provision of provided meals, for example, by detecting that a tray with the provided meal is handed to the subject, or that the subject or a person assisting the subject (e.g., a nurse, caregiver, etc.) raises their hand. At this time, in response to detecting the provision of the provided meal, the second camera 500 may zoom in on the provision and capture a meal ticket image and an image of the subject's face.

[0029] The first camera 400 and the second camera 500 may be the same camera or different cameras. Furthermore, the first camera 400 and the second camera 500 may be cameras dedicated to the processing in the provision admissibility determination system 100, or may be general-purpose cameras (for example, cameras that can also be used for surveillance or security purposes).

[0030] First camera 400 and second camera 500 may be, for example, cameras provided in an information processing device (for example, a portable information processing device) used by staff of a predetermined facility.

[0031] In Figure 2, one menu management device 200, one subject information management device 300, one first camera 400, and one second camera 500 are shown, but there may be multiple menu management devices 200, multiple subject information management devices 300, multiple first cameras 400, and multiple second cameras 500.

[0032] Next, details of the provision availability determination system 100 will be described. The provision availability determination system 100 includes a memory unit 110, an image acquisition unit 115, a subject information acquisition unit 120, a learning unit 125, a dietary condition identification unit 130, a menu identification unit 135, a content identification unit 140, an authentication unit 145, a provision availability determination unit 150, and a notification unit 155. Each unit shown in Fig. 2 can be realized, for example, by using a memory area or by a processor executing a program stored in the memory area.

[0033] The storage unit 110 stores information processed in the provision eligibility determination system 100. The storage unit 110 can store, for example, a meal image, a meal ticket image, target person information, specified meal condition information, specified menu information, specified form information, specified ingredient information, authentication result information, and determination result information, which will be described later.

[0034] The image acquisition unit 115 acquires a meal image of the meal provided to the subject, and a meal card image of a meal card provided to the subject along with the provided meal and bearing identification information identifying the subject and / or the conditions for the form of provision of the meal, and stores the acquired meal image and meal card image in the memory unit 110. The image acquisition unit 115 may store the acquired meal image and meal card image in the memory unit 110 in association with each other.

[0035] Here, the meal card is, for example, a card placed on a tray when serving food. Note that the material and shape of the meal card are not important.

[0036] Conventionally, meal cards may include, for example, information identifying the subject (e.g., the subject's name) and the subject's dietary requirements. In this case, the provider providing the meal to the subject will, for example, identify the name written on the meal card and the subject's face, confirm that the meal was prepared specifically for the subject, and then provide the meal to the subject. At this time, the provider will refer to the dietary requirements written on the meal card, check the meal at the time of provision, and confirm whether the meal meets the dietary requirements (i.e., for example, whether it does not contain ingredients that should not be given to the subject, or whether it is provided in a form appropriate for the subject), before providing the meal.

[0037] In this embodiment, the meal ticket only needs to include identification information that identifies the target person and / or the conditions for the meal to be served. The identification information may be text, a predetermined code (e.g., a barcode or a two-dimensional code), or an image.

[0038] Furthermore, the image acquisition unit 115 can acquire learning images of a learning menu that are used in the learning process of the learning unit 125, which will be described later.

[0039] 3 is a diagram showing an example of a food image, which includes multiple menus (for example, menu 301).

[0040] Fig. 4 is a diagram showing an example of a meal card. The meal card includes, for example, an area 401 in which identification information that identifies the target person is written, and an area 402 in which identification information that identifies the conditions for the serving format of the meal is written. In the example shown in Fig. 4, the respective pieces of information are written using text in areas 401 and 402, but instead of text, the meal card may also be written with information that can be read by a specified device (for example, a two-dimensional code).

[0041] The subject information acquisition unit 120 acquires subject information relating to the subject, and stores it in the storage unit 110.

[0042] The subject information acquisition unit 120 can acquire subject information from the subject information management device 300, for example.

[0043] The subject information acquisition unit 120 can acquire subject information of the subject corresponding to the meal card, for example, based on the identification information written on the meal card image. Specifically, if the identification information is information that identifies the subject, the subject information acquisition unit 120 accesses the subject information management device 300, for example, and acquires subject information corresponding to the subject indicated by the identification information. Furthermore, if the identification information is information that identifies meal conditions, the subject information acquisition unit 120 acquires the meal condition information written on the identification information as subject information.

[0044] The subject information includes, for example, identification information for identifying the subject (for example, ID, name, etc.) and dietary condition information regarding the dietary conditions of the subject.

[0045] 5 is a diagram showing an example of subject information stored in storage unit 110. The subject information stored in storage unit 110 includes, for example, a subject ID and dietary condition information. The dietary condition information includes, for example, allergy information related to the subject's allergies and form information related to the conditions for the form of food to be served to the subject.

[0046] The form information may be, for example, "bite-sized," "chopped," "extra-chopped," "mixer," or "mousse." Note that the number and names of the form categories are not limited to these.

[0047] The learning unit 125 learns the correspondence relationships used in the processing of the provision acceptability determination system 100, and stores the learned correspondence relationships in the storage unit 110. The learning unit 125 can learn, for example, menu correspondence relationships, form correspondence relationships, and ingredient correspondence relationships.

[0048] The menu correspondence is a correspondence that is learned based on a plurality of combinations of, for example, a learning image of a learning menu and learning menu information related to the learning menu. That is, the menu specification unit 135, which will be described later, can specify the menu information (for example, the menu name) included in a predetermined menu image by inputting the image of the menu to the menu correspondence.

[0049] 6A is a diagram showing an overview of the menu correspondence relationship. For example, the menu correspondence relationship is determined by receiving an input of a food image (S601) and identifying menu information included in the image (S602).

[0050] The form correspondence is a correspondence that is learned based on, for example, a plurality of combinations of each of a plurality of serving forms and a learning image in which the learning menu is cooked in each of the plurality of serving forms. That is, the content identification unit 140, which will be described later, can input an image of a menu into the form correspondence, thereby identifying the serving form (e.g., bite-sized, chopped, extra chopped, blender, mousse, etc.) of the menu included in the image.

[0051] The form correspondence relationship is, for example, a correspondence relationship obtained by learning the shapes of multiple serving forms for each menu (e.g., dish). The form correspondence relationship may be learned further based on menu information (e.g., menu name).

[0052] 6B is a diagram showing an overview of the form correspondence relationship. For example, the form correspondence relationship receives input of a meal image including an image of a predetermined menu (S603), and identifies the serving form of the menu included in the image (S604).

[0053] The ingredient correspondence relationship is a correspondence relationship that is learned based on multiple combinations of, for example, learning images, learning menu information, and learning ingredient information related to learning ingredients included in the learning menu. That is, the content identification unit 140, which will be described later, can identify ingredients included in a specific menu by inputting an image and menu information (for example, a menu name) of the menu into the ingredient correspondence relationship.

[0054] 6C is a diagram showing an outline of the ingredient correspondence relationship. For example, the ingredient correspondence relationship receives input of a meal image including an image of a predetermined menu (S605), and identifies ingredients included in the menu (S606).

[0055] The learning unit 125 can learn the menu correspondence relationship, the form correspondence relationship, and the ingredient correspondence relationship by, for example, machine learning. Note that the learning algorithm used by the learning unit 125 is not limited to this.

[0056] The meal condition identification unit 130 identifies the meal condition information corresponding to the meal card based on a condition correspondence relationship between the identification information and the meal condition information related to the conditions of the serving format, which is set in advance, and stores the identified meal condition information in the memory unit 110.

[0057] Here, the condition correspondence relationship may be, for example, subject information including a subject ID and meal condition information. In this case, the meal condition identification unit 130 can identify the meal condition information corresponding to the meal card based on the subject information.

[0058] In addition, if the meal card contains identification information that identifies the meal conditions, the meal condition identification unit 130 may, based on the identification information, identify the meal condition information indicated by the identification information as the meal condition information corresponding to the meal card.

[0059] The menu specification unit 135 specifies menu information relating to the menu included in the provided meal shown in the meal image based on the menu correspondence relationship, and stores the specified menu information in the storage unit 110.

[0060] The menu specification unit 135 can also specify menu information based on pre-set scheduled menu information related to a scheduled menu that can be provided to the subject. The scheduled menu information may be information managed by the menu management device 200, for example. This limits the menu candidates that can be included in the meal to be provided within the scope of the scheduled menu, allowing the provision eligibility determination system 100 to perform the menu specification process easily and with high accuracy.

[0061] The content specifying unit 140 specifies form information relating to the presentation form of each of the specified menus based on the form correspondence relationship, and stores the specified form information in the storage unit 110.

[0062] Furthermore, the content specifying unit 140 can further specify ingredient information related to ingredients included in the provided meal shown in the meal image based on the menu information, and store the specified ingredient information in the storage unit 110.

[0063] Furthermore, the content identification unit 140 can identify ingredient information further based on the ingredient correspondence relationship.

[0064] The specified ingredient information may be, for example, "carrot," "onion," "peanut," etc. The specified ingredient information may be ingredient information related to ingredients used in the menu, or may be only ingredient information related to allergenic ingredients among ingredients used in the menu.

[0065] The content identification unit 140 can also identify ingredient information based on a predetermined correspondence between the scheduled menu information and the scheduled ingredient information of scheduled ingredients that may be included in the scheduled menu. This limits the candidate ingredients that may be included in the menu to the range of scheduled ingredients, allowing the provision acceptability determination system 100 to simplify and increase the accuracy of the ingredient identification process.

[0066] The authentication unit 145 authenticates the target person to whom the meal is to be provided based on the information identifying the target person written on the meal ticket and information about the target person acquired when the meal is provided, and stores authentication result information regarding the authentication result in the storage unit 110. The authentication unit 145 can perform authentication processing, for example, when the identification information written on the meal ticket includes information identifying the target person.

[0067] The authentication unit 145 can perform authentication based on, for example, information identifying the subject written on the meal ticket and an image of the subject's face obtained when the meal is served, and store authentication result information regarding the authentication result in the memory unit 110.

[0068] In addition, the authentication unit 145 may authenticate the person to whom the meal is to be served, for example, based on information identifying the person contained in the meal card image captured by the second camera 500 and an image of the person's face captured by the second camera 500.

[0069] Here, the second camera 500 is installed, for example, in a predetermined space (e.g., a cafeteria) where multiple subjects receive provided meals, detects the provision of provided meals to each of the multiple subjects, and captures a meal card image and an image of the subject's face. That is, the authentication unit 145 can authenticate the subject who will receive the provided meal, for example, based on the meal card image and the image of the subject's face that are captured upon detecting the provision of the provided meal. In this way, the provision eligibility determination system 100 can ensure that the correct provided meal is provided to the correct subject, even in a predetermined space where multiple subjects receive provided meals.

[0070] The provision possibility determination unit 150 determines whether the provision of the meal shown in the meal image is possible based on the identified meal condition information and morphology information, and stores determination result information relating to the determination result in the storage unit 110.

[0071] The provision possibility determination unit 150 can determine that the provision of the provided meal is possible, for example, when the form indicated by the specified form information (i.e., the provision form of the menu included in the provided meal) satisfies the dietary conditions indicated by the specified dietary condition information (i.e., the dietary conditions of the subject). This allows the provision possibility determination system 100 to determine whether or not to provide the meal, taking into account the provision form of the menu included in the provided meal.

[0072] Furthermore, the serve acceptability determination unit 150 can determine whether or not to serve the meal based further on the ingredient information. That is, the serve acceptability determination unit 150 can determine that the provided meal can be served if, for example, the ingredients indicated by the ingredient information (i.e., the ingredients included in the provided meal) satisfy the dietary conditions indicated by the identified dietary condition information (i.e., the dietary conditions of the subject). This allows the serve acceptability determination system 100 to determine whether or not to serve the meal by further considering the ingredients included in the provided meal.

[0073] Furthermore, the provision permission determination unit 150 can determine whether or not to provide the meal further based on the authentication result (for example, authentication result information). That is, the provision permission determination unit 150 can determine that the provided meal can be provided when, for example, it is determined that the subject indicated on the meal ticket and the person to whom the provided meal is to be provided match through authentication processing by the authentication unit 145 further based on the authentication result. This allows the provision permission determination system 100 to determine whether or not to provide the meal taking into account the ingredients contained in the provided meal.

[0074] The provision admissibility determination unit 150 may perform a first provision admissibility determination process and a second provision admissibility determination process. In the first provision admissibility determination process, the provision admissibility determination unit 150 may determine whether to provide the provided meal shown in the meal image, for example, based on the identified meal condition information and morphology information, or further based on ingredient information. In the second provision admissibility determination process, the provision admissibility determination unit 150 may determine whether to provide the meal based on the authentication result. This allows the provision admissibility determination unit 150 to perform the provision admissibility determination process in two stages. This allows the subject to be provided with an appropriate provided meal, for example, even if the counter where the provided meal is served and the place where the subject receives the provided meal are separate (for example, in the case of a cafeteria).

[0075] The result of the determination by the provision availability determination unit 150 is not limited to "yes" or "no", but may be, for example, "confirmation required" to call the attention of the provider who provides the provided meal.

[0076] The notification unit 155 notifies an external information processing device of warning information based on the determination result (for example, determination result information). The notification unit 155 can notify, for example, a device (for example, a portable information processing device) used by a staff member of a facility used by the subject of the warning information.

[0077] For example, when it is determined based on the result of the determination that the provision of the provided meal is possible, the notification unit 155 can notify the determination result that it is possible. Also, for example, when it is determined based on the result of the determination that the provision of the provided meal is impossible, the notification unit 155 can notify the determination result that it is impossible.

[0078] The notification unit 155 may, for example, only notify in the case of either "OK" or "NO" and not notify in the case of the other. Specifically, the notification unit 155 can notify the determination result of "NO" only when it is determined that the provision of the provided meal is not possible. This allows for effective attention to be drawn to the person receiving the notification (for example, staff).

[0079] 7 is a flowchart showing an example of processing in the provision permission determination system 100. The flowchart shown in FIG.

[0080] First, the provision acceptability determination system 100 (e.g., the learning information acquisition unit) acquires learning information (e.g., learning images, learning menu information, etc.) (S701). At this time, the image acquisition unit 115 may acquire learning images of learning menus. Next, the learning unit 125 learns menu correspondence relationships, shape correspondence relationships, and ingredient correspondence relationships based on the learning information (S702).

[0081] 8 is a flowchart showing an example of processing in the provision permission determination system 100. The flowchart shown in FIG.

[0082] First, the image acquisition unit 115 acquires a meal image and a meal ticket image (S801), and the subject information acquisition unit 120 acquires subject information (S802).

[0083] The meal condition identification unit 130 identifies the meal conditions corresponding to the meal card based on the condition correspondence relationship (S803). The menu identification unit 135 identifies menu information related to the menu items included in the meal shown in the meal image based on the menu correspondence relationship, and the content identification unit 140 identifies form information related to the serving form of each identified menu item (S804). At this time, the content identification unit 140 may also identify ingredient information corresponding to the menu information based on the ingredient correspondence relationship.

[0084] The authentication unit 145 authenticates the person to whom the meal is to be provided (S805). The provision permission determination unit 150 determines whether the meal is to be provided (S806). The notification unit 155 notifies the result of the determination (S807).

[0085] 8 may be changed as appropriate. For example, the process by the meal condition specification unit 130 may be executed before the process by the provision availability determination unit 150, or may be executed after the processes by the menu specification unit 135 and the content specification unit 140.

[0086] The provision advisability determination system 100 can be used, for example, when a staff member of a facility provides a meal to a subject in the subject's room (for example, the room where the subject's bed is located) in the facility used by the subject. Note that the subject's room may be, for example, a private room or a shared room.

[0087] In this case, for example, a staff member delivers the provided meal to the subject's room. The staff member uses a device (e.g., a portable information processing device) to photograph the provided meal and the meal ticket and provide the photograph to the provision eligibility determination system 100, and the image acquisition unit 115 acquires the meal image and the meal ticket image. Next, whether or not the meal can be provided is determined by a process similar to that shown in FIG. 8, and the notification unit 155 notifies the staff member (e.g., a device used by the staff member) of the determination result. At this time, the staff member may also photograph the subject's face using the device used by the staff member, and the authentication unit 145 may perform authentication processing based on the photographed image.

[0088] Furthermore, the provision eligibility determination system 100 can be used, for example, in a designated space (e.g., a cafeteria) in a facility used by the subject where multiple subjects receive provided meals, when staff at the facility provide the provided meals to the subject.

[0089] An example of a cafeteria will be described. A cafeteria may include, for example, a counter where a server who delivers the food to the subject receives the food, and a dining space where multiple subjects eat. For example, when a counter staff member provides a meal to the server at the counter, a first camera 400 installed at the counter captures an image of the food and a meal ticket image and provides them to the provision eligibility determination system 100, and the image acquisition unit 115 acquires the image of the food and the meal ticket image. Next, a determination is made as to whether the food is to be provided using a process similar to that shown in FIG. 8, and the notification unit 155 notifies the counter staff or the server (for example, a device used by the counter staff or the server) of the determination result. The server receives the provided food according to the result of the determination and delivers it to the subject.

[0090] The server serves the provided meal to the target person and performs a predetermined action (for example, raising their hand). The second camera 500 detects this predetermined action as the serving of the provided meal, acquires an image of the meal ticket and an image of the target person's face, and the authentication unit 145 authenticates them. The serving permission determination unit 150 then further determines whether or not to serve the meal based on the results of the authentication process, and the notification unit 155 notifies them. Depending on the result of the determination, the server allows the target person to eat the provided meal.

[0091] In this way, the provision acceptability determination system 100 can learn the provision form of the provided meal and determine whether or not to provide it based on the provision form. This allows the provision acceptability determination system 100 to provide a provided meal that is suitable for the subject.

[0092] Furthermore, the provision eligibility determination system 100 can perform provision eligibility determination in two stages: first, determining whether or not to provide the meal based on the form of provision of the meal and the meal conditions written on the meal ticket, and second, determining whether or not to provide the meal based on the results of the authentication process by the authentication unit 145 (i.e., information about the person to whom the meal will be provided (e.g., a facial image) and the identification information written on the meal ticket). This makes it possible to provide an appropriate meal to the person, even if, for example, the counter where the meal is provided and the place where the person receives the meal are separate (e.g., in the case of a cafeteria).

[0093] The above describes one embodiment of the present invention. The serving availability determination system 100 acquires a meal image and a meal card image, identifies meal condition information corresponding to the meal card based on the condition correspondence relationship, identifies menu information related to the menu items included in the meal to be served based on the menu correspondence relationship, identifies form information related to the serving form of each identified menu item based on the form correspondence relationship, and determines whether or not to serve the meal shown in the meal image based on the identified meal condition information and form information. This allows the serving availability determination system 100 to determine whether or not to serve the meal, taking into account the menu serving form.

[0094] Furthermore, the provision admissibility determination system 100 can notify an external information processing device of warning information based on the determination result, thereby enabling the provision admissibility determination system 100 to notify the determination result, for example, to staff at a facility used by the subject.

[0095] Furthermore, the serve acceptability determination system 100 can further identify ingredient information regarding ingredients contained in the provided meal based on the menu information, and determine whether or not to serve the meal based on the ingredient information. The serve acceptability determination system 100 can also identify ingredient information based on ingredient correspondences. This allows the serve acceptability determination system 100 to determine whether or not to serve the meal, taking into account the ingredients contained in the provided meal, for example, the presence or absence of allergenic ingredients.

[0096] Furthermore, the provision availability determination system 100 can specify menu information further based on the scheduled menu information, which allows the provision availability determination system 100 to specify a menu within the scheduled menu range easily and with high accuracy.

[0097] Furthermore, the serving acceptability determination system 100 can identify ingredient information based on the planned ingredient correspondence relationship, which allows the serving acceptability determination system 100 to easily and accurately identify ingredients within the range of planned ingredients.

[0098] Furthermore, the provision eligibility determination system 100 can authenticate the person to whom the meal is to be provided based on the information identifying the person written on the meal ticket and the information about the person acquired when the meal is provided, and can determine whether or not to provide the meal based on the authentication results. This allows the provision eligibility determination system 100 to authenticate the person to whom the meal is to be provided and provide the meal, preventing incorrect serving of the meal.

[0099] Furthermore, the provision acceptability determination system 100 can perform authentication based on an image of the subject's face.

[0100] Furthermore, the provision adequacy determination system 100 detects the provision of the provided meal to each of the multiple subjects using a camera installed in a predetermined space where multiple subjects receive the provided meals, and can determine whether or not to provide the meal based on the captured meal ticket image and the facial image of the subject. As a result, the provision adequacy determination system 100 can prevent incorrect serving of meals even when multiple subjects each receive the provided meals in a cafeteria, for example.

[0101] It should be noted that the present embodiment is provided to facilitate understanding of the present invention and is not intended to limit the present invention. The present invention may be modified or improved without departing from the spirit thereof, and equivalents thereof are also included in the present invention.

[0102] In addition, in the present invention, a "unit" does not simply mean a physical means, but also includes cases where the functions of the "unit" are realized by software. Furthermore, the functions of one "unit" or device may be realized by two or more physical means, devices, or software, and the functions of two or more "units" or devices may be realized by one physical means, device, or software. [Explanation of symbols]

[0103] 100 Provision possibility determination system, 110 memory unit, 115 image acquisition unit, 120 subject information acquisition unit, 125 learning unit, 130 dietary condition identification unit, 135 menu identification unit, 140 content identification unit, 145 authentication unit, 150 provision possibility determination unit, 155 notification unit, 200 menu management device, 300 subject information management device, 400 first camera, 500 second camera

Claims

1. an image acquisition unit that acquires a meal image of the meal provided to the subject, and a meal card image of a meal card that is provided to the subject together with the meal and that contains identification information that identifies the subject and / or the conditions of the meal's provision format; a meal condition specification unit that specifies the meal condition information corresponding to the meal ticket based on a condition correspondence relationship between the identification information and meal condition information relating to the conditions of the serving format, which is set in advance; a menu identification unit that identifies menu information related to a menu included in the provided meal shown by the meal image based on a menu correspondence relationship learned based on a plurality of combinations of a learning image of a learning menu and learning menu information related to the learning menu; a content identification unit that identifies form information regarding the serving form of each of the identified menus based on form correspondence relationships learned based on multiple combinations of each of a plurality of serving forms and training images of training menus cooked in each of the plurality of serving forms; a provision availability determination unit that determines whether the provided meal shown in the meal image can be provided based on the specified meal condition information and the morphology information; A provision availability determination system comprising:

2. The provision possibility determination system according to claim 1 , further comprising a notification unit that notifies an external information processing device of warning information based on a result of the determination.

3. The content identification unit further identifies ingredient information related to ingredients included in the provided meal shown in the meal image based on the menu information, The provision availability determination unit determines whether or not the food is available based further on the ingredient information. The provision possibility determination system according to claim 1 or 2.

4. The provision eligibility determination system of claim 3, wherein the content identification unit further identifies the ingredient information corresponding to the menu information based on an ingredient correspondence relationship learned based on multiple combinations of the learning image, the learning menu information, and learning ingredient information related to learning ingredients included in the learning menu.

5. The provision possibility determination system according to claim 1 or 2, wherein the menu specification unit specifies the menu information further based on scheduled menu information relating to a scheduled menu that is set in advance and that may be provided to the subject.

6. The menu specifying unit specifies the menu information further based on scheduled menu information regarding a scheduled menu that may be provided to the subject, which is set in advance; the content specifying unit specifies the ingredient information based on a predetermined correspondence relationship between the scheduled menu information and scheduled ingredient information of scheduled ingredients that may be included in the scheduled menu. The provision possibility determination system according to claim 4 .

7. the identification information includes information that identifies the subject; The provision determination system further includes an authentication unit that authenticates the target person to whom the provided meal is provided based on information identifying the target person written on the meal ticket and information about the target person acquired when the provided meal is provided, the provision permission determination unit determines whether or not to provide the information further based on a result of the authentication. The provision possibility determination system according to claim 1 or 2.

8. The provision acceptability determination system according to claim 7 , wherein the information about the subject is an image of the subject's face.

9. Further provided is a first camera that captures the meal image and the meal ticket image, The image acquisition unit acquires the meal image and the meal ticket image photographed by the first camera. The provision possibility determination system according to claim 1 or 2.

10. the identification information includes information that identifies the subject; The provision availability determination system includes: a second camera for capturing the meal ticket image and an image of the subject's face; an authentication unit that authenticates the target person who will be provided with the meal based on information identifying the target person included in the meal ticket image captured by the second camera and an image of the target person's face captured by the second camera; Furthermore, the provision permission determination unit determines whether or not to provide the information further based on a result of the authentication. The provision possibility determination system according to claim 9 .

11. The provision possibility determination system described in claim 10, wherein the second camera is installed in a specified space where multiple subjects receive the provided meals, detects the provision of the provided meals to each of the multiple subjects, and captures the meal ticket image and an image of the subject's face.

12. The computer an image acquisition unit that acquires a meal image of the meal provided to the subject, and a meal card image of a meal card that is provided to the subject together with the meal and that contains identification information that identifies the subject and / or the conditions of the meal's provision format; Identifying the meal condition information corresponding to the meal ticket based on a condition correspondence relationship between the identification information and meal condition information relating to the conditions of the serving format, which is set in advance; Identifying menu information related to the menu included in the provided meal shown by the meal image based on a menu correspondence relationship learned based on a plurality of combinations of a learning image of a learning menu and learning menu information related to the learning menu; Identifying form information relating to the serving form of each of the identified menus based on form correspondence relationships learned based on a plurality of combinations of each of a plurality of serving forms and learning images of the learning menus cooked in each of the plurality of serving forms; determining whether or not the meal shown in the meal image can be provided based on the specified meal condition information and the morphology information; Method of determining availability.

13. On the computer, an image acquisition unit that acquires a meal image of the meal provided to the subject, and a meal card image of a meal card that is provided to the subject together with the meal and that contains identification information that identifies the subject and / or the conditions of the meal's provision format; a meal condition specification unit that specifies the meal condition information corresponding to the meal ticket based on a condition correspondence relationship between the identification information and meal condition information relating to the conditions of the serving format, which is set in advance; a menu identification unit that identifies menu information related to a menu included in the provided meal shown by the meal image based on a menu correspondence relationship learned based on a plurality of combinations of a learning image of a learning menu and learning menu information related to the learning menu; a content identification unit that identifies form information regarding the serving form of each of the identified menus based on form correspondence relationships learned based on multiple combinations of each of a plurality of serving forms and training images of training menus cooked in each of the plurality of serving forms; a provision availability determination unit that determines whether the provided meal shown in the meal image can be provided based on the specified meal condition information and the morphology information; A provision availability determination program that includes the above.

Images