Information processing device

Abstract

[Problem] To facilitate setting of appropriate inspection items in food hygiene inspection. [Solution] In the present invention, a dish image acquisition unit 202 acquires the image of a dish that is the object of inspection work and transmits the acquired image of the dish to a server device 10. An article information acquisition unit 101 specifies the dish represented by the transmitted image and acquires the name of the specified dish as article information. An inspection information output unit 104 refers to an inspection item storage unit 103 and reads out inspection items associated with foodstuffs included in the dish of the article indicated by the acquired article information. The inspection information output unit 104 outputs the read-out inspection items to a user terminal 20. An inspection information storage unit 203 stores the inspection items outputted from the server device 10. An inspection processing unit 204 displays an inspection screen image including the stored inspection items and performs an inspection process for, e.g., accepting input for inspection by a person in charge of inspection.

Description

[Technical field]

[0001] The present invention relates to food hygiene management. [Background technology]

[0002] Patent Document 1 discloses a technology relating to food hygiene management in which a document is created with an appropriate temperature range item indicating the appropriate temperature range for each food ingredient or dish item, and if either an upper or lower limit value is associated with the appropriate temperature range item for each food ingredient or dish item, the upper or lower limit value is drawn at one end of the item and an out-of-range indicator is drawn to indicate that the appropriate temperature range has been exceeded. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2011-204171 A Summary of the Invention [Problem to be solved by the invention]

[0004] The importance of food hygiene inspections in facilities that handle food is increasing due to circumstances such as the mandatory implementation of HACCP (Hazard Analysis and Critical Control Point), but in facilities of a size that does not have food hygiene inspection experts, it is difficult to determine appropriate inspection items. Therefore, an object of the present invention is to facilitate the setting of appropriate inspection items for food hygiene inspections. [Means for solving the problem]

[0005] In order to achieve the above object, the present invention provides a food processing system including: an acquisition unit that acquires item information indicating items of dishes served in a food processing facility; a storage unit that stores ingredients in association with inspection items required for the ingredients; an identification unit that identifies ingredients contained in the dish indicated by the acquired item information; and an output unit that outputs the inspection items stored in association with the identified ingredients. a recognition unit that recognizes the name of a dish contained in a captured image; Equipped with The acquisition unit acquires the name recognized by the recognition unit as the item information. An information processing device is provided.

[0007] In addition, when the recognition unit cannot recognize the name of the dish contained in the photographed image, the recognition unit may recognize the ingredients contained in the image, and the acquisition unit may acquire the recognized names of the ingredients as the item.

[0008] The identification unit may also identify ingredients defined as ingredients commonly included in a dish of the item indicated by the acquired item information as ingredients included in the dish.

[0009] In addition, when there are multiple combinations of ingredients included in a dish of the item indicated by the acquired item information, the identification unit may identify all ingredients that are included in at least one of the multiple combinations as ingredients included in the dish.

[0010] The food processing device may further include an adding unit that adds ingredients specified by a user as ingredients to be contained in the dish, in addition to the ingredients identified as ingredients to be contained in the dish, as ingredients to be contained in the dish.

[0011] The food processing device may further include an exclusion unit that excludes, from among the ingredients identified as ingredients contained in the dish, ingredients that are specified by the user as ingredients not to be contained in the dish, from the ingredients contained in the dish.

[0012] The output unit may also refer to a list of ingredients that cause allergies, and output the test items corresponding to ingredients included in the list in a format different from that of test items corresponding to ingredients not included in the list.

[0013] In addition, the acquisition unit may acquire cooking information indicating a cooking method in addition to the item information, the memory unit may store the inspection items in association with the cooking method of the ingredients in addition to the ingredients, and the identification unit may identify ingredients included in a dish of an item indicated by the acquired item information and a dish of a cooking method indicated by the acquired cooking information. Effect of the Invention

[0014] According to the present invention, it is possible to easily set appropriate inspection items for food hygiene inspection. [Brief description of the drawings]

[0015] [Figure 1] FIG. 1 is a diagram illustrating an example of an overall configuration of an examination support system according to an embodiment. [Diagram 2] FIG. 2 illustrates an example of a hardware configuration of a server device. [Diagram 3] FIG. 1 is a diagram illustrating an example of a hardware configuration of a user terminal. [Figure 4] A diagram showing the functional configuration realized by each device [Diagram 5] FIG. 13 is a diagram illustrating an example of a screen for inputting dish items. [Figure 6] FIG. 1 is a diagram illustrating an example of stored test items. [Figure 7] FIG. 13 is a diagram illustrating an example of test items stored in a user terminal. [Figure 8] FIG. 13 is a diagram illustrating an example of a displayed inspection screen. [Figure 9] FIG. 13 is a diagram showing an example of an enlarged display of a selected test item. [Figure 10] FIG. 1 is a diagram illustrating an example of a test result table. [Figure 11] A diagram showing an example of the displayed tally results [Figure 12] FIG. 1 is a diagram illustrating an example of an operation procedure of each device in an output process. [Figure 13] A diagram showing an example of the displayed inspection items and items [Figure 14] A diagram showing an example of the displayed inspection items and items [Figure 15]FIG. 13 is a diagram illustrating an example of a displayed inspection screen. [Figure 16] A diagram showing an example of a displayed substitute ingredient [Figure 17] FIG. 13 is a diagram illustrating an example of an examination item table according to a modified example. [Figure 18] FIG. 13 is a diagram illustrating an example of a screen for inputting dish items according to a modified example. [Figure 19] An example of a displayed consumer web page. [Figure 20] A diagram showing an example of a displayed web page for administrators. [Explanation of symbols]

[0016] 1... inspection support system, 10... server device, 20... user terminal, 101... item information acquisition unit, 102... foodstuff identification unit, 103... inspection item storage unit, 104... inspection information output unit, 201... item input reception unit, 202... food image acquisition unit, 203... inspection information storage unit, 204... inspection processing unit. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0017] [1] First Example 1 shows an example of the overall configuration of an inspection support system 1 according to an embodiment. The inspection support system 1 is a system that supports inspection work, which is one of the tasks related to food hygiene management in facilities that handle food. The inspection work is a task of determining whether the state of food hygiene in a facility meets standards required for safety (for example, standards established by HACCP (Hazard Analysis and Critical Control Point)) and inputting the determination results.

[0018] Facilities that handle food include, for example, restaurants, food and beverage retailers, food and beverage warehouses, and food and beverage manufacturing plants, and are also facilities where food hygiene inspections are conducted. In these facilities, a person in charge of food hygiene inspections is designated, but the person in charge of inspection work does not necessarily have specialized knowledge or experience in food hygiene inspections.

[0019] For example, in stores that set up stalls at food sales events, restaurants in shopping malls, or self-employed restaurants in shopping districts, there are no specialized inspectors, so inspections are carried out by employees who are not familiar with food hygiene inspections. Inspection support system 1 particularly supports the inspection work of such staff who do not have specialized knowledge or experience in food hygiene inspection.

[0020] The test support system 1 includes a network 2, a server device 10, and a user terminal 20. The network 2 is a communication system including a mobile communication network and the Internet, and relays data exchange between devices accessing the system. The server device 10 accesses the network 2 via wired communication (or wireless communication), and the user terminal 20 accesses the network 2 via wireless communication (or wired communication).

[0021] User terminal 20 is a terminal used by an inspector who performs inspection work in a facility that handles food. An inspector is, for example, an employee in charge of inspection work among employees of a facility that handles food. User terminal 20 stores items to be inspected and displays the stored items. An inspector performs inspections on the displayed items and inputs the inspection results into user terminal 20. Although only one user terminal 20 is shown in FIG. 1, if there are many facilities to be inspected, multiple inspectors will each use multiple user terminals 20 to perform multiple inspections in parallel.

[0022] The server device 10 performs processes such as managing information related to examinations performed by multiple user terminals 20. The server device 10 is an example of the "information processing device" of the present invention. The information related to the examinations includes the above-mentioned examination items and the examination results for each examination item. The processes performed by the server device 10 will be described in detail later.

[0023] 2 shows an example of a hardware configuration of the server device 10. The server device 10 is a computer including a processor 11, a memory 12, a storage 13, a communication device 14, and a bus 15. The processor 11 controls the entire computer by running, for example, an operating system. The processor 11 includes a central processing unit (CPU) including an interface with peripheral devices, a control device, an arithmetic unit, a register, and the like.

[0024] The processor 11 reads programs, data, etc. from at least one of the storage 13 and the communication device 14 into the memory 12, and executes various processes according to the read programs, etc. The memory 12 is a computer-readable recording medium such as a ROM (Read Only Memory) and a RAM (Random Access Memory). The storage 13 is a computer-readable recording medium such as a hard disk drive.

[0025] The communication device 14 is hardware (transmitting / receiving device) for performing communication between computers via at least one of a wired network and a wireless network. Each device, such as the processor 11 and the memory 12, is connected by a bus 15 for communicating information. The bus 15 may be configured using a single bus, or may be configured using different buses between each device.

[0026] Fig. 3 shows an example of the hardware configuration of the user terminal 20. The user terminal 20 is a computer including a processor 21, a memory 22, a storage 23, a communication device 24, an input device 25, an output device 26, an imaging device 27, and a bus 28. The processor 21 and other hardware having the same name as that shown in Fig. 2 are the same type of hardware as that shown in Fig. 2, although there are differences in performance and specifications.

[0027] The input device 25 is an input device (e.g., a switch, a button, a sensor, etc.) that accepts input from the outside. The input device 25 includes an imaging device (e.g., a digital camera, etc.) that takes pictures. The output device 26 is an output device (e.g., a display, a speaker, an LED lamp, etc.) that performs output to the outside. In the user terminal 20, the input device 25 and the output device 26 include an integrated configuration (a touch screen in which a display and a touch panel are integrated). The imaging device 27 includes a lens, an optical system, an image sensor, etc., and captures an image represented by light that reaches the image sensor.

[0028] The functions of each device in the test support system 1 are realized by loading specific software (programs) onto each hardware such as processor and memory, causing the processor to perform calculations, control communications by each communication device, and control at least one of reading and writing of data in memory and storage.

[0029] 4 shows the functional configuration realized by each device. The server device 10 comprises an item information acquisition unit 101, an ingredient identification unit 102, an inspection item storage unit 103, and an inspection information output unit 104. The user terminal 20 comprises an item input reception unit 201, a dish image acquisition unit 202, an inspection information storage unit 203, and an inspection processing unit 204.

[0030] The item information acquisition unit 101 of the server device 10 acquires item information indicating the items of dishes served in a facility that handles food. An item is a term that indicates a type of dish, and is expressed by terms such as "curry rice," "spaghetti," "hamburger steak," and "salad." In this embodiment, the item information acquisition unit 101 acquires item information by receiving information transmitted from the user terminal 20.

[0031] The item input receiving unit 201 of the user terminal 20 receives an operation to input dish item information. The item input receiving unit 201 displays an input screen for item information. Fig. 5 shows an example of a screen for inputting dish item information. In the example of Fig. 5, the item input receiving unit 201 displays a character string "Please enter the dish item", item information input fields A1, A2, and A3, and a confirm button B1.

[0032] A character string representing the item "curry rice" is entered in the input field A1. This character string may be entered character by character, or may be selected from a displayed pull-down list. When the confirm button B1 is pressed with the item information entered, the item input receiving unit 201 transmits the entered item information to the server device 10. The item information acquiring unit 101 of the server device 10 acquires the transmitted item information as item information indicating the item entered by the user.

[0033] The file name of the image, "xxx.jpg", is entered in input field A2. This image is supplied from, for example, user terminal 20. The food image acquisition unit 202 of user terminal 20 acquires an image of the food that is the subject of the inspection work. For example, the food image acquisition unit 202 acquires a photo of the food taken by imaging device 27 of the user terminal 20 as the food image. The food image acquisition unit 202 also acquires a photo of the food taken by the user with a digital camera other than the user terminal via wireless communication or a recording medium as the food image.

[0034] The food image acquisition unit 202 transmits the acquired food image to the server device 10. The item information acquisition unit 101 of the server device 10 calculates the feature amount of the food shown in the transmitted image using a well-known pattern matching technique. As the feature amount of the food image, for example, one or more of SIFT (Scaled Invariance Feature Transform) feature amount, SURF (Speed-Up Robust Features) feature amount, HOG (Histograms of Oriented Gradients) feature amount, etc. may be used.

[0035] The item information acquisition unit 101 identifies, from among pre-stored pattern images of food, images having features similar to those of the acquired food image. The item information acquisition unit 101 recognizes the name of the food represented by the identified pattern image, i.e., the name of the food included in the captured image, and acquires the recognized name as item information. The item information acquisition unit 101 is an example of the "recognition unit" of the present invention. After acquiring item information as described above, the item information acquisition unit 101 supplies the acquired item information to the ingredient identification unit 102.

[0036] The ingredient identification unit 102 identifies ingredients contained in a dish of an item indicated by the item information acquired by the item information acquisition unit 101. The ingredient identification unit 102 is an example of the "identification unit" of the present invention. When the ingredient identification unit 102 is supplied with item information from the item information acquisition unit 101, it refers to the inspection item storage unit 103. The inspection item storage unit 103 stores ingredients defined as generally contained in dishes to be inspected in the inspection support system 1 in association with the inspection items required for the ingredients. This definition is performed, for example, by the business entity providing the inspection support system 1.

[0037] FIG. 6 shows an example of stored test items. In the example of FIG. 6, the test item storage unit 103 stores ingredients "C1-1", "C1-2", and "C1-3" and test items "K1-1", "K1-2", and "K1-3" in association with an item of dish "curry rice". Also, the test item storage unit 103 stores ingredients "C2-1", "C2-2", and "C2-3" and test items "K2-1", "K2-2", and "K2-3" in association with an item of dish "spaghetti". Note that the number of ingredients is not limited to three, and may be one or more.

[0038] The ingredient identification unit 102 refers to the inspection item storage unit 103 and identifies ingredients stored in association with the item indicated by the item information supplied from the item information acquisition unit 101, i.e., ingredients defined as ingredients commonly included in dishes of that item, as ingredients included in the dish of that item. The ingredient identification unit 102 notifies the inspection information output unit 104 of the identified ingredients. The inspection information output unit 104 outputs to the user terminal 20 the inspection items associated with the notified ingredients, i.e., ingredients included in the dish of the item indicated by the acquired item information.

[0039] Specifically, the inspection information output unit 104 reads out the inspection items stored in the inspection item storage unit 103 in association with the notified ingredient, and outputs the item data indicating the read inspection items and the items indicated by the acquired item information to the user terminal 20. The inspection information storage unit 203 of the user terminal 20 stores the inspection items indicated by the item data output from the server device 10 in association with the dish item indicated by the same item data.

[0040] Fig. 7 shows an example of test items stored in the user terminal 20. In the example of Fig. 7, the test information storage unit 203 stores test items "K1-1", "K1-2", and "K1-3" in association with a food item "curry rice". The test information storage unit 203 also stores test items "K4-1", "K4-2", "K4-3", and "K4-4" in association with a food item "hayashi rice".

[0041] By storing the inspection items as described above, the food hygiene inspection is ready. The inspection processing unit 204 performs processing to perform a food hygiene inspection using the inspection items stored in the inspection information storage unit 203. The inspection processing unit 204 first displays an inspection screen for the relevant facility.

[0042] Fig. 8 shows an example of a displayed inspection screen. In the example of Fig. 8, the inspection processing unit 204 displays an inspection list including the major items of "Employee" tab T1, "Foodstuff" tab T2, "Utensils and tableware" tab T3, "Storage status" tab T4, and "Environment" tab T5, as well as a "Judgment" tab T6, which will be described later, with tab T1 open. The display area C1 for "Employee" includes the medium items of "Handwashing" display area D1, "Clothing" display area D2, and "Visual inspection of hands" display area D3.

[0043] The subsequent displays are also performed by the inspection processing unit 204. Inspection items, etc. are displayed in the display area for each medium item. When the display area C1 is scrolled, the display area for medium items and the inspection items that are not displayed are displayed. On the left side of the inspection items, an NG button E1, a photo button E2, a comment button E3, and an OK button E4 are displayed. When the inspector selects an inspection item for which he or she wishes to enter the inspection results by tapping or other operation, the inspection processing unit 204 enlarges and displays only the selected inspection item.

[0044] Fig. 9 shows an example of an enlarged display of a selected test item. In the example of Fig. 9, test item K-4 is displayed in an enlarged state. When the NG button E1 is pressed in the enlarged state, an "x" mark (a mark indicating that the test result is NG, i.e., a failure) is displayed, and when the OK button E4 is pressed, an "o" mark (a mark indicating that the test result is OK) is displayed. When the photo input field E5 is tapped, for example, the imaging device of the user terminal 20 is started and a photo is taken by the user's operation, and the taken photo is displayed in the photo input field E5.

[0045] It should be noted that when the photo input field E5 is tapped, a photograph that has been taken and is stored in the user terminal 20 may be imported. A comment may be manually input into the comment input field E6, or a comment may be input by selecting an example sentence included in a list of comment example sentences E7. When the inspection processing unit 204 receives an input operation of the inspection result, it displays the result of the received input operation.

[0046] When the pause button B2 is tapped, the test processing unit 204 determines that input to the enlarged test item K-4 is to be temporarily paused, and returns to the test screen of Fig. 8 to display the list of test items. When the input completion button B3 is tapped, the test processing unit 204 determines that input to the enlarged test item K-4 is completed, and returns to the test screen of Fig. 8 to display the list of test items.

[0047] Furthermore, the inspection processing unit 204 stores an inspection result table, and when the input completion button B3 is tapped, the result of the input operation up to that point is reflected in the inspection result table as the inspection result. An example of the test result table is shown in Fig. 10. The test result table stores "facility ID", "number of tests", "test item", "NG", "OK", "photo", "comment", and "input date and time" in association with each other.

[0048] The "facility ID" and "number of tests" are stored when the test processing unit 204 generates a test result table. In the example of FIG. 10, since this is the first time that a test result table for the relevant facility ID has been generated, "1" is stored as the "number of tests." "NG" means that the test failed, and "OK" means that the test passed. An "NG" input is represented by an "X," and an "OK" input is represented by an "O."

[0049] The photos are represented by the file names of the two data, and the comments are represented by the file name of the text data. The input date and time are represented as year, month, and day, but the exact time may also be represented. The inspection processing unit 204 refers to the inspection results stored in the inspection result table and performs a counting process of the inspection results. The counting process is a process in which the total number of common inspection results (e.g., OK inspection results) is calculated as the count value.

[0050] The tallying process also includes a process of calculating another value based on the calculated tally. Specifically, the inspection processing unit 204 tally up the OK inspection results and calculates the ratio of the OK tally to the total number of inspection items (hereinafter referred to as the "evaluation rate") for each major item and for the whole. The higher the evaluation rate, the more work that should be performed for sanitation management is being performed, and it can be used as an index that indicates that safer food can be expected to be supplied.

[0051] When calculating the evaluation rate, the inspection processing unit 204 handles the inspection results of each inspection item by weighting rather than treating them uniformly. For example, if there are 50 inspection items, the evaluation rate will decrease by 2% for each NG if they are handled uniformly. In contrast, by weighting each inspection item, the evaluation rate is calculated so that, for example, if an inspection item with high importance is NG, the evaluation rate will decrease by 3%, and if an inspection item with low importance is NG, the evaluation rate will decrease by 1%.

[0052] The importance level means that, for example, the greater the impact of an inspection item on food hygiene, the higher the importance level. By weighting the items with the importance level taken into consideration, the reliability of the evaluation rate as the above-mentioned index can be increased compared to when the importance level is not taken into consideration. When the "Judgment" tab T6 shown in FIG. 8 is pressed, the inspection processing unit 204 displays the results of the previous tabulation.

[0053] 11 shows an example of the displayed tally results. The inspection processing unit 204 displays a result table F1 showing the evaluation rate for each major category, a radar chart F2 showing the evaluation rate for each major category, and an input confirmation button B4. The inspection processing unit 204 also displays the overall evaluation rate as an "overall evaluation," and displays the character string "Excellent Store," which is a name determined according to the overall evaluation, and "S," which is an evaluation rank determined according to the overall evaluation.

[0054] These names and evaluation ranks are determined according to the overall evaluation value, for example, "Excellent store" and "S", "Excellent store" and "A", "Good store" and "B", "Needs improvement" and "C". When the input confirmation button B4 displayed on the inspection screen is pressed, the inspection processing unit 204 updates and stores the inspection results table. The stored inspection results include the facility ID and the number of inspections, so it is possible to know which facility and which inspection results are for which facility.

[0055] Based on the above configuration, the server device 10 and the user terminal 20 perform an output process for outputting the inspection items based on the acquired item information. 12 shows an example of the operation procedure of each device in the output process. First, the user terminal 20 (item input receiving unit 201) receives an operation to input dish items (step S11), and transmits item information indicating the input items to the server device 10 (step S12).

[0056] The server device 10 (item information acquisition unit 101) acquires the transmitted item information as item information indicating the items of dishes handled in the facility that handles food (step S13). Next, the user terminal 20 (food image acquisition unit 202) acquires an image of the dish that is the subject of the inspection work (step S21) and transmits the acquired image of the dish to the server device 10 (step S22). The server device 10 (item information acquisition unit 101) recognizes the name of the dish shown in the transmitted image (step S23) and acquires the recognized name of the dish as item information (step S24).

[0057] The sequence of operations from steps S11 to S13 and the sequence of operations from steps S21 to S24 may be reversed, or only one of them may be performed. In addition, each may be performed any number of times. Next, the server device 10 (ingredient identification unit 102) refers to the test item storage unit 103 and identifies ingredients contained in the dish of the item indicated by the acquired item information (step S31).

[0058] Next, the server device 10 (test information output unit 104) refers to the test item storage unit 103 and reads out the test items associated with the identified ingredients, i.e., the ingredients contained in the dish of the item indicated by the acquired item information (step S32). Next, the server device 10 (test information output unit 104) outputs the read out test items to the user terminal 20 (step S33).

[0059] The user terminal 20 (test information storage unit 203) stores the test items output from the server device 10 in association with the item indicated by the acquired item information (step S34). Then, the user terminal 20 (test processing unit 204) displays an test screen including the stored test items and performs test processing such as accepting input of test information by an inspector (step S41).

[0060] In this embodiment, as described above, for example, a store employee can input the types of food served in his / her store or take pictures of the food to output the inspection items appropriate for those dishes. This makes it easier to set appropriate inspection items for food hygiene inspections compared to when the inspection items are not output.

[0061] [2] Variations The above-described embodiment is merely one example of the implementation of the present invention, and may be modified as follows. Furthermore, the embodiment and each modification may be combined and implemented as necessary.

[0062] [2-1] Ingredients included in the dish Even if the item is the same, the ingredients contained in the dish may be different, for example, if the restaurant or region is different. In such a case, there will be multiple combinations of ingredients contained in the dish of the item indicated by the item information acquired by the item information acquisition unit 101. In such a case, the test information output unit 104 may identify all ingredients contained in at least one of the multiple combinations as ingredients contained in the dish.

[0063] For example, suppose that one restaurant uses onions, carrots, potatoes, minced chicken, and rice for the same curry rice, while another restaurant uses onions, carrots, eggplant, tomatoes, pork belly, and rice.In this case, the inspection information output unit 104 identifies onions, carrots, potatoes, eggplant, tomatoes, minced chicken, pork belly, and rice as ingredients contained in a dish of the item curry rice.

[0064] In this case, the inspection information output unit 104 outputs item data indicating the inspection item and category corresponding to the identified ingredient to the user terminal 20. In this modification, the inspection processing unit 204 of the user terminal 20 displays the inspection item and category indicated by the output item data. Fig. 13 shows an example of the displayed inspection items and items. In the example of Fig. 13, the inspection processing unit 204 displays six ingredients and six inspection items corresponding to curry rice.

[0065] Additionally, the inspection processing unit 204 displays a specification field E8 for specifying an inspection item to be excluded and a confirmation button B6 next to each ingredient and inspection item. When the user selects the specification field E8 for an inspection item that he or she wants to exclude, the inspection processing unit 204 displays a "◯" in that specification field E8. In the example of FIG. 13, ingredients "C1-3" and "C1-5" and inspection items "K1-3" and "K1-5" are specified as items to be excluded.

[0066] When the Confirm button B6 is pressed in this state, the inspection processing unit 204 transmits item data indicating the inspection items and items excluding those designated as excluded items to the server device 10. The inspection information output unit 104 of the server device 10 outputs item data indicating the inspection items indicated by the received item data and the items indicated by the acquired item information to the user terminal 20. The inspection information storage unit 203 of the user terminal 20 stores the inspection items indicated by the transmitted item data in association with the dish items indicated by the same item data.

[0067] Thereafter, the inspection process is performed in the same manner as in the embodiment. As described above, the inspection information output unit 104 excludes ingredients specified by the user as ingredients not to be included in the dish (ingredients "C1-3" and "C1-5" in the example of FIG. 13) from among the ingredients identified by the ingredient identification unit 102 as ingredients included in the dish. The inspection information output unit 104 is an example of the "exclusion unit" of the present invention. By performing this exclusion, when unnecessary ingredients are mixed in with the identified ingredients, only the correct ingredients can be left and the inspection items can be output.

[0068] In this modified example, when there are multiple combinations of ingredients included in a dish of an item indicated by item information, all of the ingredients in those combinations are identified as ingredients included in the dish. When the test items associated with the identified ingredients are presented, it is usually easier for the user to exclude unnecessary ingredients than to remember and add missing ingredients. In other words, this modified example makes it easier to determine the test items compared to when there is a shortage of identified ingredients.

[0069] [2-2] Adding ingredients In the above modified example, the test information output unit 104 excludes the specified ingredients from the ingredients contained in the dish, but the test information output unit 104 may add the specified ingredients to the ingredients contained in the dish. In this case, the test information output unit 104 adds ingredients specified by the user as ingredients contained in the dish, even if they are not identified as ingredients contained in the dish by the ingredient identification unit 102, as ingredients contained in the dish.

[0070] Fig. 14 shows an example of the inspection items and items displayed in this modified example. In the example of Fig. 14, the inspection processing unit 204 displays four standard ingredients and four inspection items corresponding to curry rice. The standard ingredients are ingredients identified by the ingredient identification unit 102 as ingredients contained in the dish. The inspection processing unit 204 also displays a specification field E9 for specifying ingredients to be added, an Add button B7, and a Confirm button B8.

[0071] When the Add button B7 is pressed, the inspection processing unit 204 displays a specification field E9 and accepts input of the ingredient to be added. When the ingredient to be added is input, the inspection processing unit 204 queries the server device 10 about the inspection items associated with the input ingredient. When the inspection information output unit 104 of the server device 10 receives this query, it reads out the corresponding inspection items from the inspection item storage unit 103 and outputs them to the user terminal 20.

[0072] The inspection processing unit 204 displays the output inspection items in association with the added ingredient, as shown in Fig. 14. When the ingredient to be added is thus input and the Confirm button B8 is pressed, the inspection processing unit 204 transmits item data indicating the inspection items and category, including those corresponding to the ingredient designated to be added, to the server device 10. Thereafter, the process is the same as that for excluding an ingredient described above.

[0073] As described above, the test information output unit 104 adds ingredients specified by the user as ingredients contained in the dish (ingredients "C1-7" in the example of FIG. 14) to the ingredients contained in the dish in addition to the ingredients identified by the ingredient identification unit 102 as ingredients contained in the dish. The test information output unit 104 is an example of the "addition unit" of the present invention. This addition makes it possible to prevent the absence of an inspection item for a necessary ingredient when an ingredient necessary for a dish is not included in the identified ingredients.

[0074] In addition, in combination with the above modified example, it may be possible to add necessary ingredients to the identified ingredients and remove unnecessary ingredients.

[0075] [2-3] Unable to recognize the name of the dish In the embodiment, the item information acquisition unit 101 recognizes the name of the dish included in the captured image, but depending on the image, the name of the dish may not be recognized. In that case, the item information acquisition unit 101 may recognize the ingredients included in the image. Specifically, the item information acquisition unit 101 stores in advance pattern images of ingredients in addition to pattern images of dishes, and identifies pattern images with features similar to those of the image of the dish.

[0076] The item information acquisition unit 101 recognizes the names of ingredients in the identified pattern image as the names of ingredients in the dish included in the captured image, and acquires the recognized names of ingredients as item information. The ingredient identification unit 102 identifies the ingredients with the names indicated in the acquired item information as ingredients included in the dish. This makes it easier to set appropriate inspection items for food hygiene inspections, even when the names of the dishes cannot be recognized from the images, compared to when ingredients are not identified as in this modified example.

[0077] [2-4] Allergens Processing related to ingredients that cause allergies, so-called allergens, may also be performed. In this modified example, for example, the server device 10 stores a list of allergens. The test information output unit 104 then refers to the list of allergens stored in the device, and outputs to the user terminal 20 the test items corresponding to ingredients included in the list in a format different from the test items corresponding to ingredients not included in the list.

[0078] The inspection processing unit 204 of the user terminal 20 displays the outputted inspection items on an inspection screen. Fig. 15 shows an example of the displayed test screen. In the example of Fig. 15, the test processing unit 204 displays test items C11 and C12, which include allergens, in a thicker frame than the other test items on the test screen with the "Food Ingredients" tab open.

[0079] In this way, the aspect of the allergen test item is different from the others, so that the person in charge of testing can easily understand the allergen test and can perform the test with special care, compared to when the aspect is uniform. Note that when an allergen is contained in an ingredient that is the subject of a test item, the test information output unit 104 may output an alternative ingredient that is not an allergen but can replace the allergen, and the test item for that alternative ingredient.

[0080] Fig. 16 shows an example of the displayed substitute ingredients and test items. In the example of Fig. 16, the test processing unit 204 displays ingredients C1-3 and C1-6, among the ingredients contained in curry rice, as allergens by enclosing them in a thick frame. The test processing unit 204 then displays substitute ingredients C9-3 and test item K9-3 next to ingredient C1-3, and displays substitute ingredients C9-6 and test item K9-6 next to ingredient C1-6. When an operation to select a substitute ingredient (for example, an operation to tap the display field of a substitute ingredient) is performed, the test processing unit 204 displays the ingredients and the substitute ingredients interchangeably.

[0081] At that time, the inspection processing unit 204 also switches the inspection items displayed to those for the alternative ingredients. This makes it easier for the menu provider to create a menu that does not contain allergens, compared to when the alternative ingredients and their inspection items are not output. As a result, restaurants and the like can meet the requests of customers with allergies to use alternative ingredients.

[0082] [2-5]Cooking method Even if the ingredients are the same, the required inspection items may differ depending on the cooking method. For example, even if the ingredients contain the same meat, if it is eaten raw and cooked, stricter temperature control etc. will be required as inspection items because the latter is more likely to be contaminated by bacteria.

[0083] In this modification, the inspection item storage unit 103 uses an inspection item table that associates ingredients, cooking methods, and inspection items. An example of an inspection item table of this modified example is shown in Fig. 17. In the example of Fig. 15, the food ingredient C1-1 is associated with the following combinations of cooking methods and inspection items: "non-heating" and "K1-11", "heating" and "K1-12", and "reheating" and "K1-13".

[0084] Also, a set of cooking method and inspection item is associated with each of ingredients C1-2 and C1-3. In this way, the inspection item storage unit 103 stores the inspection items in association with the cooking method of the ingredients in addition to the ingredients. In this modification, the item information acquisition unit 101 acquires cooking information indicating the cooking method in addition to the item information.

[0085] Fig. 18 shows an example of a screen for inputting dish items in this modified example. In the example of Fig. 18, the item input receiving unit 201 displays a character string saying "Please enter dish item information and cooking method", an input field for item information, an input field for cooking method, and a confirm button B9. When the confirm button B9 is pressed with the item information and cooking method input, the item input receiving unit 201 transmits the input item information and cooking method to the server device 10.

[0086] The item information acquisition unit 101 of the server device 10 acquires the transmitted item information and cooking method. The ingredient identification unit 102 identifies ingredients included in a dish of the item indicated by the item information acquired by the item information acquisition unit 101 as described above and of the cooking method acquired in the same manner. By identifying ingredients in this way, the inspector can carry out the inspection required for each cooking method of the ingredients.

[0087] [2-6] Providing food information for consumers The test support system 1 may provide information on ingredients, allergens, etc. to consumers as food information. In this modification, the test information output unit 104 generates a web page that lists, for example, dish items, ingredients contained in each dish, and, for ingredients containing allergens, the allergens, and test results related to the allergens.

[0088] The test information output unit 104 outputs the generated web page to a communication terminal such as a smartphone that has accessed the URL (Uniform Resource Locator) of the screen for consumers. The communication terminal displays the output web page. Figure 19 shows an example of a displayed web page for consumers. In Figure 19(a), a store list for selecting a store for which food information is to be viewed is displayed on the communication terminal.

[0089] When a consumer selects a store and presses the confirm button B11, the test information output unit 104 generates the above-mentioned web page for the selected store. In Fig. 19(b), the generated web page is displayed on the communication terminal. For example, an item of a dish called "seafood pasta" contains ingredients C11-1, C11-2, and C11-3, and among them, ingredient C11-3 contains shrimp as an allergen, and it is displayed that the test result of ingredient C11-3 was OK.

[0090] As described above, the test information output unit 104 outputs a webpage for consumers that lists the types of dishes, the ingredients contained in each dish, and for ingredients that contain allergens, the allergens and the test results for the allergens for each store. The food information may also include substitute ingredients and the test results for the substitute ingredients. Also, food information may be included not for each store, but for facilities that handle food, such as food factories.

[0091] When the food information is provided to the consumer, the consumer can easily know whether or not the food contains allergens, and since the test results are also included, the consumer can confirm the safety of the food. In this way, according to this modification, the information held by the test support system 1 can be used to improve the satisfaction of the consumer who is provided with the food. In addition, the consumer can evaluate the time and effort spent on the test conducted at the facility.

[0092] [2-7] Providing food information for managers The test support system 1 may provide the administrator with information on ingredients, allergens, etc. as food information. In this modification, the test information output unit 104 generates a web page that presents, as food information, a list of, for example, dish items, ingredients contained in each dish item, the allergen for ingredients containing an allergen, the test results for the allergen, and substitute ingredients for the allergen.

[0093] The test information output unit 104 outputs the generated web page to a communication terminal such as a smartphone that has accessed the URL of the screen for the administrator. The communication terminal displays the output web page. Fig. 20 shows an example of a displayed web page for the administrator. In Fig. 20(a), a list of stores is displayed on the communication terminal for selecting a store to be managed.

[0094] When the administrator selects a store and presses the confirm button B11, the test information output unit 104 generates the above-mentioned web page for the selected store. In Fig. 20(b), the generated web page is displayed on the communication terminal. For example, it is displayed that an item of a dish called "XX bowl" contains ingredients C21-1, C21-2, and C21-3, and that C21-2 contains allergen K21-2 and that C29-2 is available as an alternative ingredient.

[0095] In addition, the dish item "△△ set meal" contains ingredients C21-4, C21-5, and C21-6, and among these, ingredient C21-6 contains allergen K21-6, and it is displayed that there is an alternative ingredient C29-6. As described above, the test information output unit 104 outputs a web page for the manager that shows a list of dish items, ingredients contained in each dish item, and for ingredients containing allergens, the allergen and alternative ingredients for the allergen as food information for each store.

[0096] In the web page shown in Fig. 20(b), an operation of selecting an allergen or an alternative ingredient and pressing the Replace button B13 is accepted as an operation of replacing the allergen with an alternative food. When the replacement operation is accepted, the test information output unit 104 outputs a web page showing food information in which the allergen has been replaced with an alternative ingredient. Note that the food information may include test items and test results of the test results, etc.

[0097] Also, instead of information for each store, information may be included for facilities that handle food, such as food factories. According to this modification, the manager can easily understand the allergens contained in the dishes handled at the facility and, if necessary, replace them with alternative ingredients.

[0098] [2-8] Improving the accuracy of product information In the embodiment, the item information acquisition unit 101 identifies similar food images using only pre-stored food pattern images, but it may also store food images identified for a certain facility and use the stored food images as pattern images to identify food images for that facility. This improves the accuracy of identifying food for each facility compared to using only pre-stored food pattern images.

[0099] The item information acquisition unit 101 may also use AI (artificial intelligence) technology to identify the image of the dish. In this case, the item information acquisition unit 101 calculates an index of similarity between the pattern image and the dish based on, for example, values ​​obtained by weighting two or more feature quantities, and identifies the pattern image with the largest calculated index as the image of the dish. In this case, the item information acquisition unit 101 prepares multiple weighting patterns and uses each of them to identify the image of the dish.

[0100] Then, the item information acquisition unit 101 acquires the result of a human judgment as to whether the identification result is correct or not, and identifies the image of the food using a weighting pattern with a higher accuracy rate. In this way, by feeding back the result of a human judgment as to whether the identified image of the food is correct or not, it is possible to improve the accuracy of the name of the food indicated by the identified image, i.e., the acquired item information, compared to the case where this feedback is not provided.

[0101] [2-9] Devices that realize each function The devices that realize the functions shown in Fig. 4 are not limited to the devices described above. For example, the functions realized by the server device 10 may be shared and realized by two or more devices, or the functions realized by the user terminal 20 may be shared and realized by two or more devices. Furthermore, the functions realized by the server device 10 and the user terminal 20 may be collectively realized by one device.

[0102] In addition, in the embodiment, the functions of the item input reception unit 201 and the like realized by the user terminal 20 are realized by the processor 21 of the user terminal 20 executing a program (a so-called local application program) stored in the user terminal 20, but are not limited to this.

[0103] For example, this may be realized by the processor 11 of the server device 10 executing a program (e.g., CGI (Common Gateway Interface) or the like) stored in the device itself. In this case, the user terminal 20 executes a browser to display an image of the examination screen transmitted from the server device 10. In either case, it is sufficient that the functions shown in Fig. 4 are realized in the entire examination support system 1.

[0104] [2-10] Invention Categories The present invention can be understood as each information processing device, namely the server device 10 and the user terminal 20, as well as an information processing system (the examination support system 1 is an example) including each information processing device. The present invention can also be understood as an information processing method for realizing the processing performed by each information processing device, or as a program for causing a computer that controls each information processing device to function. The program understood as the present invention may be provided in the form of a recording medium such as an optical disk on which the program is stored, or may be provided in the form of a program that is downloaded to a computer via a network such as the Internet and the downloaded program is installed and made available.

Claims

1. an acquisition unit that acquires item information indicating items of food served in a food facility; A storage unit that stores food materials and inspection items required for the food materials in association with each other; an identification unit that identifies ingredients included in a dish of an item indicated by the acquired item information; an output unit that outputs the inspection items stored in association with the identified food material; A recognition unit that recognizes the names of dishes contained in the captured images; Equipped with The acquisition unit acquires the name recognized by the recognition unit as the item information. Information processing device.

2. When the recognition unit cannot recognize the name of a dish contained in a photographed image, the recognition unit recognizes ingredients contained in the image, The acquisition unit acquires the recognized name of the ingredient as the item. The information processing device according to claim 1 .

3. The identification unit identifies ingredients defined as ingredients generally included in a dish of the item indicated by the acquired item information as ingredients included in the dish.

3. The information processing device according to claim 1 or 2.

4. When there are multiple combinations of ingredients included in a dish of the item indicated by the acquired item information, the identification unit identifies all ingredients that are included in at least one of the multiple combinations as ingredients included in the dish.

3. The information processing device according to claim 1 or 2.

5. An adding unit that adds ingredients specified by a user as ingredients to be included in the dish, in addition to the ingredients identified as ingredients to be included in the dish, as ingredients to be included in the dish.

5. The information processing device according to claim 3.

6. An exclusion unit that excludes ingredients specified by a user as ingredients not to be included in the dish from the ingredients to be included in the dish among the ingredients identified as ingredients to be included in the dish The information processing device according to claim 3 .

7. The output unit refers to a list of ingredients that cause allergies, and outputs the test items corresponding to ingredients included in the list in a format different from that of test items corresponding to ingredients not included in the list. The information processing device according to claim 1 .

8. The acquisition unit acquires cooking information indicating a cooking method in addition to the item information, The storage unit stores the inspection items in association with the cooking methods of the ingredients in addition to the ingredients, The identification unit identifies ingredients included in a dish of an item indicated by the acquired item information and of a cooking method indicated by the acquired cooking information. The information processing device according to claim 1 .

Images