Food-and-drink provision system and food-and-drink provision method
The described system addresses inefficiencies in restaurant management by implementing facial recognition, weight-based ordering, and automated wine cellar control to provide contactless and labor-efficient food and beverage services.
Patent Information
- Application Number
- JP2023080550
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-05-16
- Publication Date
- 2024-11-28
AI Technical Summary
Existing restaurant management systems face inefficiencies and challenges in providing contactless and labor-saving food and beverage services, particularly in the context of the COVID-19 pandemic.
A food and beverage serving system that utilizes facial recognition for entry control, a substitute system with weight detection for ordering, and a membership-based approach with individual wine cellar control, enabling contactless and automated service operations.
Facilitates contactless and labor-efficient food and beverage services by minimizing human interaction and optimizing staff utilization, especially beneficial for membership-based restaurants.
Smart Images

Figure 2024164875000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to a food and drink providing system and a food and drink providing method. [Background technology]
[0002] For example, Patent Document 1 discloses an information processing system used when a person moves around to purchase a product, the information processing system comprising: a moving object tracking means for tracking the moving object, which is the person or an object moving with the person; a product identification means for identifying both the product and the number of products by a specified method using at least one of a weight sensor and a camera; and a linking means for linking the identified product with the moving object that is in a specified positional relationship. Patent Document 2 discloses a facial image processing method that uses a registration database in which facial images of persons who have been permitted to enter a specific closed space in advance and narrowing-down information corresponding to the facial images are registered, the method acquiring narrowing-down information corresponding to persons entering and exiting the closed space, comparing the registered narrowing-down information with the acquired narrowing-down information, and determining a search range for facial images registered in the registration database to be searched in the authentication process of facial images within the closed space based on the comparison result between the registered narrowing-down information and the acquired narrowing-down information. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2023-14207 A [Patent Document 2] Re-tabled publication 2018 / 110012 Summary of the Invention [Problem to be solved by the invention]
[0004] The present invention aims to improve the efficiency of restaurant operations. [Means for solving the problem]
[0005] The food and beverage provision system of the present invention comprises a member information storage unit that stores at least a portion of the facial images of members who are permitted to use an eating and beverage area, and an entrance control device that controls entrance to the eating and beverage area based on at least a portion of the facial images stored in the member information storage unit and facial image data of people photographed at the time of entry to the eating and beverage area.
[0006] Preferably, the system further includes substitutes of a predetermined shape and weight arranged within the eating area, a camera that photographs the area in which the substitutes are arranged, a detection device that detects changes in weight in the area in which the substitutes are arranged, a substitute information storage unit that stores at least a portion of the image information of the substitutes in association with a specified food or beverage, and an order receiving unit that accepts orders for food or beverage associated with the substitutes based on at least a portion of the image information stored in the substitute information storage unit, the image photographed by the camera, and the change in weight detected by the detection device.
[0007] Preferably, the order receiving unit further has a payment unit which identifies the orderer who placed the food and beverage order based on the image captured by the camera, and performs payment for the order accepted by the order receiving unit using payment information of the orderer identified by the order receiving unit.
[0008] Preferably, the area in which the substitutes are placed is a product purchasing section separated from other areas of the eating and drinking area, and further includes a purchasing section entrance gate that restricts entry to the product purchasing section, and an opening / closing control unit that opens and closes the purchasing section entrance gate depending on the presence or absence of a medium carrying information indicating purchasing authority.
[0009] Preferably, the device further has a reservation management unit which accepts reservations for use of the eating and drinking area, and the entrance control device allows entry to the eating and drinking area when at least a portion of the facial image stored in the member information storage unit matches facial image data of a person photographed at the time of entry to the eating and drinking area, and when the reservation for use of the person with this facial image has been successfully accepted by the reservation management unit.
[0010] Preferably, the wine cellar further comprises a wine cellar capable of individually controlling the opening and closing of each of a plurality of storage areas, and the member information storage unit further stores identification information of a member permitted to use the wine cellar and identification information of the storage areas allocated to the member in association with at least a portion of an image of the member's face, and the entrance restriction device further photographs and identifies people leaving the dining area, and the wine cellar permits the opening and closing of the storage area allocated to the member by the entrance restriction device, on the condition that the member is present in the dining area.
[0011] In addition, the food and beverage provision method of the present invention is a food and beverage provision system having a member information database storing at least a portion of the facial images of members who are permitted to use an eating and beverage area, and an entrance control device that controls entrance to the eating and beverage area based on at least a portion of the facial images stored in the member information database and facial image data of the person photographed at the time of entry to the eating and beverage area, the method comprising the steps of: the entrance control device photographing the face of the person at the time of entry to the eating and beverage area and generating facial image data of the person; and the entrance control device allowing entry to the eating and beverage area if at least a portion of the facial image stored in the member information database matches the generated facial image data of the person. [Brief description of the drawings]
[0012] [Figure 1] 1 is a diagram illustrating an example of the overall configuration of a food and drink providing system 1. FIG. [Diagram 2] 2 is a diagram illustrating an example of a hardware configuration of a management device 2. [Diagram 3]2 is a diagram illustrating an example of a functional configuration of a management device 2. FIG. [Figure 4] 13 is a diagram illustrating an example of information registered in a member information database 390. FIG. [Diagram 5] 13 is a flowchart illustrating the process (S10) of entering an eating area 900 in the food and drink providing system 1. [Figure 6] 13 is a flowchart illustrating a product purchasing process (S20) in the food and drink providing system 1. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0013] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. 1 is a diagram illustrating an example of the overall configuration of a food and drink providing system 1. In this example, a specific example will be described in which an eating and drink area 900 is a members-only eating and drink space. As illustrated in FIG. 1, the food and beverage provision system 1 includes a management device 2, an entrance control device 50, a purchasing area entrance gate 52, a substitute table 54, a purchasing area camera 56, and a wine cellar 58, which are connected to each other via wired LAN or wireless LAN. The management device 2 is a computer terminal that controls other components (such as the wine cellar 58) and manages member information and reservation information. The management device 2 may be a cloud server or the like. The entrance control device 50 is a device that controls entrance to the eating and drinking area 900, and is, for example, an automatic door that opens and closes depending on the result of face authentication. The entrance control device 50 in this example is composed of a face authentication device that photographs the faces of visitors outside the eating and drinking area 900 and performs face authentication, and an automatic door that automatically opens and closes when face authentication by this face authentication device is successful.
[0014] The purchase area entrance gate 52 is a gate that restricts entry to the product purchase area 902. The product purchase area 902 is an area that is provided within the eating and drinking area 900, where food and drink can be ordered, and is separated from other spaces where eating and drinking can be performed. In other words, the product purchase area 902 is an area that can only be entered by members who have been granted the authority to order food and drink among those permitted to enter the eating and drinking area 900 by face authentication. The purchase area entrance gate 52 in this example is composed of a code reader that reads a code image such as a QR code (registered trademark), and a gate that permits entry when the purchase authority is confirmed by the code reader.
[0015] The substitute table 54 is a table installed in the product purchasing section 902, on which substitutes associated with products such as food and drink are placed. Each substitute has a predetermined shape and weight, and when a substitute is selected by a member, it is detected by the food and drink providing system 1 as an order for the product associated with that substitute. The substitute table 54 in this example has a sensor on the top surface of the table that detects changes in weight, and detects the change in weight corresponding to the substitute.
[0016] The purchasing area camera 56 is a camera that photographs the area where substitutes are placed. In this example, the purchasing area camera 56 photographs the top surface of the substitute table 54, and the management device 2 identifies the substitute brought out by the member based on the change in weight detected by the substitute table 54 and the image photographed by the purchasing area camera 56, and accepts an order for a product associated with the identified substitute. The substitute may be, for example, a chess piece or a model.
[0017] Wine cellar 58 is a wine cellar in which the opening and closing of each of a plurality of storage areas can be controlled individually, and the door of each storage area can be opened and closed according to the control of management device 2. In this example, wine cellar 58 is provided with a lock for each of the plurality of storage areas, and when management device 2 determines that a member to whom a storage area is assigned is present within dining area 900, the lock for that storage area can be used to open and close that storage area.
[0018] With the above configuration, the food and beverage service system 1 of this example provides a member-only food and beverage service with as little contact as possible and achieves labor-saving in providing the service. In other words, it provides a new type of member-only food and beverage service that serves as a ray of hope in the social dining industry, which has been unable to operate satisfactorily due to the COVID-19 pandemic and has also faced difficulties in recruiting staff.
[0019] FIG. 2 is a diagram illustrating an example of a hardware configuration of the management device 2. As shown in FIG. As illustrated in FIG. 2, the management device 2 includes a CPU 200, a memory 202, a HDD 204, a network interface 206 (network IF 206), a display device 208, and an input device 210, which are connected to each other via a bus 212. The CPU 200 is, for example, a central processing unit. The memory 202 is, for example, a volatile memory, and functions as a main storage device. The HDD 204 is, for example, a hard disk drive device, and serves as a non-volatile storage device for storing computer programs and other data files. The network IF 206 is an interface for wired or wireless communication. The display device 208 is, for example, a liquid crystal display. The input device 210 is, for example, a keyboard and a mouse.
[0020] FIG. 3 is a diagram illustrating an example of the functional configuration of the management device 2. As shown in FIG. As shown in FIG. 3, the management device 2 of this embodiment has a server program 3 installed therein, and includes a member information database 390 (member information DB 390) and a reservation information database 392 (reservation information DB 392). The server program 3 has a member information management unit 300, a reservation management unit 310, an order receiving unit 320, a payment unit 330, an admission control unit 340, a purchase authority management unit 350, a purchase section opening / closing control unit 360, and a wine cellar control unit 370. A part or the whole of the server program 3 may be realized by hardware such as an ASIC. The server program 3 is stored in a recording medium such as a CD-ROM, and is installed in the management device 2 via the recording medium.
[0021] In the server program 3, the member information management unit 300 manages (registers, modifies, or deletes) information registered in the member information DB 390. As shown in Fig. 4, the member information management unit 300 in this example registers the member's payment information (information on credit card, etc.), the member's facial image data (feature amount), and the identification information of the wine cellar assigned to the member in the member information DB 390 in association with the member's identification information (member ID).
[0022] The reservation management unit 310 manages (registers, changes, or deletes) information registered in the reservation information DB 392. In this example, since this is a subscription-based, members-only restaurant, as long as a reservation is made, the dining area 900 can be used. The reservation management unit 310 in this example refers to the reservation information DB 392, calculates the number of reservations for each time slot, and responds to a request from the member's mobile phone or the like by returning the usage status of each time slot and whether or not the reservation can be made.
[0023] The order receiving unit 320 includes a substitute information storage table, and receives orders for food and drink associated with a substitute based on at least a portion of the image information stored in the substitute information storage table, the image captured by the purchasing area camera 56, and the change in weight detected by the substitute table 54. The substitute information storage table is a table that associates, for example, at least a portion of the image information of the substitute and information regarding the weight of the substitute with a predetermined food or drink. In addition, the order receiving unit 320 identifies the orderer who placed the food and drink order based on the image captured by the purchasing area camera 56 or the code image read by the purchasing area entrance gate 52.
[0024] The settlement unit 330 performs settlement for the order accepted by the order receiving unit 320, using the payment information of the orderer identified by the order receiving unit 320. The settlement unit 330 in this example performs cashless settlement for the order accepted by the order receiving unit 320, using the payment information of the orderer identified by the order receiving unit 320.
[0025] The entrance control unit 340 controls the operation of the entrance control device 50 based on at least a portion of the facial image stored in the member information DB 390 and the facial image data of the person photographed upon entry to the eating and drinking area 900. In this example, the entrance control unit 340 causes the entrance control device 50 to open and close the automatic door at the entrance to the eating and drinking area when the characteristic information of the facial image stored in the member information DB 390 matches the characteristic information of the facial image data of the person photographed upon entry to the eating and drinking area 900.
[0026] The purchasing authority management unit 350 manages the authority to purchase products in the product purchasing section 902. In response to a request from a member's mobile terminal, the purchasing authority management unit 350 in this example grants the authority to purchase products in the product purchasing section 902 and returns a code image indicating the purchasing authority to the member's mobile terminal or the like. In addition, the purchasing authority management unit 350 may grant the authority to purchase products in the product purchasing section 902 and print the code image indicating the purchasing authority on a mount in response to a request from a member's mobile terminal. The product purchasing authority has a limited usable period, for example.
[0027] The purchasing area opening / closing control unit 360 controls the operation of the purchasing area entrance gate 52. In this example, the purchasing area opening / closing control unit 360 verifies the authority to purchase goods granted by the purchasing authority management unit 350 using a code image, and if the authority is confirmed, opens or closes the gate of the purchasing area entrance gate 52 to permit entry to the product purchasing area 902.
[0028] The wine cellar control unit 370 controls the operation of the wine cellar 58. On the condition that any member is present within the dining area 900, the wine cellar control unit 370 in this example makes it possible to open and close the storage area of the wine cellar 58 assigned to that member with a key.
[0029] FIG. 5 is a flowchart illustrating the process (S10) of entering the eating and drinking area 900 in the food and drink providing system 1. As shown in FIG. 5, in step 100 (S100), when the entrance control device 50 detects that a person has entered a specified area, it photographs the face of the visitor with a built-in camera and transmits image data of the photographed face to the management device 2. In step 105 (S105), the entrance control unit 340 of the management device 2 compares the features of the image data received from the entrance control device 50 with the features of the facial images registered in the member information DB 390, and determines whether there is a match between them. If either of them matches, the admission control unit 340 proceeds to the process of S110, and if neither of them matches, the admission control unit 340 returns to the process of S100.
[0030] In step 110 (S110), the admission control unit 340 refers to the reservation information DB 392 and determines whether or not there is a reservation for a member whose facial features match. If a reservation has been made, the admission control unit 340 proceeds to the process of S115, and if no reservation has been made, the admission control unit 340 displays on the monitor of the admission control device 50 a message indicating that a reservation is necessary, and returns to the process of S100.
[0031] In step 115 (S115), the entrance control unit 340 of the management device 2 causes the entrance control device 50 to open the automatic door. In step 120 (S120), if the entrance control device 50 detects that no object is present near the automatic door after a predetermined period of time has elapsed since the automatic door was opened, it closes the automatic door. In step 125 (S125), when the wine cellar control unit 370 is notified by the entrance control unit 340 that a member has entered the eating and drinking area 900, the wine cellar control unit 370 makes the storage area of the wine cellar 58 assigned to this member openable and closable with a key.
[0032] FIG. 6 is a flowchart illustrating the product purchasing process (S20) in the food and drink providing system 1. As shown in FIG. 6, in step 200 (S200), the purchasing area entrance gate 52 installed at the entrance of the product purchasing area 902 reads the code image (QR code (registered trademark), etc.) presented by the purchaser and transmits the read code information to the management device 2.
[0033] In step 205 (S205), the purchase area control unit 360 of the management device 2 compares the code information received from the purchase area entrance gate 52 with the valid purchase authority information granted by the purchase authority management unit 350 to determine whether or not the purchase authority is present, and if the purchase authority is present, proceeds to processing of S210, and if the purchase authority is not present, returns to processing of S200. In step 210 (S210), the purchasing section control unit 360 opens and closes the purchasing section entrance gate 52 to permit the purchaser to enter the product purchasing section 902.
[0034] In step 215 (S215), the order receiving section 320 detects the pick-up of an alternative item by the purchaser based on the image captured by the purchase area camera 56 and the change in weight detected by the alternative item table . If the purchaser picks up an alternative from the alternative table 54 before the purchaser exits the product purchasing section 902, the server program 3 proceeds to processing of S220, and if the purchaser does not pick up any alternative from the alternative table 54 before the purchaser exits the product purchasing section 902, the server program 3 ends the purchase processing (S20).
[0035] In step 220 (S220), the order receiving unit 320 identifies the substitute picked up by the purchaser based on the image captured by the purchase area camera 56, and accepts the order for the food and drink associated with the identified substitute. The management device 2 displays information about the ordered food and drink on the display device 208, and instructs the staff to provide the food and drink.
[0036] In step 225 (S225), the settlement unit 330 uses the payment information of the purchaser specified by the order receiving unit 320 to perform cashless payment for the order accepted by the order receiving unit 320.
[0037] As described above, according to the food and drink providing system 1 of the present embodiment, it is possible to provide a member-only food and drink service while minimizing contact between visiting members and store staff. At the same time, it is expected to reduce the labor required for food and drink services. [Explanation of symbols]
[0038] 1. Food and beverage supply system 2 Management device 50 Entrance control device 52 Purchase Area Entrance Gate 54 Alternative Table 56 Purchase Area Camera 58 Wine Cellar
Claims
1. a member information storage unit that stores at least a portion of a facial image of a member who is permitted to use the dining area; an entrance control device that controls entrance to the eating area based on at least a part of the face image stored in the member information storage unit and face image data of a person photographed at the time of entrance to the eating area; A food and beverage providing system having the above structure.
2. a representative object of a predetermined shape and weight disposed within the eating area; A camera that photographs an area in which the substitute is placed; A detection device that detects a change in weight in the area where the substitute is placed; a substitute information storage unit that stores at least a part of the image information of the substitute in association with a predetermined food and drink; an order receiving unit that receives an order for a food or drink associated with a substitute based on at least a part of the image information stored in the substitute information storage unit, an image captured by the camera, and a change in weight detected by the detection device; The food and drink providing system according to claim 1 , further comprising:
3. The order receiving unit identifies an orderer who has placed an order for food and beverages based on the image captured by the camera, A settlement unit that performs settlement for the order accepted by the order receiving unit using the settlement information of the orderer specified by the order receiving unit. The food and drink providing system according to claim 2 , further comprising:
4. The area in which the substitutes are arranged is a product purchasing section separated from other areas of the eating and drinking area; a purchase area entrance gate for restricting entry to the product purchase area; an opening / closing control unit that opens and closes the purchase section entrance gate depending on the presence or absence of a medium carrying information indicating purchase authority; The food and drink providing system according to claim 3 , further comprising:
5. A reservation management unit that receives reservations for use of the dining area and The entrance control device permits entry to the eating and drinking area when at least a part of the face image stored in the member information storage unit matches face image data of a person photographed at the time of entry to the eating and drinking area, and when a reservation for use of the person with this face image has been normally accepted by the reservation management unit. The food and drink providing system according to claim 4.
6. A wine cellar with multiple storage areas that can be opened and closed individually and The member information storage unit further stores identification information of a member permitted to use the wine cellar and identification information of a storage area assigned to the member in association with at least a portion of a facial image of the member; The entrance restriction device further photographs and identifies people leaving the eating and drinking area, The wine cellar allows the opening and closing of a storage area allocated to a member on the condition that the member is present in the eating and drinking area by the entrance restriction device. The food and drink providing system according to claim 5 .
7. a member information database that stores at least a portion of a facial image of a member who is permitted to use the dining area; an entrance control device that controls entrance to the eating and drinking area based on at least a part of the face images stored in the member information database and face image data of a person photographed at the time of entrance to the eating and drinking area, The entrance control device takes a photograph of a person's face when the person enters the eating and drinking area, and generates face image data of the person; the entrance control device permits entry to the eating and drinking area when at least a part of a face image stored in the member information database matches the generated face image data of the person; A method for providing food and drink comprising the steps of:
Citation Information
Patent Citations
Information Processing Systems
JP2023014207A
