Information management device and information management program

The information management device addresses the issue of inaccurate waiting time estimation in restaurants by using a camera to predict customer departure times, enhancing customer satisfaction through precise waiting time guidance.

JP7717483B2Active Publication Date: 2025-08-04TOSHIBA TEC KK
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
JP2021070468
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-04-19
Publication Date
2025-08-04
Estimated Expiration
2041-04-19

AI Technical Summary

Technical Problem

Existing systems fail to accurately guide customers about waiting times in restaurants, leading to customer dissatisfaction and potential loss of business due to uncertainty, as staff reliance on experience-based estimates is unreliable.

Method used

An information management device and program that utilizes a camera to detect table statuses, predict customer departure times, and display predicted departure times on a guidance display, integrating with an order terminal and display device to provide precise waiting time information.

Benefits of technology

Enhances customer satisfaction by providing accurate waiting time estimates, reducing anxiety and increasing customer retention by allowing customers to effectively utilize their time.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007717483000001
    Figure 0007717483000001
  • Figure 0007717483000002
    Figure 0007717483000002
  • Figure 0007717483000003
    Figure 0007717483000003
Patent Text Reader

Abstract

To provide an information management device and an information management program for increasing customer satisfaction by providing guidance about waiting time according to the situation.SOLUTION: In a guidance system, an information processing device 10 acquires data including a status indicating the situation of a table detected from a captured image including an image on the table captured by a camera 21. Then, leaving time until a customer at the table leaves a restaurant is predicted according to elapsed time after the acquired status changes. The predicted leaving time as leaving prediction time is output to a guidance display device 31.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] Embodiments of the present invention relate to an information management device and an information management program.

Background Art

[0002] Conventionally, in a restaurant, when it is not possible to immediately guide customers to a seat due to congestion, customers are asked to write their names etc. and are guided in order. In many cases, the staff conducts operations such as telling the customers an approximate waiting time estimated from experience rules, or informing them that the waiting time is unknown.

[0003] In such cases, customers often take the action of going to another store due to the anxiety of not knowing the exact waiting time. As a restaurant, there is a desire to convey the waiting time as accurately as possible to customers without relying solely on the experience of individual staff members, in order to secure many customers. Also, as a customer, it is desired to be able to dine at a desired restaurant while effectively utilizing the waiting time by knowing the exact waiting time.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] The problem to be solved by the embodiments of the present invention is to provide an information management device and an information management program that can increase customer satisfaction by guiding a waiting time according to the situation.

Means for Solving the Problems

[0006] According to an embodiment, an information processing apparatus includes an acquisition unit and a processor. The acquisition unit acquires data including a status indicating the situation of a table detected from a captured image including an image of the table captured by a camera. The processor predicts the departure time until a customer at the table departs, and outputs the predicted departure time as a predicted departure time to a display device after the status acquired by the acquisition unit changes. The predicted departure time according to the status and Elapsed time since the change by the two predicts the departure time until the customer at the table departs, and outputs the predicted departure time as a predicted departure time to a display device.

Brief Description of Drawings

[0007]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

DETAILED DESCRIPTION OF THE INVENTION

[0008] Hereinafter, embodiments will be described with reference to the drawings. First, the configuration of the guidance system 1 according to the embodiment will be described. FIG. 1 is a diagram schematically showing a configuration example of the guidance system 1 according to the embodiment. In the configuration example shown in FIG. 1, the guidance system 1 includes an information management device (STN) 10, a camera 21, an order terminal 22, and a guidance display device 31.

[0009] The information management device 10 manages various types of information for guiding the waiting time until guiding a customer in the store to a seat. The information management device 10 is a computer as a server device. The information management device 10 communicates with the camera 21, the order terminal 22, and the display guidance device 31.

[0010] In addition, the information management device 10 has a memory for storing a departure prediction information database (DB) 11, a departure time master 12, and the like. The departure prediction information DB 11 stores departure prediction information for each table (seat) in the store. The departure prediction information stored in the departure prediction information DB 11 is information for predicting the time (departure time) until a customer using the table (seat) departs. For example, the departure prediction information is information including information indicating the status of the table and the predicted departure time (departure prediction time) based on the status of the table.

[0011] The store closing time master 12 stores master information indicating the predicted value (set value) of the store closing time. The store closing time master 12 stores, for example, master information indicating the predicted value (set value) of the store closing time corresponding to the menu items and the status indicating the situation of the tables. Note that the store closing time master 12 may be stored in a storage device externally attached to the information management device 10, or may be stored in another server device accessible by the information management device 10.

[0012] The camera 21 photographs the tables (tables provided at each guest seat) that provide meals installed in the store. The camera 21 may be any camera that can photograph an image of the table to be monitored. For example, the camera 21 may be provided for each table in the store, may be provided for a plurality of tables, or may be one camera that photographs all the tables in the store.

[0013] Also, the camera 21 includes an imaging unit and a processing unit. The imaging unit photographs an image of a shooting range including the table to be monitored. The processing unit performs processing of the image photographed by the imaging unit, control of the imaging unit, and communication with the information management device 10. In the present embodiment, the processing unit of the camera 21 has a function of executing a recognition process for detecting the state (status) of the table with respect to the photographed image. For example, the processing unit of the camera 21 detects from the image photographed by the imaging unit that the status is "with meal", "only tableware", or "no tableware". The processing unit of the camera 21 supplies information indicating the status detected from the photographed image to the information management device 10.

[0014] The order terminal 22 is a device for inputting orders for meals and the like at each table (dining table). The order terminal 22 may be a device operated by a store clerk or a device operated by the customer himself / herself. Also, the order terminal 22 may be portable or stationary. The order terminal 22 has a function of communicating with the information management device 10. The order terminal 22 transmits information (order data) indicating the ordered items (orders) input by the store clerk or the customer himself / herself to the information management device 10. For example, the order data includes information (e.g., item code) indicating the menu items ordered by the customers at the table seats (dining tables) identified by the table numbers and the quantities, etc. Further, the order terminal 22 may be configured to input information indicating that the customers seated at each table are in a waiting-for-order state.

[0015] The guidance display device 31 is a device for displaying waiting time guidance. The function as the guidance display device 31 may be realized by a POS terminal or a display device installed at the entrance of the store or the like. In the present embodiment, the guidance display device 31 will be described assuming that it is a POS terminal.

[0016] Next, the configuration of the control system in the information management device (STN) 10 according to the embodiment will be described. FIG. 2 is a block diagram showing a configuration example of the control system in the information management device 10 according to the embodiment. The information management device 10 includes a processor 41, a ROM (Read Only Memory) 42, a RAM (Random Access Memory) 43, a data memory 44, a communication unit 45, etc. The processor 41 is connected to each unit via a system transmission path including an address bus, a data bus, control signal lines, etc.

[0017] The processor 41 corresponds to the central part of the computer as the information management device 10. The processor 41 is, for example, a CPU (Central Processing Unit). The processor 41 controls each unit in order to realize various functions as the information management device 10 according to an operating system or an application program.

[0018] The ROM 42 has a non-rewritable non-volatile memory area. The ROM 42 stores an operating system or an application program. The RAM 43 has a volatile memory area. The RAM 43 functions as a working memory. The RAM 43 holds data that can be rewritten as appropriate by the processor 41.

[0019] The data memory 44 is a memory corresponding to the auxiliary storage part of the computer as the information management device 10. The data memory 44 is composed of, for example, an HDD (Hard Disc Drive), an SSD (Solid State Drive), or an EEPROM (registered trademark) (Electric Erasable Programmable Read-Only Memory), etc. The data memory 44 stores data used by the processor 41 to perform various processes, or data created by the processes in the processor 41, etc.

[0020] The data memory 44 stores the application program executed by the processor 41. The application program stored in the data memory 44 or the ROM 42 includes a control program for realizing each process described later. The method of installing the application program in the data memory 44 is not particularly limited. For example, a program stored in a removable recording medium, or a program distributed via a network may be installed in the data memory 44. Note that the removable recording medium for storing the program may be a recording medium such as a CD-ROM, a memory card, etc. However, it is assumed that the information management device 10 is provided with a device for reading data (program) from the removable recording medium.

[0021] The communication unit 45 is a communication interface for communicating with each device connected via a network or the like. In the configuration example of the guidance system 1 shown in FIG. 1, the communication unit 45 includes a circuit for performing data communication with the camera 21, the order terminal 22, and the guidance display device 31. The communication unit 45 functions as an acquisition unit that acquires data from the camera 21 and the order terminal 22. Further, the communication unit 45 also functions as an output unit that outputs display information to the guidance display device 31.

[0022] Also, the data memory 44 stores the order data acquired from the order terminal 22 via the communication unit 45. The data memory 44 stores order data including information (for example, item code) indicating the menu items ordered by the customers at the table seats (customer seats) for each table number and the number of items.

[0023] Also, the data memory 44 has a storage area for storing the departure prediction information database (DB) 11 and the departure time master 12. The departure prediction information DB 11 stores departure prediction information for each table (customer seat) to be monitored. The departure prediction information DB 11 stores the status indicating the situation of each table and the predicted value (departure prediction time) of the departure time until the customer departs. The departure prediction information DB 11 is updated as needed according to the elapsed time, the information acquired from the camera 21 or the order terminal 22, and the elapsed time.

[0024] The check-out time master 12 stores setting values that are predicted check-out times according to the status of the table. For example, the check-out time master 12 stores setting values that are predicted check-out times according to the dining status (status) for menu items (ordered items). The check-out time master 12 may be set for each menu item, or may be set for each menu classification (for example, set meals, noodles, desserts, course dishes, etc.). Also, the check-out time master 12 may store setting values that are predicted check-out times according to work other than dining (non-dining work) at the table. The check-out time master 12 may set one setting value for non-dining work, or may set setting values according to the content or time zone of non-dining work. For example, the check-out time master 12 may set setting values that are predicted check-out times according to the content of non-dining work detectable from the images captured by the camera. Note that the check-out time master 12 may be stored in the memory of an external device that can communicate via the communication unit 45.

[0025] Next, an example of the check-out prediction information database 11 held in the data memory 44 by the information management apparatus 10 according to the embodiment will be described. FIG. 3 is a diagram showing an example of the check-out prediction information database (DB) 11 held in the data memory 44 by the information management apparatus 10 according to the embodiment. The check-out prediction information DB 11 holds data records for the number of seats (table seats, counter seats, etc.) that are units to be monitored. In the example shown in FIG. 3, the data record corresponding to each seat has fields for table number, status, meal service progress, post-meal progress, check-out prediction, and non-dining work.

[0026] The table number is identification information for identifying the table corresponding to each seat to be monitored. Here, it is assumed that the table number is assigned in units where a customer or a group of customers are seated. For example, the table number is assigned not only to the tables corresponding to table seats but also to the tables corresponding to counter seats. For example, for table seats, a table number is assigned to each table, and for counter seats, a table number is assigned corresponding to each seat. Note that when individual seats are to be monitored, the table number may be replaced with the seat number for identifying the individual seats.

[0027] The status is information indicating the situation of the table. The status is used as information for predicting the departure time. For example, the status is stored as one of a plurality of pre-set levels according to the order situation and the progress of the meal, etc. In the present embodiment, as the status, any one of "awaiting order", "order placed", "having a meal", "only tableware (meal completed)", "no tableware", "off-meal work" is stored.

[0028] "Awaiting order" and "order placed" are stored according to the presence or absence of an order from the customers seated at the table. "Awaiting order" and "order placed" are set, for example, according to the input content of the order information by the order terminal 22. For a table where no order has been input from the seated customers, the status becomes "awaiting order". For a table where an order has been input from the customers, the status becomes "order placed".

[0029] "Meal served" indicates a situation where the ordered menu (meal) is served on the table and the served meal remains on the table. "Dishes only (meal finished)" indicates a situation where the meal served on the table has been eaten. "No dishes" indicates a situation where the dishes after finishing the meal have been collected (tidied up). For example, when it is detected that the ordered meal has been served, the status is updated from "Ordered" to "Meal served". When it is detected that the meal has been eaten, the status is updated from "Meal served" to "Dishes only". Further, when it is detected that the dishes after finishing the meal have been collected, the status is updated from "Dishes only" to "No dishes".

[0030] The serving elapsed time indicates the elapsed time since the meal was brought to the table. For example, the check-out prediction information DB11 stores the elapsed time since the status changed to "Meal served" as the serving elapsed time. The post-meal elapsed time indicates the elapsed time since finishing the meal. For example, the check-out prediction information database 11 stores the elapsed time since the status changed to "Dishes only" as the post-meal elapsed time.

[0031] The check-out prediction indicates the check-out time predicted based on the status or off-meal operations, etc. For example, when the status or off-meal operation information is updated, the check-out prediction information DB11 stores the check-out time predicted from the updated situation as the check-out prediction. The predicted value of the check-out time according to the status may be specified based on the information stored in the check-out time master 12. Also, the check-out prediction information DB11 updates the check-out time as the check-out prediction to a value obtained by subtracting the elapsed time in a time period when there is no update of the status or off-meal operation information.

[0032] Out-of-meal operations indicate the implementation status of operations not related to meals. Out-of-meal operations are operations other than meals performed by customers seated at the table. For example, when it is detected that a personal computer (PC), book, notebook, materials, etc. are placed on the table, it is assumed that out-of-meal operations are being performed. Also, as out-of-meal operations, information indicating the content of the operation may be stored. For example, when the start of PC work is detected, information indicating PC work may be stored as out-of-meal operations. Also, when the start of reading is detected, information indicating reading may be stored as out-of-meal operations. Also, when the start of an operation using documents such as notebooks and materials is detected, information indicating document work may be stored as out-of-meal operations.

[0033] In the example shown in FIG. 3, the tables with table numbers "1" and "2" have a status of "waiting for order". The status of "waiting for order" indicates that no order has been input at the table. Also, when a customer who has come to the store is seated at a table, the status of the table may be set to "waiting for order" to indicate that there is a customer waiting for an order rather than an empty table.

[0034] In the example shown in FIG. 3, the table with table number "3" has a status of "ordered" and the meal has not been served (there is no record of the serving progress). That is, table "3" is in a situation waiting for the "ordered" meal to be served. For example, when the meal order content is input as table number "3" to the order terminal 22, the status is updated to "ordered".

[0035] Also, after the status is updated to "ordered", for the serving progress, the elapsed time from when the meal carried to the table is detected from the image taken by the camera 21 is recorded. For example, the elapsed time from when the first meal is carried to the table is recorded as the serving progress. Also, the elapsed time from when the last meal ordered is carried to the table may be recorded as the serving progress.

[0036] In the example shown in FIG. 3, the table with the table number "4" has a status of "no tableware". "No tableware" indicates a situation where the meal is completed and the tableware provided for the meal has been collected. "No tableware" is detected from the image captured by the camera 21. When "no tableware" is detected from the image captured by the camera 21, the status of the table is updated to "no tableware".

[0037] When the status is updated to "no tableware", the predicted time from when the tableware is collected until leaving the store is recorded as the departure prediction. The predicted time from when the tableware is collected until leaving the store (departure prediction time) is determined based on the set value recorded in the departure time master 12, etc. The time recorded as the departure prediction is updated according to the elapsed time if the status is not updated. When the status is updated, the departure prediction is updated to the predicted departure time predicted according to the status. For example, when there is an additional order, etc., the status corresponding to the situation of the additional ordered meal is updated, and the departure prediction is also updated according to the update of the status.

[0038] In the example shown in FIG. 3, the table with the table number "5" has a status of "only tableware". "Only tableware" indicates a situation where the meal is completed. Here, it is assumed that only the tableware remains on the table and it is detected that the meal is gone. However, as long as the status indicates a situation where the meal has ended, it may be recorded as "meal ended" instead of "only tableware". For example, if it is possible to detect from the image captured by the camera 21 that the meal has ended, the status may be "meal ended".

[0039] When the status is updated to "dishes only" ("meal finished"), the predicted time from the end of the meal to leaving the store is recorded as the leaving prediction. The predicted time from the end of the meal to leaving the store (leaving prediction time) is determined based on the set values recorded in the leaving time master 12. The time recorded as the leaving prediction is updated according to the elapsed time until the status is updated. For example, when the status is updated to "no dishes", as described above, the leaving prediction is updated to the leaving prediction time from when the dishes are collected to when leaving the store.

[0040] Next, an example of the leaving time master 12 held in the data memory 44 by the information management device 10 according to the embodiment will be described. FIG. 4 is a diagram showing an example of the leaving time master 12 held in the data memory 44 by the information management device 10 according to the embodiment. Here, it is assumed that the leaving time master 12 stores predicted values of the leaving time corresponding to individual menu items (ordered items) and statuses. FIG. 4 shows an example in which predicted values (leaving prediction times) of the leaving time for each status (meal situation) are stored in the leaving time master 12 for "pudding" as an example of a menu item.

[0041] In the example shown in FIG. 4, when the menu item is "pudding" and the status is "meal available", the set value as the predicted value of the leaving time is set to "30 minutes later". When it is detected that "pudding" has been brought to the table, the status of the leaving prediction information corresponding to the table changes to "meal available". Therefore, according to the leaving time master 12 shown in FIG. 4, the leaving prediction information for the table where "pudding" has been brought is updated so that the leaving prediction time is "30 minutes later".

[0042] Also, in the example shown in FIG. 4, when the menu item is "pudding" and the status is "only tableware", the set value for the predicted departure time is set to "15 minutes later". The departure prediction information corresponding to the table that has detected that the "pudding" has been eaten changes the status to "with meal". Therefore, according to the departure time master 12 shown in FIG. 4, the departure prediction information for the table that has finished eating the "pudding" has its predicted departure time updated to "15 minutes later".

[0043] Furthermore, in the example shown in FIG. 4, when the menu item is "pudding" and the status is "without tableware", the set value for the predicted departure time is set to "5 minutes later". When it is detected that the tableware for the eaten "pudding" has been collected, the departure prediction information corresponding to the table changes the status to "without tableware". Therefore, according to the departure time master 12 shown in FIG. 4, the departure prediction information for the table from which the tableware for the eaten "pudding" has been collected has its predicted departure time updated to "5 minutes later".

[0044] Next, a display example of information such as the predicted departure time managed by the information management device 10 on the guidance display device 31 will be described. FIG. 5 is a diagram showing a display example of a departure prediction screen displayed by the guidance display device 31 based on information from the information management device 10. In the departure prediction screen shown in FIG. 5, the predicted departure times of each guest seat (table) are displayed in a list in ascending order of the departure time. For example, it is assumed that on the guidance display device 31, an operator (store clerk or customer himself / herself) instructs the display of the departure prediction screen using an operation unit (not shown). The guidance display device 31 transmits a display request for the departure prediction screen to the information management device 10 in response to the display instruction for the departure prediction screen.

[0045] When the information management device 10 receives a display request for a check-out prediction screen from the guidance display device 31, it generates information for displaying the check-out prediction screen based on the information in the check-out prediction information DB 11. For example, the information management device 10 arranges the check-out prediction times of each seat stored in the check-out prediction information DB 11 in ascending order of the check-out time. In this case, the information management device 10 lists up the check-out prediction information held by the check-out prediction information DB 11 in ascending order of the check-out prediction time. The information management device 10 generates information to be output to the guidance display device 31 by extracting the information to be displayed on the check-out prediction screen from each of the listed check-out prediction information.

[0046] In the example shown in FIG. 5, the information management device outputs information such as the progress of meal service, the elapsed time after the meal, and the check-out prediction to the guidance display device 31 corresponding to each table number in ascending order of the check-out prediction time. However, the progress of meal service indicates the elapsed time since the meal was served (when the meal was brought to the table), the elapsed time after the meal indicates the elapsed time since the meal ended, and the check-out prediction indicates the check-out prediction time.

[0047] The guidance display device 31 acquires the check-out prediction information of each seat arranged in ascending order of the check-out prediction time from the information management device 10. The guidance display device 31 displays on the display unit a check-out prediction screen including a list showing the check-out prediction information of each seat arranged in ascending order of the check-out prediction time. According to the check-out prediction screen shown in FIG. 5, not only the shortest check-out prediction time but also the check-out prediction times after the second can be confirmed at a glance, and the waiting time can be immediately informed to the customers who come to the store.

[0048] Also, the guidance display device 31 may display the check-out prediction screen by specifying conditions such as the number of people or the seat (table). For example, when the display of the check-out prediction screen for a specified number of people is instructed, the information management device 10 outputs to the guidance display device 31 information arranged in ascending order of the check-out prediction time with the specified number of people as a condition. Thereby, the guidance display device 31 can display a check-out prediction screen on which the check-out prediction time for the specified number of people can be visually recognized at a glance.

[0049] Also, when the conditions of the seats (e.g., by the window) are specified, the information management device 10 outputs information arranged in ascending order of the predicted departure times for the seats that meet the specified conditions to the guidance display device 31. Thereby, the guidance display device 31 can display a predicted departure screen for the seats that meet the specified conditions.

[0050] FIG. 6 is a diagram showing a display example of a seat information screen that the guidance display device 31 displays based on information from the information management device 10. The seat information screen shown in FIG. 6 shows the status of orders, meals, etc. at each seat (table) in the store in a display format such as colors and patterns. In the display example shown in FIG. 6, seats for which an order has been placed are displayed with left-lower diagonal hatching, and seats for which the meal has ended are displayed with left-lower diagonal hatching and right-lower diagonal hatching.

[0051] Also, the guidance display device 31 displays information indicating the detailed status of the seats specified on the seat information screen. FIG. 6 shows a display example of the seat information screen when the seat (table) with the table number "4" is specified. When the seat with the table number "4" is specified, a window for displaying departure prediction information including the predicted departure time of table number "4" is displayed on the seat information screen as shown in FIG. 6.

[0052] Next, an update of the status according to the change in the status of the seats (tables) in the departure prediction information DB 11 will be described. FIG. 7 is a diagram showing an example of the transition of the status updated according to the change in the status of the seats (tables) in the departure prediction information DB 11. FIGS. 8 to 11 are diagrams showing display examples of the status of the table when each status is updated as shown in FIG. 7.

[0053] First, when an order for table number "4" is input at the order terminal 22, the information management device 10 receives the order data from the order terminal 22. When receiving the order data from the order terminal 22, the information management device 10 updates the status of table number "4" in the departure prediction information DB to "ordered". When an instruction is given to display the status of table number "4" in this state, the guidance display device 31 displays that no meal has been served at table number "4" as shown in FIG. 8.

[0054] When a meal is placed on the table with table number "4", the camera 21 detects from the image of the table with table number "4" that the meal has been delivered to the table (meal available). When the camera 21 detects that there is a meal at table number "4", it notifies the information management device 10 that the status of table number "4" has become "meal available". When the information management device 10 receives that table number "4" has become "meal available", it updates the status of table number "4" in the departure prediction information DB11 to "meal available".

[0055] When an instruction is given to display the status of table number "4" on the seat information screen in this state, the guidance display device 31 displays a display screen as shown in FIG. 9. In the display example shown in FIG. 9, it is displayed that the seat of table number "4" has a meal delivery elapsed time of 0 minutes (immediately after the meal was served) and the predicted departure time is 30 minutes later.

[0056] When the meal delivered to the table with table number "4" is finished being eaten, the camera 21 detects from the image of the table with table number "4" that the meal has ended (only tableware remains). When the camera 21 detects "only tableware" at table number "4", it notifies the information management device 10 that the status of table number "4" has become "only tableware". When the information management device 10 receives that table number "4" has become "only tableware", it updates the status of table number "4" in the departure prediction information DB11 to "only tableware".

[0057] When the table number "4" on the seat information screen is instructed in this state, the guidance display device 31 displays a display screen as shown in FIG. 10. In the display example shown in FIG. 10, the seats of table number "4" display that the meal service elapsed time is 20 minutes, the post-meal elapsed time is 0 minutes, and the predicted departure time is 15 minutes later.

[0058] When the tableware after the meal is collected from the table with table number "4", the camera 21 detects that the tableware has been collected (no tableware) from the image of the table with table number "4". When the camera 21 detects "no tableware" for table number "4", it notifies the information management device 10 that the status of table number "4" has become "no tableware". When the information management device 10 receives that table number "4" has become "no tableware", it updates the status of table number "4" in the departure prediction information DB 11 to "no tableware".

[0059] When the table number "4" on the seat information screen is instructed in this state, the guidance display device 31 displays a display screen as shown in FIG. 11. In the display example shown in FIG. 11, the seats of table number "4" display that the meal service elapsed time is 35 minutes, the post-meal elapsed time is 15 minutes, and the predicted departure time is 5 minutes later. Thereby, the guidance display device 31 can display the departure prediction information including the predicted departure time of a specific seat (table) on the seat information screen as well.

[0060] Next, an operation example of the information management device 10 according to the embodiment will be described. FIG. 12 is a flowchart for explaining an operation example of the information management device 10 according to the embodiment. The processor 41 of the information management device 10 acquires information from each device connected via the communication unit 45 at an arbitrary timing. For example, the processor 41 receives order data from the order terminal 22. Also, the processor 41 receives data including the status indicating the situation of each table from the camera 21. Also, the processor 41 receives a display request from the guidance display device 31.

[0061] When the communication unit 45 acquires the order data from the order terminal 22 (ACT11, YES), the processor 41 stores the acquired order data in the data memory 44 (ACT12). For example, the processor 41 stores information indicating the ordered items (menu items) and the quantities for each table number included in the order data. Also, the processor 41 updates the status corresponding to the table number included in the order data in the departure prediction information DB11 to "ordered".

[0062] When the processor 41 acquires the status indicating a change in the situation of a specific table from the camera 21 (ACT13, YES), the processor 41 updates the status of the table in the departure prediction information DB11 (ACT14). Here, it is assumed that when the camera 21 detects a change in the situation in the table to be monitored, the camera 21 transmits the status indicating the situation to the information management device 10. The processor 41 updates the status of the corresponding table based on the information acquired from the camera 21.

[0063] That is, the camera 21 always (at a predetermined cycle) captures the table to be monitored, and detects a change in the situation in the table by performing image recognition processing on the captured image. The camera 21 detects a status indicating the progress of the meal, etc., as a change in the situation on the table. For example, the camera 21 detects "meal in progress", "only tableware", "no tableware", "off - meal work" as the status indicating the situation of the table. When detecting a change in the situation (status), the camera 21 notifies the information management device 10 of the status indicating the situation of the table.

[0064] When detecting that a meal has been placed on the table, the camera 21 notifies the information management device 10 that the status of the table is set to "meal in progress". For example, the camera 21 transmits data indicating that the status has become "meal in progress" associated with the table number of the table to the information management device 10. When the processor 41 of the information management device 10 receives the notification of "meal in progress" from the camera 21, the processor 41 updates the status of the departure management information of the table to "meal in progress".

[0065] Also, when it is detected that the meal on the table has been finished, the camera 21 notifies the information management device 10 that the status of the table is "only tableware (meal finished)". For example, the camera 21 transmits data indicating that the status has become "only tableware" to the information management device 10 in association with the table number of the table. The processor 41 of the information management device 10 updates the status of the check-out prediction information of the table to "only tableware" according to the status of "with meal" obtained from the camera 21.

[0066] However, the processor 41 may determine whether all the ordered items of food at a table where a plurality of menu items have been ordered have been finished. That is, the processor 41 may update the status to "only tableware" when it determines, based on the order data of the table, that all the ordered items of food have been finished. For example, the processor 41 may update the status of the table to "only tableware" when it is notified that the status of "only tableware" of a table where the provision of all ordered items has been completed.

[0067] Also, when it is detected that the finished tableware has been collected, the camera 21 notifies the information management device 10 that the status of the table is "no tableware". For example, the camera 21 transmits data indicating that the status has become "no tableware" to the information management device 10 in association with the table number of the table. The processor 41 of the information management device 10 updates the status of the table to "no tableware" according to the status of "no tableware" obtained from the camera 21.

[0068] However, the processor 41 may determine whether or not the tableware for the meals of all the items ordered for a table with multiple menu items has been collected. That is, the processor 41 may update the status to "no tableware" when it determines that the tableware for the meals of all the items ordered at the table has been collected. For example, the processor 41 may update the status of the table to "no tableware" when "no tableware" is notified for a table where the provision of all ordered items has been completed.

[0069] Also, when detecting a non-meal operation at a table, the camera 21 notifies the information management device 10 of information indicating that the status of the table is "non-meal operation". For example, the camera 21 transmits data indicating that the status is "non-meal operation" to the information management device 10 in association with the table number of the table. The processor 41 of the information management device 10 updates the status of the table's departure prediction information to "non-meal operation" according to the status of "non-meal operation" obtained from the camera 21. In addition, when also obtaining information indicating the content of the non-meal operation, the information management device 10 records the information indicating the content of the non-meal operation in the departure prediction information DB 11.

[0070] When updating the status corresponding to the table in the departure prediction information DB 11, the processor 41 specifies the departure prediction time according to the updated status (ACT15). For example, when updating the status to "having a meal", "only tableware", or "no tableware", the processor 41 refers to the departure time master 12 to specify the departure prediction time according to the ordered menu items and the status. Also, when the processor 41 updates the status of a table in the departure prediction information DB 11 to "non-meal operation", it specifies the departure prediction time according to the non-meal operation. Also, when the order data in the table with updated status contains multiple ordered items (menu items), the processor 41 selects a menu item to be used as a criterion for predicting the leaving time. For example, the processor 41 may select the menu item that was last provided to the table as the menu item to be used as a criterion for predicting the leaving time. Also, the processor 41 may select the menu item with the latest leaving time among the multiple menu items as the menu item to be used as a criterion for predicting the leaving time. Also, when a menu item (such as dessert or drink) to be provided after the meal (last) is specified, the processor 41 may select the menu item to be provided after the meal as the menu item to be used for predicting the leaving time.

[0071] When the processor 41 selects a menu item to be used for predicting the leaving time, the processor 41 specifies the predicted leaving time corresponding to the selected menu item and the status from the leaving time master 12. For example, in the case of the leaving time master 12 shown in FIG. 4, if the menu item is "pudding" and the status is "with meal", the processor 41 specifies the predicted leaving time as "30 minutes later". Also, if the menu item is "pudding" and the status is "only tableware", the processor 41 specifies the predicted leaving time as "15 minutes later". If the menu item is "pudding" and the status is "without tableware", the processor 41 specifies the predicted leaving time as "5 minutes later".

[0072] After specifying the predicted leaving time, the processor 41 updates the predicted leaving time corresponding to the table number with the updated status in the leaving prediction information DB 11 to the specified predicted leaving time (ACT16).

[0073] After updating the predicted leaving time in the leaving prediction information DB 11, the processor 41 updates the predicted leaving time of each table number according to the elapsed time (ACT17). Also, even when there is no status update, the processor 41 updates the predicted leaving time of each table number in the leaving prediction information DB 11 according to the elapsed time. Through the processes of ACT11 to 17 described above, the information management apparatus 10 can hold information indicating the status of each seat (table) and the predicted departure time in the departure prediction information DB 11.

[0074] Further, the processor 41 receives a display request for information from a guidance display device 31 such as a POS terminal at an arbitrary timing. For example, the processor 41 receives a display request for predicted departure or a display request for seat information from the guidance display device 31.

[0075] When the processor 41 receives a display request for predicted departure from the guidance display device 31 (ACT18, YES), the processor 41 outputs the predicted departure information held in the departure prediction information DB 11 to the guidance display device 31 in response to the request (ACT19). For example, when a display of a predicted departure screen (a list of predicted departure times) is requested, the processor 41 outputs information in which the predicted departure times of each seat in the departure prediction information DB 11 are arranged in ascending order of the departure time to the guidance display device 31. Thereby, the guidance display device 31 can display on a predicted departure screen as shown in FIG. 5 including a list arranged in ascending order of the predicted departure times of each seat. As a result, the store clerk can inform a customer who comes to the store or the like of the predicted waiting time by looking at the predicted departure time displayed on the guidance display device 31.

[0076] Further, the guidance display device 31 may request the information management apparatus 10 to display a predicted departure screen by designating the number of users. In this case, the processor 41 of the information management apparatus 10 outputs information in which the predicted departure times of each seat searched for limited to customers who can be seated for the designated number of people are arranged in ascending order to the guidance display device 31. Thereby, the guidance display device 31 can display a predicted departure screen for knowing the waiting time for the designated number of people.

[0077] Further, the guidance display device 31 may request the information management device 10 to display a check-out prediction screen for seats that meet specific conditions (for example, seats by the window, etc.). In this case, the processor 41 of the information management device 10 outputs information arranged in ascending order of the check-out prediction time for the seats selected under the specified conditions to the guidance display device 31. Thereby, the guidance display device 31 can display a check-out prediction screen for knowing the waiting time for seats that meet the specified conditions.

[0078] When receiving a display request for seat information from the guidance display device 31 (ACT20, YES), the processor 41 outputs information indicating the status of each seat held by the check-out prediction information DB11 in response to the request to the guidance display device 31 (ACT21). For example, when a display of a seat information screen as shown in FIG. 6 is requested, the processor 41 specifies, based on the check-out prediction information DB11, whether each seat is in the state of waiting for an order, having an order, or having finished eating. The processor 41 outputs information indicating whether each seat is in the state of "waiting for an order", "having an order", or "having finished eating" to the guidance display device 31. Thereby, the guidance display device 31 can display a seat information screen as shown in FIG. 6.

[0079] Further, when a specific seat (table) is indicated during the display of the seat information screen, the guidance display device 31 requests the information management device 10 to display information indicating the status of the specified seat. The processor 41 of the information management device 10 acquires the information of the specified seat from the check-out prediction information DB11 from the guidance display device 31. The processor 41 transmits information for displaying the status of the specified seat based on the acquired information to the guidance display device 31. Thereby, the guidance display device 31 can display information indicating the status of the specified seat on the seat information screen as shown in FIG. 6.

[0080] As described above, according to the present embodiment, the information management device acquires data including a status indicating the situation of the table detected from a captured image including an image on the table captured by the camera. When the status of the table changes, the information management device predicts the departure time based on a set value set according to the status. The information management device identifies the current predicted departure time by updating the predicted departure time for the changed status according to the elapsed time. The information management device outputs the current predicted departure time updated according to the elapsed time to the display device.

[0081] Thereby, the information management device according to the embodiment can display the predicted departure time according to the situation at each table in the store on the guidance display device, and can easily know the prediction of the departure time. As a result, the store clerk can easily grasp the information regarding the departure time of each table in the store. In addition, even when the store is full, the store clerk can immediately guide the waiting time based on the predicted departure time displayed on the guidance display device to new customers who come to the store.

[0082] Although several embodiments of the present invention have been described, these embodiments are presented by way of example and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the gist of the invention. These embodiments and their modifications are included in the scope and gist of the invention, and are included in the invention described in the claims and the equivalent scope thereof.

Explanation of Reference Numerals

[0083] 1... Guidance system, 10... Information management device, 11... Departure prediction information database, 12... Departure time master, 21... Camera, 22... Order terminal, 31... Guidance display device (display device), 41... Processor, 42... ROM, 43... RAM, 44... Data memory (memory), 45... Communication unit (acquisition unit).

Claims

1. An acquisition unit that acquires data including a status indicating the situation of the table detected from a captured image including an image on the table captured by a camera; A processor that predicts the departure time until the customer at the table departs based on a predicted value of the departure time according to the status acquired by the acquisition unit and the elapsed time since the status changed, and outputs the predicted departure time as a predicted departure time to a display device; An information management device having the above.

2. When the status changes to having a meal, the processor predicts the departure time based on the predicted value from the start of the meal to the departure and the elapsed time, and when the status changes to the end of the meal, the processor predicts the departure time based on the predicted value from the end of the meal to the departure and the elapsed time. When the status changes to having the dishes collected, the processor predicts the departure time based on the predicted value from the collection of the dishes to the departure. The information management device according to Claim 1. The information management device according to Claim 1.

3. When it is detected from the image captured by the camera that work other than a meal has started on the table, the processor further predicts the departure time according to the predicted value from the start of the work other than the meal to the departure and the elapsed time. The information management device according to Claim 2. The information management device according to Claim 2.

4. The acquisition unit further acquires information indicating the menu items ordered at the table, and the processor predicts the departure time according to the menu items ordered at the table and the status of the table based on master information indicating the predicted value of the departure time for each status of the menu items. The information management device according to any one of Claims 1 to 3. The information management device according to any one of Claims 1 to 3.

5. Having a memory that stores departure prediction information including a status and a predicted departure time for each table in the store, The processor outputs to the display device information in which the departure prediction information of each table in the store stored in the memory is arranged in ascending order of the predicted departure time. The information management device according to any one of Claims 1 to 4. The information management device according to any one of Claims 1 to 4.

6. In a computer, A function of acquiring data including a status indicating the situation of the table detected from a captured image including an image on the table captured by a camera; A function that predicts the departure time until a customer in the table departs based on the predicted value of the departure time according to the status obtained by the function and the elapsed time since the status changed, and outputs the predicted departure time as the predicted departure time to a display device; An information management program for executing the above.

Citation Information

Patent Citations

  • Device for outputting predicted waiting time and device for outputting predicted waiting period and storage medium

    JP2000020832A

  • Method for processing information with respect to reservation, and method for reservation

    JP2003162569A

  • Utilization situation prediction system and method, and data processing device and program

    JP2005338993A

  • Seat management device, program and robot

    JP2019003361A

  • Store management system

    JP2022041715A