Order receiving system, order receiving device and program
The order receiving system uses speech recognition and verification to reduce errors in restaurant order-taking by comparing estimated items with a created list and alerting staff to discrepancies, ensuring accurate order processing.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2023-08-22
- Publication Date
- 2026-03-03
AI Technical Summary
Existing order-taking systems in restaurants are prone to errors due to mishearing or operational mistakes by staff, leading to incorrect menu item orders.
An order receiving system that includes a creating means, an estimating means, and a confirming means to verify and correct orders, utilizing speech recognition to estimate items and compare against a created list, with a notifying means to alert errors.
Reduces order-taking errors by confirming and correcting misheard or incorrectly input menu items, ensuring accurate order processing.
Smart Images

Figure 0007823006000001 
Figure 0007823006000002 
Figure 0007823006000003
Abstract
Description
[Technical Field]
[0001] An embodiment of the present invention relates to an order receiving system, an order receiving device of this system, and a program for causing a computer to function as the order receiving device. [Background technology]
[0002] In restaurants, there is an order reception system in which waiters carry an order reception device called a handheld terminal or the like and input data of menu items ordered by customers at their seats into the order reception device. This type of order reception system has the possibility of receiving an order for the wrong menu item due to a waiter mishearing or operating error. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2014-078007 Summary of the Invention [Problem to be solved by the invention]
[0004] The problem to be solved by the embodiments of the present invention is to provide a technology that can eliminate order-taking errors caused by mishearing or operation errors by store clerks. [Means for solving the problem]
[0005] In one embodiment, the order receiving system includes a creating means, an estimating means, a confirming means, and a notifying means. The creating means creates a list of ordered items from order information input by operating an input device. The estimating means estimates the ordered items from text obtained by recognizing speech input from a microphone. The confirming means confirms whether the estimated ordered items estimated by the estimating means are present in the list of ordered items created by the creating means. The notifying means issues a notification when the estimated ordered items are not present in the list of ordered items. [Brief explanation of the drawings]
[0006] [Figure 1] FIG. 1 is a schematic diagram showing a schematic configuration of an order receiving system according to an embodiment. [Figure 2] FIG. 2 is a block diagram showing the main circuit configuration of the management server that constitutes the order receiving system. [Figure 3] FIG. 3 is a block diagram showing the main circuit configuration of a voice recognition server that constitutes the order receiving system. [Figure 4] FIG. 4 is a block diagram showing the main circuit configuration of a store station incorporated in a store system that constitutes the order receiving system. [Figure 5] FIG. 5 is a schematic diagram showing an example of information stored in an order data memory provided in the store station. [Figure 6] FIG. 6 is a plan view showing an example of the external configuration of a handy terminal incorporated in a store system that constitutes an order receiving system. [Figure 7] FIG. 7 is a block diagram showing the main circuit configuration of the handy terminal. [Figure 8] FIG. 8 is a schematic diagram showing the configuration of the first table included in the handy terminal. [Figure 9] FIG. 9 is a schematic diagram showing the configuration of the second table included in the handy terminal. [Figure 10] FIG. 10 is a schematic diagram showing the configuration of the third table included in the handy terminal. [Figure 11] FIG. 11 is a flowchart showing the main information processing steps that the processor of the handy terminal executes in accordance with the order receiving program. [Figure 12] FIG. 12 is a flowchart showing the main information processing steps that the processor of the handy terminal executes in accordance with the order receiving program. [Figure 13] FIG. 13 is a schematic diagram showing an example of a confirmation screen displayed on the display unit of the handy terminal. [Figure 14]FIG. 14 is a schematic diagram showing an example of a mismatch list screen displayed on the display unit of the handy terminal. [Figure 15] FIG. 15 is a sequence diagram of main data signals transmitted and received between the handy terminal, the voice recognition server, and the store station. DETAILED DESCRIPTION OF THE INVENTION
[0007] Hereinafter, an embodiment of an order receiving system that addresses order errors caused by staff mishearing, operational errors, etc. will be described with reference to the drawings. This embodiment illustrates an order receiving system for a restaurant in which a staff member in charge of serving customers carries a portable order receiving device and inputs data on menu items ordered by customers at their tables into the order receiving device.
[0008] First Embodiment [Outline of the order reception system] 1 is a schematic diagram showing the general configuration of an order receiving system 100. The order receiving system 100 includes a management server 1, a voice recognition server 2, and a store system 3. The order receiving system 100 communicatively connects the management server 1, the voice recognition server 2, and the store system 3 via a communication network 4. The communication network 4 is the Internet, a mobile communication network, a LAN (local area network), a VPN (virtual private network), a public communication network, etc., either alone or in combination as appropriate.
[0009] The store system 3 is established in a restaurant or the like that prepares and serves ordered items to customers who place orders. The order receiving system 100 may include store systems 3 for multiple stores. For example, in a restaurant chain with multiple stores, a store system 3 is established for each store. The store system 3 for each store may then be connected to a communication network 4 to form the order receiving system 100 together with the management server 1 and the voice recognition server 2. The store system 3 may also be called an order entry system (OES), restaurant POS (Point Of Sales) system, etc.
[0010] The store system 3 includes a handheld terminal 31, a slip printer 32, a kitchen terminal 33, a POS terminal 34, a store station 35, a wireless router 36, a communication network 37, and a gateway 38. Although one handheld terminal 31, slip printer 32, POS terminal 34, store station 35, and wireless router 36 are shown in Fig. 1, the number of each is arbitrary. In many cases, the store system 3 includes multiple handheld terminals 31.
[0011] The store system 3 connects the handheld terminal 31, slip printer 32, kitchen terminal 33, POS terminal 34, and store station 35 so that they can communicate with each other via a communication network 37. Specifically, the handheld terminal 31 and kitchen terminal 33 connect to the communication network 37 via a wireless router 36 by wireless communication with the wireless router 36. The handheld terminal 31 and kitchen terminal 33 may also be directly connected to the communication network 37. The slip printer 32, POS terminal 34, and store station 35 may also be connected to the communication network 37 via the wireless router 36 by wireless communication with the wireless router 36.
[0012] The handheld terminal 31 functions as a portable order receiving device for receiving orders for menu items. The handheld terminal 31 is generally carried by a store clerk, or so-called customer service staff member. When a customer orders a menu item from a customer at a table in the store, the customer service staff operates the handheld terminal 31 to input the order details. Specifically, the customer service staff inputs the ordered menu item, order quantity, etc. Menu items are generally items listed on a restaurant menu. Menu items can also be referred to as prepared food, products, menu items, etc. Each menu item is assigned a unique product number. Product numbers are numbers assigned to each menu item to identify each menu item uniquely. Product numbers can also be referred to as item codes, product codes, etc. When inputting a menu item, the handheld terminal 31 may input the product number of the menu item. When inputting a menu item, the handheld terminal 31 may input information related to the menu item other than the product number.
[0013] The slip printer 32 is installed, for example, on the customer service floor or in the kitchen. The slip printer 32 installed on the customer service floor prints order slips. The order slips are printed so that the customers can understand the contents of the menu items they have ordered, and are given to the customers. Such slip printers 32 are called customer printers, etc. On the other hand, the slip printer 32 installed in the kitchen prints cooking slips. The cooking slips are printed so that the staff member in charge of cooking, the so-called chef, can understand the contents of the menu items they have ordered, and are given to the chef. Such slip printers 32 are called kitchen printers, etc.
[0014] The kitchen terminal 33 is installed, for example, in the kitchen. The kitchen terminal 33 is equipped with a display device, and displays a screen on this display device for the chef or other personnel to check the contents of the menu items ordered by the customer. The kitchen terminal 33 also has an input device, and the chef or other personnel inputs various instructions via this input device. The instructions are, for example, instructions to notify the store station 35 that cooking has finished.
[0015] The POS terminal 34 is installed, for example, on the customer service floor or at the checkout counter. The POS terminal 34 processes information related to various operations such as guiding customers, taking orders, serving, distributing food, and accounting. The POS terminal 34 installed on the customer service floor mainly processes information related to guidance, taking orders, serving, and distributing food. The POS terminal 34 installed at the checkout counter also processes information related to accounting. The POS terminal 34 may be specialized for a specific purpose by processing only some of the above operations.
[0016] The store station 35 manages orders for menu items received at the handy terminal 31. The store station 35 controls the slip printer 32, the kitchen terminal 33, and the POS terminal 34 in response to orders for menu items received at the handy terminal 31.
[0017] For example, the store station 35 controls the printing of order slips, cooking slips, etc. by the slip printer 32 based on the order of a menu item received at the handy terminal 31. Through this control, an order slip or cooking slip is issued that describes the contents of the menu item ordered by the customer.
[0018] For example, the store station 35 controls the screen display of the display device provided in the kitchen terminal 33 based on an order for a menu item received at the handy terminal 31. The store station 35 also controls the screen display of the display device provided in the kitchen terminal 33 based on an instruction to finish cooking input from the kitchen terminal 33. Through this control, the cook in the kitchen can check, for example, on the display screen of the kitchen terminal 33, menu items that have been ordered by a customer but have not yet been cooked.
[0019] For example, in response to a request from the POS terminal 34, the store station 35 controls the output of data related to the order of menu items that it manages to the POS terminal 34. Through this control, for example, data related to an order from a customer who has finished eating and drinking is sent to the POS terminal 34. The POS terminal 34 then processes information related to, for example, the bill based on the order data retrieved from the store station 35. In this way, the customer who has finished eating and drinking can pay for the menu items that they ordered.
[0020] The wireless router 36 performs wireless communication with devices such as the kitchen terminal 33 and the handy terminal 31 that have wireless communication capabilities, and enables the devices to communicate via the communication network 37 .
[0021] The communication network 37 transmits data exchanged between devices equipped with communication functions, such as the handheld terminal 31, slip printer 32, kitchen terminal 33, POS terminal 34, and store station 35. A LAN is typically used as the communication network 37. The communication network 37 may be a LAN, the Internet, a VPN, a public communication network, a mobile communication network, or the like, either alone or in appropriate combination.
[0022] The gateway 38 connects the communication network 37 and the communication network 4. For example, the handheld terminal 31 exchanges data signals with the voice recognition server 2 via the communication network 37, the gateway 38, and the communication network 4. The data signal transmitted from the handheld terminal 31 to the voice recognition server 2 is, for example, a voice signal. The data signal transmitted from the voice recognition server 2 to the handheld terminal 31 is, for example, a signal indicating data obtained by recognizing the voice of the voice signal.
[0023] [Administration Server Description] 2 is a block diagram showing the main circuit configuration of the management server 1. The management server 1 includes a processor 11, a main memory 12, an auxiliary storage device 13, a communication interface 14, and a system transmission path 15. The system transmission path 15 includes an address bus, a data bus, a control signal line, and the like. The system transmission path 15 connects the processor 11 to each of the other components and transmits data signals exchanged between them. The management server 1 constitutes a computer by connecting the processor 11 to the main memory 12, the auxiliary storage device 13, and the communication interface 14 via the system transmission path 15.
[0024] The processor 11 corresponds to the central part of the computer. The processor 11 controls each part to realize various functions of the management server 1 in accordance with an operating system or application programs. The processor 11 is, for example, a CPU (Central Processing Unit). The processor 11 is preferably a multi-core processor that includes multiple processor cores and is capable of executing multiple processes in parallel.
[0025] The main memory 12 corresponds to the main storage portion of the computer. The main memory 12 includes a nonvolatile memory area and a volatile memory area. The main memory 12 stores an operating system or application programs in the nonvolatile memory area. The main memory 12 may store data required for the processor 11 to execute processes for controlling each part in either the nonvolatile or volatile memory area. The main memory 12 uses the volatile memory area as a work area where data is rewritten by the processor 11 as appropriate. The nonvolatile memory area is, for example, ROM (Read Only Memory). The volatile memory area is, for example, RAM (Random Access Memory).
[0026] The auxiliary storage device 13 corresponds to the auxiliary storage portion of the computer. For example, an EEPROM (Electric Erasable Programmable Read-Only Memory), an HDD (Hard Disk Drive), or an SSD (Solid State Drive) can be the auxiliary storage device 13. The auxiliary storage device 13 stores data used by the processor 11 when performing various processes, data created by the processes in the processor 11, etc. The auxiliary storage device 13 may also store the application programs described above.
[0027] The communication interface 14 is an interface for performing data communication between the voice recognition server 2 and the store system 3 via the communication network 4.
[0028] The management server 1 configured as described above uses part of the storage area of the auxiliary storage device 13 as an area for the master menu database DBa and an area for the employee database DBb. The master menu database DBa stores data related to various menu items provided to customers at stores in which the store system 3 connected via the communication network 4 is established. The data related to the menu items includes the product number, item name, price, etc. of the menu item.
[0029] The employee database DBb stores data related to store employees, or so-called store clerks. The aforementioned customer service staff and cooks also belong to the store clerk category. Data related to the store clerk includes the employee code, name, password, etc. of the store clerk. The employee code is a unique code assigned to each store clerk. The employee code can also be referred to as an employee ID, etc. The password is a password used by the store clerk identified by the employee code when logging in to the devices that make up the store system 3.
[0030] For example, a store clerk operating the handheld terminal 31 performs a login operation by entering his or her employee code and password into the handheld terminal 31 before starting operation. In response to this login operation, the management server 1 searches the employee database DBb. If the password associated with the employee code entered into the handheld terminal 31 matches the password entered into the handheld terminal 31, the login is approved. If the login is approved, the handheld terminal 31 becomes available for operation by that employee. At this time, the employee code entered during the login operation is stored in the memory of the handheld terminal 31. The employee code is retained until a logout operation is performed on the handheld terminal 31 to declare the end of operation.
[0031] Such information processing regarding login and logout is similarly executed for the kitchen terminal 33 and the POS terminal 34. Note that the store station 35 may store a database similar to the employee database DBb, and the store station 35 may perform the information processing regarding login and logout described above.
[0032] The databases managed by the management server 1 are not limited to the master menu database DBa and the employee database DBb. For example, the management server 1 also manages a store database that stores data related to stores, a supplier database that stores data related to suppliers, and the like.
[0033] [Description of speech recognition server] 3 is a block diagram showing the main circuit configuration of the speech recognition server 2. The speech recognition server 2 includes a processor 21, a main memory 22, an auxiliary storage device 23, a communication interface 24, and a system transmission path 25. The system transmission path 25 includes an address bus, a data bus, a control signal line, and the like. The system transmission path 25 connects the processor 21 with each of the other components and transmits data signals exchanged between them. The speech recognition server 2 constitutes a computer by connecting the processor 21 with the main memory 22, the auxiliary storage device 23, and the communication interface 24 via the system transmission path 25.
[0034] The processor 21 corresponds to the central part of the computer. The processor 21 controls each part to realize various functions of the speech recognition server 2 in accordance with an operating system or application programs. The processor 21 is, for example, a CPU. The processor 21 is preferably a multi-core processor that includes multiple processor cores and is capable of executing multiple processes in parallel.
[0035] The main memory 22 corresponds to the main storage portion of the computer. The main memory 22 includes a nonvolatile memory area and a volatile memory area. The main memory 22 stores an operating system or application programs in the nonvolatile memory area. The main memory 22 may store data required for the processor 21 to execute processes for controlling each part in either the nonvolatile or volatile memory area. The main memory 22 uses the volatile memory area as a work area where data is rewritten by the processor 21 as appropriate. The nonvolatile memory area is, for example, ROM. The volatile memory area is, for example, RAM.
[0036] The auxiliary storage device 23 corresponds to the auxiliary storage portion of the computer. For example, an EEPROM, HDD, or SSD can be the auxiliary storage device 23. The auxiliary storage device 23 stores data used by the processor 21 when performing various processes, data created by the processes in the processor 21, etc. The auxiliary storage device 23 may also store the application programs described above.
[0037] The communication interface 24 is an interface for performing data communication between the management server 1 and the store system 3 via the communication network 4.
[0038] The speech recognition server 2 configured as described above allocates part of the storage area of the auxiliary storage device 23 to a speech recognition application APa and a dictionary database DBc. The speech recognition application APa is application software that causes a computer to recognize input speech, convert it into text, and search the text for terms registered in the dictionary database DBc. The dictionary database DBc is a database for registering various terms to be searched in the speech recognition server 2. In this embodiment, the dictionary database DBc registers the names of menu items as search terms. The item names are not limited to the names listed on the menu. For example, if the name of an item listed on the menu is "A Set Meal," but many customers abbreviate it to "A Set," both "A Set Meal" and "A Set" are registered in the dictionary database DBc. Such term registration may be achieved by a learning function of the dictionary database DBc provided in the speech recognition server 2.
[0039] The processor 21 of the speech recognition server 2 operates in accordance with the speech recognition application APa to function as an estimation unit 61. The estimation unit 61 estimates the menu item for which an order has been accepted by the handheld terminal 31, i.e., the so-called ordered item, from text obtained by recognizing input speech. The speech is captured by, for example, a microphone 57 (see FIG. 7 ) provided in the handheld terminal 31. For example, the microphone 57 captures speech uttered by a customer service representative carrying the handheld terminal 31 or a customer being served by the customer service representative. The speech data captured by the microphone 57 is input to the speech recognition server 2 via the wireless router 36, the communication network 37, the gateway 38, and the communication network 4. The estimation unit 61 recognizes the input speech and converts it into text. If a term registered in the dictionary database DBc is detected from the text, the estimation unit 61 estimates the term as the name of the ordered item. The estimation unit 61 notifies the handheld terminal 31, which is the source of the speech input, of data related to the estimated item name of the ordered item. Data relating to the item name of the ordered item is input to the handy terminal 31 that is the source of the voice input via the reverse route of the voice data. The voice recognition server 2 that operates in this way can be realized by employing voice recognition technology that utilizes AI (artificial intelligence), for example.
[0040] [Store Station Description] 4 is a block diagram showing the main circuit configuration of the store station 35. The store station 35 includes a processor 351, a main memory 352, an auxiliary storage device 353, a communication interface 354, and a system transmission path 355. The system transmission path 355 includes an address bus, a data bus, a control signal line, and the like. The system transmission path 355 connects the processor 351 to each of the other components and transmits data signals exchanged between them. The store station 35 constitutes a computer by connecting the processor 351 to the main memory 352, the auxiliary storage device 353, and the communication interface 354 via the system transmission path 355.
[0041] The processor 351 corresponds to the central part of the computer. The processor 351 controls each part to realize various functions of the store station 35 in accordance with an operating system or an application program. The processor 351 is, for example, a CPU. The processor 351 is preferably a multi-core processor that includes multiple processor cores and is capable of executing multiple processes in parallel.
[0042] The main memory 352 corresponds to the main storage portion of the computer. The main memory 352 includes a nonvolatile memory area and a volatile memory area. The main memory 352 stores an operating system or application programs in the nonvolatile memory area. The main memory 352 may store data required for the processor 351 to execute processes for controlling each part in either the nonvolatile or volatile memory area. The main memory 352 uses the volatile memory area as a work area where data is rewritten by the processor 351 as appropriate. The nonvolatile memory area is, for example, ROM. The volatile memory area is, for example, RAM.
[0043] The auxiliary storage device 353 corresponds to the auxiliary storage portion of the computer. For example, an EEPROM, HDD, or SSD can be the auxiliary storage device 353. The auxiliary storage device 353 stores data used by the processor 351 when performing various processes, data created by the processes in the processor 351, etc. The auxiliary storage device 353 may also store the application programs described above.
[0044] The communication interface 354 is an interface for performing data communication with other devices in the store system 3 via the communication network 37.
[0045] In the store station 35 configured as described above, part of the storage area of the auxiliary storage device 313 is used as an area for the menu database DBd and an area for the order data memory MRa. The menu database DBd is created in the area for the menu database DBd. The menu database DBd stores data related to various menu items provided to customers at the store where the store system 3 is installed. The data related to the menu items includes the product number, item name, price, etc. of the menu item. The menu database DBd is created based on the data stored in the master menu database DBa.
[0046] Multiple order data memories MRa are created in the order data memory MRa. The order data memory MRa collectively stores information related to the menu items ordered by a group of customers. In other words, an order data memory MRa is prepared for each customer. An example of information stored in the order data memory MRa is shown in FIG. 5. As shown in the figure, the order data memory MRa stores information such as a slip number, order date and time, employee code, seat number, number of people, one or more order data, total number of items, and total price. The slip number is an identification number for the order slip. For example, a series of numbers that are incremented by "1" each time an order slip is printed from the slip printer 32 is printed on the order slip. The slip number may be printed on the order slip in the form of a machine-readable code such as a barcode. The order date and time is the date and time the order was placed. The employee code is an identification code for the employee who accepted the order using the handheld terminal 31. The seat number is the seat number of the customer who placed the order. Each seat is assigned a unique seat number to prevent duplication. The number of people is the number of customers seated at the seat. The order data includes the item number, item name, number of items, and price of the menu item ordered by the customer. The number of items is the number of items ordered for the same item. The price is calculated by multiplying the price of the menu item by the number of items ordered. The total number of items is the sum of the number of items in all order data. The total price is the sum of the prices of all order data.
[0047] The processor 351 of the store station 35 operates in accordance with application software (not shown) to realize the function of order management means 62. The order management means 62 has a function to register data of necessary items in the order data memory MRa based on data input via the handy terminal 31. The order management means 62 also has a function to control the slip printer 32 to issue an order slip and a cooking slip based on the data registered in the order data memory MRa, and to display a screen on the kitchen terminal 33 for the chef or other personnel to confirm the order. The order management means 62 also has a function to output the data registered in the order data memory MRa to the POS terminal 34, which processes information related to the transaction.
[0048] [Explanation of Handy Terminal 31] Fig. 6 is a plan view showing an example of the external configuration of the handheld terminal 31. In Fig. 6, the handheld terminal 31 includes a first body 51 disposed on the left side and a second body 52 disposed on the right side. Both the first body 51 and the second body 52 are substantially rectangular parallelepipeds. The second body 52 is rotatably connected to the first body 51 via a fastener 53 such as a hinge. The fastener 53 allows the second body 52 to be opened and closed relative to the first body 51 between an open state (see Fig. 6) and a closed state (not shown).
[0049] A touch panel 54 is arranged on an inner surface 511 of the first body 51 that is exposed when the second body 52 is opened relative to the first body 51. Similarly, a keyboard 55 is arranged on an inner surface 521 of the second body 52 that is exposed when the second body 52 is opened relative to the first body 51. The touch panel 54 and the keyboard 55 constitute an operation unit of the handheld terminal 31.
[0050] Specifically, the keyboard 55 has a matrix of menu keys, each assigned to a different menu item. By touching a menu key to which a menu item ordered by a customer is assigned, the customer can input the item number of that menu item into the handheld terminal 31.
[0051] On the other hand, the touch panel 54 is divided into a display section 541 and a key section 542. The display section 541 displays, for example, the name of a menu item identified by a product number entered by operating the keyboard 55. The key section 542 is provided with a start key for instructing the start of order acceptance, an add key for declaring that the order is an additional order, an end key for instructing the end of order acceptance, and a numeric keypad for entering numerical values such as the order quantity. When taking an order from a customer, the waiter first presses the start key. If the customer is not a new customer but is placing an additional order, the waiter presses the add key. When the customer has finished ordering, the waiter presses the end key. If an order for two or more items of a menu item whose product number has been entered by operating the menu key is received, the order quantity is entered using the numeric keypad after pressing the menu key. The end key is sometimes referred to as, for example, a send key.
[0052] Although not shown in FIG. 6 , the handheld terminal 31 is equipped with a camera 56 (see FIG. 7 ) and a microphone 57 (see FIG. 7 ). The camera 56 is primarily used to read the order slip number printed in the form of a machine-readable code on the order slip. The microphone 57 is primarily used to capture the voice of the waiter taking an order at the customer's table or the voice of the customer placing an order. The camera 56 and the microphone 57 are built into the first body 51 or the second body 52. For example, if the camera 56 is built into the first body 51, the lens of the camera 56 is exposed on the outer surface of the first body 51 opposite the inner surface 511 on which the touch panel 54 is located. For example, if the microphone 57 is built into the second body 52, an audio input port for the microphone 57 is opened in a part of the inner surface 511 on which the keyboard 55 is located. Note that the above-described positions of the exposed lens of the camera 56 and the audio input port for the microphone 57 are merely examples and are not limited to the above positions.
[0053] FIG. 7 is a block diagram showing the main circuit configuration of the handheld terminal 31. The handheld terminal 31 includes a processor 311, a main memory 312, an auxiliary storage device 313, a clock 314, a wireless unit 315, and a system transmission path 316. The system transmission path 316 includes an address bus, a data bus, a control signal line, and the like. The system transmission path 316 connects the processor 311 to other components and transmits data signals exchanged between them. The handheld terminal 31 configures a computer by connecting the processor 311 to the main memory 312, the auxiliary storage device 313, the clock 314, and the wireless unit 315 via the system transmission path 316. The handheld terminal 31 also connects various devices, such as the touch panel 54, keyboard 55, camera 56, and microphone 57 described with reference to FIG. 6, to the system transmission path 316 via signal input / output circuits (not shown). Note that the devices connected to the system transmission path 316 are not limited to the above devices. Other devices, such as a small printer or a small display, may also be connected.
[0054] The processor 311 corresponds to the central part of the computer. The processor 311 controls each part to realize various functions of the handheld terminal 31 in accordance with an operating system or an application program. The processor 311 is, for example, a CPU. The processor 311 is preferably a multi-core processor that includes multiple processor cores and can execute multiple processes in parallel.
[0055] The main memory 312 corresponds to the main storage portion of the computer. The main memory 312 includes a nonvolatile memory area and a volatile memory area. The main memory 312 stores an operating system or application programs in the nonvolatile memory area. The main memory 312 may store data required for the processor 311 to execute processes for controlling each unit in either the nonvolatile or volatile memory area. The main memory 312 uses the volatile memory area as a work area where data is rewritten by the processor 311 as appropriate. The nonvolatile memory area is, for example, ROM. The volatile memory area is, for example, RAM.
[0056] The auxiliary storage device 313 corresponds to the auxiliary storage portion of the computer. For example, an EEPROM, HDD, or SSD can be the auxiliary storage device 313. The auxiliary storage device 313 stores data used by the processor 311 when performing various processes, data created by the processes in the processor 311, etc. The auxiliary storage device 313 may also store the application programs described above.
[0057] The clock 314 keeps track of the date and time. The processor 311 processes the date and time kept by the clock 314 as the current date and time.
[0058] The wireless unit 315 is an interface for wireless data communication with the wireless router 36 .
[0059] In the handy terminal 31 having such a configuration, part of the volatile memory area in the main memory 312 is used as an area for the first table TBa, the second table TBb, and the third table TBc.
[0060] FIG. 8 is a schematic diagram showing the configuration of the first table TBa. As shown in the figure, the first table TBa has a column Ca for product numbers, a column Cb for input item names, a column Cc for points, and a column Cd for price. Column Ca contains the product numbers of menu items input via the operation unit of the handheld terminal 31. Column Cb contains the item names of the menu items identified by the product numbers written in column Ca in the same row. Column Cc contains the ordered number of items for the menu items identified by the product numbers written in column Ca in the same row. Column Cd contains the price calculated by multiplying the price of the menu item identified by the product number written in column Ca in the same row by the ordered number written in column Cc in the same row. In this way, the first table TBa sequentially contains the product number, item name, ordered number, and price as data related to customer orders input by the customer service representative using the handheld terminal 31. The data described in the first table TBa can be rephrased as a list of menu items ordered by customers, a so-called order item list.
[0061] 9 is a schematic diagram showing the configuration of the second table TBb. As shown in the figure, the second table TBb has a column Ce for estimated item names. Column Ce describes the item names of ordered items estimated by the estimation means 61 of the speech recognition server 2, so-called estimated ordered items. In this way, the second table TBb sequentially describes the item names of estimated ordered items each time an ordered item is estimated by the estimation means 61 of the speech recognition server 2. Here, the data described in the second table TBb can be rephrased as a list of ordered items estimated by the estimation means 61, so-called estimated ordered item list.
[0062] 10 is a schematic diagram showing the configuration of the third table TBc. As shown in the figure, the third table TBc has a column Cf of input item names and a column Cg of estimated item names. As will be described in detail later, column Cf describes input item names that exist in the ordered item list but do not exist in the estimated ordered item list. Column Cg describes input item names that exist in the estimated ordered item list but do not exist in the ordered item list.
[0063] Returning to the explanation of Figure 7. The processor 311 of the handy terminal 31 has the functions of an order input means 71 , a voice input means 72 , a creation means 73 , a storage means 74 , a confirmation means 75 , a notification means 76 , a correction means 77 and a confirmation means 78 .
[0064] The order input means 71 has a function of accepting input of data related to menu items ordered by customers. The order input means 71 accepts input of item numbers, order quantities, etc. as data related to menu items ordered by customers. For example, the order input means 71 accepts input of item numbers as data related to menu items by operating the menu keys arranged on the keyboard 55. The order input means 71 accepts input of order quantities as data related to menu items by operating the numeric keypad arranged on the key section 542 of the touch panel 54. Note that if the order quantity is not entered using the numeric keypad, the order input means may set the order quantity of the menu item identified by the item number entered by operating the menu keys to a default value of "1."
[0065] The voice input means 72 has a function of inputting the voice of a customer or a customer. The voice input means 72 inputs the voice of a customer or a customer captured by the microphone 57 provided in the handheld terminal 31. For example, the voice input means 72 inputs the voice of a customer or a customer captured by the microphone 57 within a period from when a start key arranged on the key section 542 of the touch panel 54 is pressed until when an end key is pressed. The voice data input by the voice input means 72 is wirelessly transmitted to the voice recognition server 2 via the wireless unit 315. The wirelessly transmitted voice data is received by the wireless router 36 and transmitted to the voice recognition server 2 via the communication network 37, the gateway 38, and the communication network 4.
[0066] The creation means 73 has a function of creating an ordered item list from order information input by operating an input device. The creation means 73 creates an ordered item list using the first table TBa based on the product number, order quantity, etc. input via the operation unit of the handheld terminal 31. Specifically, each time a product number is input, the creation means 73 obtains the item name and price stored in the menu database DBd in association with that product number. The creation means 73 then calculates the price by multiplying the price obtained from the menu database DBd by the order quantity. The creation means 73 writes the product number, item name, order quantity, and price in the first table TBa to create an ordered item list.
[0067] The storage means 74 has a function of storing a list of estimated ordered items estimated by the estimation means 61 of the speech recognition server 2. As described above, voice data input by the voice input means 72 is transmitted to the speech recognition server 2. In the speech recognition server 2, the estimation means 61 operates to estimate the item name of the ordered item from the input voice. Then, data related to the estimated item name of the ordered item, i.e., data on the estimated ordered item, is transmitted to the handy terminal 31 that is the source of the voice input. The storage means 74 writes and stores the data of the estimated ordered items received from the speech recognition server 2 via the wireless unit 315 in column Ce of the second table TBb.
[0068] The confirmation means 75 has a function of confirming whether the estimated ordered items estimated by the estimation means 61 of the speech recognition server 2 are present in the list of ordered items created by the creation means 73. As described above, the list of estimated ordered items estimated by the estimation means 61 is stored in the second table TBb. Also, the list of ordered items created by the creation means 73 is stored in the first table TBa. The confirmation means 75 compares the list of estimated ordered items stored in the second table TBb, the so-called estimated ordered item list, with the list of ordered items stored in the first table TBa, the so-called ordered item list. Then, the confirmation means 75 confirms whether the estimated ordered items stored in the estimated ordered item list are present in the ordered item list. The confirmation means 75 may also confirm whether the ordered items stored in the ordered item list are present in the estimated ordered item list.
[0069] The notification means 76 is a function that notifies the user when the estimated order-ordered item does not exist in the list of ordered items. If the confirmation by the confirmation means 75 shows that the estimated order-ordered item does not exist in the list of ordered items, the notification means 76 notifies the user that the estimated order-ordered item does not exist in the list of ordered items, for example, by displaying an image on the display unit 541 of the touch panel 54 that notifies the user that the estimated order-ordered item does not exist in the list of ordered items. For example, the notification means 76 notifies the user by comparing a first item that exists in the list of estimated order-ordered items but does not exist in the list of ordered items with a second item that exists in the list of ordered items but does not exist in the list of estimated order-ordered items. The notification means 76 may notify the user that the estimated order-ordered item does not exist in the list of ordered items by sounding a buzzer built into the handheld terminal 31 in addition to displaying the image. Furthermore, if the handheld terminal 31 is equipped with a voice synthesis device, the notification that the estimated order-ordered item does not exist in the list of ordered items may be made by a synthesized voice.
[0070] The correction means 77 has a function that, upon receiving an instruction to add the first item to the list of ordered items in place of the second item, deletes the second item from the list of ordered items and adds the first item to the list of ordered items. For example, the correction means 77 waits for input of a first operator instructing the addition of the first item to the list of ordered items in place of the second item. When this first operator is input, the correction means 77 deletes the product number and item name of the second item from the first table TBa, i.e., the item that exists in the list of ordered items in the first table TBa but does not exist in the list of estimated ordered items in the second table TBb. Then, in place of the product number and item name, the correction means 77 enters the item name and product number of the first item, i.e., the item that exists in the list of estimated ordered items in the second table TBb but does not exist in the list of ordered items in the first table TBa. The correction means 77 also updates the price of the first item by multiplying the price of the first item by the number of items ordered.
[0071] The determining means 78 has a function of determining the ordered item list when all estimated ordered items exist in the ordered item list. That is, when all item names of estimated ordered items stored in the second table TBb exist in column Cb of the first table TBa, the determining means 78 determines the data in the first table TBa as the ordered item list. The determined ordered item list is transmitted to the store station 35 via the wireless unit 315.
[0072] The confirmation means 78 also has a function of confirming the ordered item list when an instruction is received not to make a correction by the correction means 77 in the case where a first item exists in the estimated ordered item list but not in the ordered item list, or a second item exists in the ordered item list but not in the estimated ordered item list, or when a correction is made by the correction means 77. For example, the correction means 77 waits for input of a second operator instructing not to make a correction to add the first item to the ordered item list instead of the second item. When this second operator is input, the confirmation means 78 confirms the data in the first table TBa as the ordered item list. Alternatively, when the data in the first table TBa is corrected by the correction means 77, the confirmation means 78 confirms the data in the first table TBa as the ordered item list. The confirmed ordered item list is transmitted to the store station 35 via the wireless unit 315.
[0073] The functions of the order input means 71, voice input means 72, creation means 73, storage means 74, confirmation means 75, notification means 76, correction means 77, and confirmation means 78 are realized by information processing executed by the processor 311 in accordance with an order receiving program. The order receiving program is a type of application program stored in the main memory 312 or the auxiliary storage device 313. There are no particular limitations on the method for installing the order receiving program in the main memory 312 or the auxiliary storage device 313. The order receiving program can be recorded on a removable recording medium, or can be distributed via communication via a network and installed in the main memory 312 or the auxiliary storage device 313. The form of the recording medium is not important as long as it can store a program and is readable by the device, such as a CD-ROM or memory card.
[0074] [Handheld terminal operation explanation] 11 and 12 are flow charts showing the main information processing procedures executed by the processor 311 of the handy terminal 31 in accordance with the order receiving program. Also, FIGS. 13 and 14 are examples of images displayed on the display unit 541 of the touch panel 54 of the handy terminal 31 during these procedures. FIG. 15 is a sequence diagram of main data signals transmitted and received between the handy terminal 31, the voice recognition server 2, and the store station 35. The main operations of the handy terminal 31 will be explained below with reference to FIGS. 11 to 15. The content and procedures of the information processing described below are merely examples. The content and procedures can be changed as appropriate as long as similar operational effects can be achieved. Images are also merely examples. The layout of the images, the content of the text, etc. can be changed as appropriate.
[0075] First, the customer service representative performs a login operation before using the handheld terminal 31. Then, once the login is approved and the customer service representative's employee code is stored in the memory of the handheld terminal 31, the customer service representative begins serving customers while carrying the handheld terminal 31. When the customer takes an order from a seated customer, the customer service representative first inputs the order using the start key located on the key section 542 of the touch panel 54.
[0076] When the start key is input, processor 311 starts information processing according to the procedure shown in the flowcharts of Figures 11 and 12. Processor 311 performs initialization as ACT1. This initialization clears first table TBa, second table TBb, and third table TBc.
[0077] The customer service representative who inputs the start key confirms whether the customer is a new customer or a customer placing an additional order. If the customer is a new customer, the customer service representative operates the numeric keypad or the like of key unit 542 to input the customer seat number and number of customers. The customer seat number is an arbitrary number assigned to the customer's seat. The number of customers is the number of customers seated at the seat. If the customer is placing an additional order, the customer service representative inputs the additional key and then inputs the slip number of the order slip that has already been issued for that customer. Specifically, the customer service representative inputs the slip number by having camera 56 capture and read the slip number printed in the form of a machine-readable code on the order slip.
[0078] After completing the initialization, processor 311 proceeds to ACT2. In ACT2, processor 311 checks whether an additional key has been pressed. If an additional key has not been pressed and a key has been pressed on the numeric keypad, processor 311 proceeds to ACT3. In ACT3, processor 311 executes a process to input a seat number. That is, processor 311 acquires the number entered on the numeric keypad as the seat number and stores it in the work area of main memory 312. Next, processor 311 executes a process to input the number of guests. That is, processor 311 acquires the number entered on the numeric keypad as the number of guests and stores it in the work area of main memory 312.
[0079] On the other hand, if the add key is entered, processor 311 proceeds from ACT 2 to ACT 5. Processor 311 executes the process of inputting the slip number in ACT 5. Processor 311 analyzes the machine-readable code captured by camera 56 to obtain the slip number of the order slip and stores it in the work area of main memory 312.
[0080] Upon completing the processing of ACT4 or ACT5, the processor 311 proceeds to ACT6. The processor 311 controls the wireless unit 315 to transmit, in ACT6, a command CMa (see FIG. 15) to the speech recognition server 2 to notify the start of speech recognition. This control causes the wireless unit 315 to wirelessly transmit the command CMa. The command CMa is received by the wireless router 36 and transmitted to the speech recognition server 2 via the communication network 37, the gateway 38, and the communication network 4. The command CMa includes a terminal ID that can identify the handheld terminal 31 that sent the command. The terminal ID is unique identification information that is set in advance to individually identify each handheld terminal 31.
[0081] After notifying the start of voice recognition, the processor 311 proceeds to ACT 7. In ACT 7, the processor 311 starts capturing voice input through the microphone 57. As a result, voice data Da (see FIG. 15) captured by the microphone 57 is wirelessly transmitted to the voice recognition server 2 via the wireless unit 315. The voice data Da is received by the wireless router 36 and transmitted to the voice recognition server 2 via the communication network 37, the gateway 38, and the communication network 4.
[0082] Incidentally, upon receiving the command CMa, the voice recognition server 2 starts voice recognition processing based on the estimation means 61. Thereafter, every time voice data Da is received from the handy terminal 31 that is the sender of the command CMa, the voice recognition server 2 recognizes the voice of the voice data Da and estimates the menu item whose order has been accepted by the handy terminal 31, that is, the so-called ordered item. Once the ordered item has been estimated, the voice recognition server 2 operates to respond to the handy terminal 31 that is the sender of the command CMa with data Db (see FIG. 15) indicating the name of the estimated ordered item.
[0083] Now, after inputting the seat number and number of people or the receipt number, the customer service representative asks the customer for the name of the menu item that the customer will order. Then, each time the customer service representative hears a menu item that a customer has ordered, the customer operates keyboard 55 to input the item number of that menu item. At this time, the customer's voice is picked up by microphone 57. Furthermore, when the customer service representative repeats the name of the menu item that the customer has ordered, the voice of the customer service representative is also picked up by microphone 57. In this way, speech recognition server 2 estimates the ordered item from the voice uttered by the customer or the customer service representative. Then, data Db indicating the name of the estimated ordered item is sent back to handheld terminal 31, which is the sender of command CMa.
[0084] Having started voice input, processor 311 proceeds to ACT8. In ACT8, processor 311 checks whether a product number has been input. If a product number has not been input, processor 311 proceeds to ACT9. In ACT9, processor 311 checks whether a response has been received from the voice recognition server 2. If a response has not been received, processor 311 proceeds to ACT10. In ACT10, processor 311 checks whether an operation to complete the order has been performed. If an operation to complete the order has not been performed, processor 311 returns to ACT8. In this way, in ACT8 to ACT10, processor 311 waits for a product number to be input, for a response to be received from the voice recognition server 2, or for an operation to complete the order to be performed.
[0085] In the standby state of ACT8 to ACT10, if the product number of a menu item is entered by operating the keyboard 55, the processor 311 proceeds from ACT8 to ACT11. The processor 311 controls the wireless unit 315 to transmit a menu data request command CMb (see FIG. 15) to the store station 35 in ACT11. This control causes the command CMb to be wirelessly transmitted from the wireless unit 315. The command CMb is received by the wireless router 36 and transmitted to the store station 35 via the communication network 37. The command CMb includes the product number of the entered menu item along with a terminal ID that can identify the handy terminal 31 that sent it.
[0086] The processor 351 of the store station 35 that received the command CMb searches the menu database DBd for the product number included in the command CMb. The processor 351 then obtains menu data Dc (see FIG. 15) such as the item name and price associated with the product number, and operates to return the menu data Dc to the handy terminal 31 that sent the command CMb.
[0087] The processor 311 of the handheld terminal 31 that sent the request command CMb proceeds to ACT12. In ACT12, the processor 311 waits for the menu data Dc to be returned. When the menu data Dc is received from the store station 35 via the wireless unit 315, the processor 311 proceeds to ACT13. In ACT13, the processor 311 stores the order data based on the menu data Dc. That is, the processor 311 writes the input product number in column Ca of the first table TBa, writes the item names included in the menu data Dc in column Cb of the first table TBa, writes the order quantity in column Cc of the first table TBa, and writes the amount calculated by multiplying the price included in the menu data Dc by the order quantity in column Cd of the first table TBa. Note that the order quantity is the number of items entered using the numeric keypad along with the input of the product number, if any; otherwise, it is "1."
[0088] After storing the order data, the processor 311 proceeds to ACT14. In ACT14, the processor 311 displays an order list on the display unit 541 of the touch panel 54. The order list is a list of item names stored in column Cb of the first table TBa. The order list may include points stored in column Cc and amounts stored in column Cd of the first table TBa. It may also include the total of points stored in column Cc and the total of amounts stored in column Cd. After displaying the order list, the processor 311 returns to the standby state of ACT8 to ACT10.
[0089] If a response is received from the speech recognition server 2 during the standby state of ACT8 to ACT10, the processor 311 proceeds to ACT15. The processor 311 writes and stores the estimated item name included in the response in column Ce of the second table TBb in ACT15. Thereafter, the processor 311 returns to the standby state of ACT8 to ACT10.
[0090] In this way, each time a customer service representative inputs the product number of a menu item ordered by a customer into the handheld terminal 31, the order data for that menu item, i.e., the product number, item name, ordered quantity, and price, are stored in the first table TBa of the handheld terminal 31. Furthermore, when a customer service representative receives an order from a customer, the name of the estimated ordered items recognized by the speech recognition server 2 from the speech uttered by the customer or the customer service representative is stored in the second table TBb of the handheld terminal 31. Then, when the customer service representative has finished inputting the menu items ordered by the customer, the customer presses the end key.
[0091] When the end key is pressed in the standby state of ACT8 to ACT10, the processor 311 proceeds to ACT21 in Fig. 12. In ACT21, the processor 311 ends the capture of voice input by the microphone 57. In ACT22, the processor 311 controls the wireless unit 315 to send a command CMc (see Fig. 15) to notify the voice recognition server 2 of the end of voice recognition. By this control, the command CMc is wirelessly transmitted from the wireless unit 315. The command CMc is received by the wireless router 36 and transmitted to the voice recognition server 2 via the communication network 37, the gateway 38, and the communication network 4. The command CMc includes a terminal ID that can identify the handy terminal 31 that is the sender. When the voice recognition server 2 receives the command CMa, it ends the voice recognition process based on the estimation means 61.
[0092] After completing the processing of ACT21 and ACT22, the processor 311 proceeds to ACT23. In ACT23, the processor 311 compares the input item name stored in column Cb of the first table TBa with the estimated item name stored in column Ce of the second table TBb. Then, in ACT24, the processor 311 checks whether the input item name and the estimated item name match. If the input item name and the estimated item name all match, the processor 311 proceeds from ACT24 to ACT31. The processing from ACT31 onwards will be described later.
[0093] On the other hand, if processor 311 detects an item name that exists in the estimated item name but does not exist in the input item name, or if processor 311 detects an item name that exists in the input item name but does not exist in the estimated item name, processor 311 proceeds from ACT24 to ACT25. In ACT25, processor 311 executes a process for storing mismatched data. Specifically, if processor 311 detects an item name that exists in the estimated item name but does not exist in the input item name, processor 311 writes the estimated item name in column Cg of the third table TBc. On the other hand, if processor 311 detects an item name that exists in the input item name but does not exist in the estimated item name, processor 311 writes the input item name in column Cf of the third table TBc.
[0094] Here, the item name described in column Cf of the third table TBc is the name of the second item that exists in the list of ordered items but does not exist in the list of estimated ordered items. The item name described in column Cg of the third table TBc is the name of the first item that exists in the list of estimated ordered items but does not exist in the list of ordered items.
[0095] After completing the process of storing the mismatched data, the processor 311 proceeds to ACT 26. In ACT 26, the processor 311 displays a confirmation screen SCa (see FIG. 13) on the display unit 541 of the touch panel 54.
[0096] FIG. 13 is a schematic diagram showing an example of the display of confirmation screen SCa. As shown in the figure, confirmation screen SCa displays text data for notifying the customer service representative that the order details may be incorrect, along with a "Confirm" button BTa. The "Confirm" button BTa is an operator for notifying processor 311 that the customer service representative has confirmed the text data. After confirming the text data, the customer service representative touches the "Confirm" button BTa. When the "Confirm" button BTa is touched, an input signal for the "Confirm" button BTa is sent from touch panel 54 to processor 311.
[0097] The processor 311 of the handy terminal 31 that has displayed the confirmation screen SCa proceeds to ACT 27. In ACT 27, the processor 311 waits for the confirmation button BTa to be input. When an input signal of the "Confirm" button BTa is received from the touch panel 54, the processor 311 proceeds to ACT 28. In ACT 28, the processor 311 displays the mismatch list screen SCb (see FIG. 14) on the screen of the display unit 541.
[0098] 14 is a schematic diagram showing an example of the display of the mismatch list screen SCb. The mismatch list screen SCb has check boxes CBa and item name areas ARa for the input item names, and check boxes CBb and item name areas ARb for the estimated item names. The mismatch list screen SCb also has a "Edit" button BTb and a "Do not edit" button BTc.
[0099] The item name area ARa displays the input item name stored in column Cf of the third table TBc. The item name area ARb displays the estimated item name stored in column Cg of the third table TBc. If two or more input item names are stored in column Cf of the third table TBc, multiple item name areas ARa are arranged, one for each input item name. Multiple check boxes CBa are displayed corresponding to the multiple item name areas ARa. Similarly, if two or more estimated item names are stored in column Cg of the third table TBc, multiple item name areas ARb are arranged, one for each estimated item name. Multiple check boxes CBb are displayed corresponding to the multiple item name areas ARb.
[0100] The "Modify" button BTb is a first operator for instructing that a first item that exists in the list of estimated ordered items but does not exist in the list of estimated ordered items be added to the list of ordered items, in place of a second item that exists in the list of ordered items but does not exist in the list of estimated ordered items. Specifically, the "Modify" button BTb instructs processor 311 to delete from the first table TBa the input item name displayed in the item name area ARa associated with the checked check box CBa, and to add to the first table TBa the estimated item name displayed in the item name area ARb associated with the checked check box CBb.
[0101] The "Do Not Modify" button BTc is a second operator that instructs not to modify the ordered items list by adding a first item that exists in the estimated ordered items list but does not exist in the ordered items list to the ordered items list, instead of a second item that exists in the ordered items list but does not exist in the estimated ordered items list. Therefore, when the "Do Not Modify" button BTc is pressed, the data in the first table TBa is maintained without modification.
[0102] The processor 311 of the handy terminal 31 that has displayed the mismatch list screen SCb proceeds to ACT 29. In ACT 29, the processor 311 waits for the "Edit" button BTb to be pressed or the "Do not edit" button BTc to be pressed. If the processor 311 detects, via a signal from the touch panel 54, that the "Do not edit" button BTc has been pressed, the processor 311 proceeds to ACT 31.
[0103] In response to this, if processor 311 detects that the "Edit" button BTb has been pressed via a signal from touch panel 54, it proceeds to ACT30. In ACT30, processor 311 executes the order data correction process. That is, processor 311 deletes the input item name for which the check box CBa is checked on mismatch list screen SCb from first table TBa. Then, processor 311 enters the estimated item name for which the check box CBb is checked in place of the input item name. At this time, processor 311 sets the product number stored in column Ca of first table TBa as the product number of the menu data including the estimated item name. The menu data including the estimated item name is acquired from store station 35. Furthermore, processor 311 sets the price stored in column Cd of first table TBa to the price obtained by multiplying the price of the menu data including the estimated item name by the order quantity stored in column Cc. After completing this correction process, processor 311 proceeds to ACT31.
[0104] In this way, if the input item names and estimated item names all match in ACT24, or if the "Do not modify" button BTc is pressed in ACT29, or if the modification process in ACT30 is executed, the processor 311 proceeds to ACT31. In ACT31, the processor 311 finalizes the order list. The order list includes the product number, item name, order quantity, and price stored in columns Ca to Cd of the first table TBa. Furthermore, if an order is received from a new customer, the seat number and number of people are also included in the order list. If an additional order is received from a customer, the slip number is also included in the order list. Furthermore, the employee code stored in the handheld terminal 31 is also included in the order list.
[0105] After finalizing the order list, the processor 311 proceeds to ACT 32. In ACT 32, the processor 311 controls the wireless unit 315 to transmit the order list data Dd (see FIG. 15) to the store station 35. This control causes the order list data Dd to be wirelessly transmitted from the wireless unit 315. The data Dd is received by the wireless router 36 and transmitted to the store station 35 via the communication network 37.
[0106] The processor 351 of the store station 35 that receives the order list data Dd determines whether the order list is for a new customer. If the data Dd does not include a slip number, the processor 351 recognizes it as an order list for a new customer. The processor 351 issues a new slip number. The processor 351 then creates an order data memory MRa that stores the slip number as well as the order date and time, employee code, seat number, number of people, one or more order data, total number of items, total price, and other information obtained from the data Dd.
[0107] On the other hand, if the data Dd contains a slip number and is recognized as a list of additional orders from the customer, the processor 351 retrieves the order data memory MRa that stores the slip number. The processor 351 then adds the order data, including the product number, item name, order quantity, and price, contained in the data Dd to the order data memory MRa. The processor 351 also updates the total number of items and the total price based on the added order data. The processor 351 also controls the printing of the order slip and cooking slip. The processor 351 also updates the display on the kitchen terminal 33.
[0108] Here, the processor 311 of the handy terminal 31 functions as an order input means 71 by executing the processes in ACT8 and ACT11 in cooperation with the keyboard 55. The processor 311 functions as a voice input means 72 by executing the process in ACT7 in cooperation with the microphone 57. The processor 311 functions as a creation means 73 by executing the process in ACT13 in cooperation with the first table TBa. The processor 311 functions as a storage means 74 by executing the process in ACT15 in cooperation with the second table TBb. The processor 311 functions as a confirmation means 75 by executing the processes in ACT23 and ACT24. The processor 311 functions as a notification means 76 by executing the processes in ACT26 to ACT28 in cooperation with the display unit 541 of the touch panel 54. The processor 311 functions as a correction means 77 by executing the processes in ACT29 and ACT30 in cooperation with the touch panel 54. The processor 311 realizes the function of the determination means 78 by executing the process of ACT31.
[0109] [Effects of the order reception system] As described above in detail, in the order receiving system 100 of this embodiment, when a customer service representative carrying a handheld terminal 31 receives an order for a menu item from a customer, the voice uttered by the customer or the customer service representative is picked up by the microphone 57 of the handheld terminal 31, and the voice data Da is transmitted to the voice recognition server 2. Then, voice recognition is performed in the voice recognition server 2, and the name of the menu item presumed to have been uttered by the customer or the customer service representative, i.e., data Db of the presumed item name, is returned to the handheld terminal 31.
[0110] Meanwhile, in the handheld terminal 31, the item name of the menu item specified by the product number entered by the customer service representative using the keyboard 55, that is, the menu data Dc including the input item name, is imported from the store station 35 into the handheld terminal 31. Thus, in the handheld terminal 31, a list of ordered items is stored in the first table TBa, and a list of estimated ordered items is stored in the second table TBb.
[0111] When an end key is entered to end the order, the ordered item list stored in the first table TBa is compared with the estimated ordered item list stored in the second table TBb. If the input item name in the ordered item list exactly matches the estimated item name in the estimated ordered item list, the ordered item list stored in the first table TBa is confirmed as the order list. Order list data Dd is sent from the handy terminal 31 to the store station 35.
[0112] On the other hand, if there is a difference between the input item name in the ordered item list and the estimated item name in the estimated ordered item list, a notification is made that the estimated ordered item does not exist in the list of ordered items. Specifically, a confirmation screen SCa shown in Fig. 13, for example, is displayed on the touch panel 54 of the handy terminal 31. Furthermore, column Cf of the third table TBc stores input item names that exist in the ordered item list but do not exist in the estimated ordered item list. Similarly, column Cg of the third table TBc stores estimated item names that exist in the estimated ordered item list but do not exist in the ordered item list.
[0113] Here, when the customer service representative who has checked the confirmation screen SCa touches the "Confirm" button BTa, the screen on the touch panel 54 transitions to, for example, the mismatch list screen SCb shown in FIG.
[0114] The mismatch list screen SCb in Fig. 14 is an example of a case where the input item name stored in column Cf of the third table TBc is "fried oyster set meal" and the estimated item name stored in column Cg of the third table TBc is "fried horse mackerel set meal." For example, if a customer orders a "fried horse mackerel set meal," but the waiter mishears or makes an operational error and enters the product number of the "fried oyster set meal," the mismatch list screen SCb in Fig. 14 is displayed.
[0115] After checking the mismatch list screen SCb, the customer service representative confirms with the customer whether the ordered item is a "fried horse mackerel set meal" and not a "fried oyster set meal." If the ordered item is a "fried horse mackerel set meal," the customer service representative checks the checkbox CBa corresponding to the input item name "fried oyster set meal" and the checkbox CBb corresponding to the estimated item name "fried horse mackerel set meal," and then touches the "correct" button BTb. By doing so, the input item name "fried oyster set meal" stored in the first table TBa is corrected to the estimated item name "fried horse mackerel set meal." The product number and price associated with the item name "fried horse mackerel set meal" stored in the first table TBa are also corrected to those of the item name "fried horse mackerel set meal."
[0116] If the item ordered by the customer is a "fried oyster set meal," the waiter can simply touch the "do not modify" button BTc.
[0117] As described above, according to this embodiment, even if the customer service representative inputs the wrong menu item number into the handheld terminal 31 due to a mishearing or operation error, the confirmation screen SCa is displayed before the order list is finalized to notify the customer that there may be an error in the order. This gives the customer an opportunity to reconfirm the order with the customer, thereby preventing the customer from placing an order for the wrong menu item at the store station 35. Furthermore, if there is an error in the order, the error can be corrected by a simple operation on the mismatch list screen SCb. This minimizes the chance of incorrect orders being placed without placing a burden on the customer service representative.
[0118] [Other embodiments] While one embodiment of the order receiving system that addresses order errors caused by mishearing or operational errors by store staff has been described above, the embodiment is not limited to this.
[0119] In the above embodiment, the handheld terminal 31 is used to compare the ordered item list with the estimated ordered item list. In another embodiment, the store station 35 may compare the ordered item list with the estimated ordered item list. That is, the store station 35 includes data tables corresponding to the first table TBa and the second table TBb. When the store station 35 receives a notification from the handheld terminal 31 that the end key has been pressed, the processor 351 of the store station 35 performs the comparison described above. If a mismatch is found, the processor 351 instructs the handheld terminal 31 to display a confirmation screen SCa. This configuration can also eliminate order errors caused by mishearing or operational errors by the store clerk. Furthermore, it also has the effect of reducing the processing load on the handheld terminal 31. The comparison may also be performed by a device other than the store station 35, such as the voice recognition server 2 or the management server 1.
[0120] In the above embodiment, an example has been given of a case where the voice of a customer or a customer service representative is captured by the microphone 57 built into the handheld terminal 31. In another embodiment, a microphone may be installed at a customer seat, and the voice captured by this microphone may be output to the voice recognition server 2 for voice recognition. In this case, identification information such as the seat number of the seat where the microphone is installed is added to the voice data transmitted from the microphone. Furthermore, the voice recognition server 2 may output data on estimated order items recognized by voice recognition to the handheld terminal 31 to which the same seat number has been input. According to such an embodiment, a low-cost terminal that does not have a microphone 57 can be used as the handheld terminal 31.
[0121] In the above embodiment, an example has been given in which voice recognition is performed by the voice recognition server 2. The store station 35 or the handy terminal 31 may be provided with a voice recognition function equivalent to that of the voice recognition server 2. By doing so, even if communication over the communication network 4 becomes unavailable, voice recognition technology can be used to eliminate order-taking errors caused by mishearing or operation errors by store clerks.
[0122] In the above embodiment, an example is given of a case where a customer service representative performs a login operation, that is, inputs an employee code and a password, when starting to use the handheld terminal 31. In another embodiment, instead of performing the login operation, the customer service representative may simply input an employee code before taking an order from a customer.
[0123] In the above embodiment, the handheld terminal 31 has been described as an example of an order receiving device. The order receiving device is not limited to the handheld terminal 31. For example, in a restaurant, customer orders may be received using a POS terminal installed at the reception desk. In such a case, the processor of the POS terminal is provided with the functions of order input means 71, voice input means 72, creation means 73, storage means 74, confirmation means 75, notification means 76, correction means 77, and confirmation means 78. In this way, the POS terminal can be used to realize an order receiving device that can eliminate order errors caused by mishearing or operational errors by store staff.
[0124] Although several embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be embodied in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included within the scope of the invention and the scope of the inventions and their equivalents as defined in the claims. [Explanation of symbols]
[0125] 1...Management server, 2...Speech recognition server, 3...Store system, 4...Communication network, 31...Handheld terminal, 32...Slip printer, 33...Kitchen terminal, 34...POS terminal, 35...Store station, 36...Wireless router, 37...Communication network, 38...Gateway, 51...First body, 52...Second body, 53...Fastener, 54...Touch panel, 55...Keyboard, 56...Camera, 57...Microphone, 61...Estimation means, 62...Order management means, 71...Note Sentence input means, 72...voice input means, 73...creation means, 74...storage means, 75...confirmation means, 76...notification means, 77...correction means, 78...confirmation means, APa...voice recognition application, DBa...master menu database, DBb...employee database, DBc...dictionary database, DBd...menu database, MRa...order data memory, SCa...confirmation screen, SCb...mismatch list screen, TBa...first table, TBb...second table, TBC...third table.
Claims
1. a creating means for creating a list of ordered items from order information input by operating an input device; an estimation means for estimating an ordered item from text obtained by recognizing a voice input from a microphone; a confirmation means for confirming whether the estimated order item estimated by the estimation means is present in the list of order items created by the creation means; a notification means for notifying when the estimated ordered item does not exist in the list of ordered items; An order receiving system comprising:
2. a storage means for storing a list of estimated order items estimated by the estimation means; Further comprising:
2. The order receiving system according to claim 1, wherein the notification means compares and notifies a first item that is present in the list of estimated order items but not in the list of ordered items with a second item that is present in the list of ordered items but not in the list of estimated order items.
3. a modifying means for, upon receiving an instruction to add the first item in place of the second item to the list of ordered items, deleting the second item from the list of ordered items and adding the first item to the list of ordered items; 3. The order receiving system according to claim 2, further comprising:
4. a determination means for determining the list of ordered items when all of the estimated ordered items exist in the list of ordered items, or when an instruction not to perform the correction by the correction means is received, or when the correction by the correction means is performed; 4. The order receiving system according to claim 3, further comprising:
5. A microphone for capturing audio; a creating means for creating a list of ordered items from order information input by operating an input device; an acquisition means for acquiring estimated order items estimated from text obtained by recognizing voice captured via a microphone; a confirmation means for confirming whether the estimated ordered item acquired by said acquisition means is present in the list of ordered items created by said creation means; a notification means for notifying when the estimated ordered item does not exist in the list of ordered items; An order receiving device comprising:
6. A computer of an order receiving device equipped with a microphone for capturing voice, a creating means for creating a list of ordered items from order information input by operating an input device; an acquisition means for acquiring estimated order items estimated from text obtained by recognizing speech captured via a microphone; a confirmation means for confirming whether the estimated order item acquired by the acquisition means is present in the list of order items created by the creation means; and a notification means for notifying when the estimated ordered item does not exist in the list of ordered items; A program to function as a
Citation Information
Patent Citations
Method and device for executing preliminarily set operation mode by using voice recognition
JP2014078007A
Input processing device, input processing method and program
JP2014203018A
Order registration device and program
JP2020098434A