Business assistance system

The business support system addresses generative AI's inflexibility in the food and beverage industry by personalizing customer service and order management, enhancing customer experience and operational efficiency while reducing labor requirements.

WO2025164177A1PCT designated stage Publication Date: 2025-08-07FOOD AI LAB INC
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
PCT/JP2024/045778
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2024-01-31
Filing Date
2024-12-24
Publication Date
2025-08-07

AI Technical Summary

Technical Problem

Existing generative AI systems in the food and beverage industry struggle to flexibly respond to customer orders and are ineffective due to improper request routing, leading to inconsistent service and labor challenges, especially in talent acquisition and management.

Method used

A business support system utilizing a server device with a voice response AI function that processes customer voice data, learns customer characteristics, and integrates with a database to provide personalized service, including order management and staff communication, supported by a flexible AI system that can adapt to different languages and customer preferences.

Benefits of technology

Enhances customer experience, supports talent acquisition and training strategies, and improves store management by providing consistent and personalized service across multiple locations, reducing labor needs and improving operational efficiency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure JP2024045778_07082025_PF_FP_ABST
    Figure JP2024045778_07082025_PF_FP_ABST
Patent Text Reader

Abstract

The purpose of the present invention is to support business development by utilizing generative AI for customer experience in a food and drink industry, human resource acquisition, education strategy, and store management. A business assistance system, wherein a server device (1) comprises: a voice generative AI function processing unit (16-1) that acquires voice data emanated from a visitor to a menu screen displayed on a first data terminal (3-1 to 3-N), generates voice data according to language data for establishing a conversation for receiving a cooking order of the visitor, and responds to the first data terminal (3-1 to 3-N); and a registration unit (16-2) that analyzes language data extracted from the voice data generated by the voice generative AI function processing unit (16-1), learns the feature and order history of the visitor, and registers these in a customer database (14).
Need to check novelty before this filing date? Find Prior Art

Description

Business Support System

[0001] The present invention relates to a business support system that uses generative AI to comprehensively support manpower working in the food and beverage industry and provides services that innovatively foster business operations.

[0002] Traditionally, franchised group chains have adopted a system in which customer service, cooking, and accounting are divided into separate roles, providing consistent service.

[0003] On the other hand, individual restaurants provide a service of serving food to customers while performing overlapping tasks such as customer service, cooking, and accounting.

[0004] Meanwhile, with the support of job-hunting sites, the employment environment has become such that it is common for employees who stay with one company to change jobs repeatedly, at least as they advance in their careers.

[0005] For this reason, it is becoming increasingly difficult to secure talented personnel in the food and beverage industry, and coupled with labor shortages and succession issues, there is a need for changes in the working environment.

[0006] Meanwhile, in computer-related technology, generative AI is attracting attention, and some customer service applications that utilize generative AI are being offered in the food and beverage industry.

[0007] The following Patent Document 1 discloses that "to provide a conversational artificial intelligence platform that utilizes elicitation question answering, in various examples, the conversational artificial intelligence (AI) platform uses structured data and unstructured data to generate responses to queries from users. In one example, if data for the response to the query is not stored in a structured data structure, the conversational AI platform searches for this data in an unstructured data structure."

[0008] Furthermore, paragraph 0003 of the following Patent Document 2 discloses that "In addition, a single AI assistant is typically tasked with responding to requests in a variety of different domains, such as, for example, ordering food and drink, setting a timer, disabling an alarm system, playing music, etc. However, because a single AI assistant is responsible for the entire range of possible domains, requests are often sent to the rule set for the wrong domain for the request, thereby resulting in an inappropriate or inaccurate response. Consequently, even if these AI assistants may have a path to the necessary knowledge (e.g., a domain-specific application programming interface (API)), they may prove to be ineffective in certain domains due to, for example, improper routing of requests."

[0009] Japanese Patent Application Laid-Open No. 2023-120130 Special Publication No. 2023-525173

[0010] However, the learning level of generative AI is still immature, and it is often unable to respond flexibly to customers who place orders according to unexpected routines, and improvements are needed. Meanwhile, in the food and beverage industry, there is a growing momentum to introduce and utilize generative AI not only in the field of customer service but also in the fields of talent acquisition and talent development, and the system development field is also in the trial and error stage of figuring out how to incorporate generative AI.

[0011] The present invention has been made to solve the above-mentioned problems, and aims to provide a business support system that can support business development in the food and beverage industry by utilizing AI to improve customer experience, recruit personnel, and develop training strategies, as well as store management.

[0012] The business support system of the present invention for achieving the above object comprises the following configuration.

[0013] The business support system of the present invention is a business support system capable of communicating via a specified communication medium between a first data terminal operated by a customer visiting a restaurant and a server device that supports a customer service approach involving an order on the first data terminal, wherein the server device comprises a voice response AI function processing means that acquires voice data spoken by the customer in response to a menu screen displayed on the first data terminal, generates voice data according to language data for establishing a conversation to accept the customer's food order, and responds to the first data terminal, and a registration means that analyzes the language data extracted from the voice data generated by the voice response AI function processing means, learns the customer's characteristics and order history, and registers the learned data in a database, and the first data terminal comprises a speech means that acquires voice data from the server device and speaks it, and a response means that directly responds to the server device with the voice data spoken by the customer.

[0014] According to the present invention, generative AI can be utilized to support business development in the food and beverage industry in customer experience, talent acquisition, training strategies, and store management.

[0015] The drawings show specific embodiments of the present invention, and include not only essential components of the invention but also optional and preferred embodiments. A block diagram illustrating the configuration of a business support system illustrating this embodiment. A block diagram illustrating the configuration of a server device shown in FIG. 1. (a) is a block diagram illustrating the configuration of first to fourth data terminals connected to the server device shown in FIG. 1, and (b) is a block diagram illustrating the configuration of the main parts shown in (a). A diagram illustrating a hierarchical structure of language data constructed in a database utilized by the speech generation AI function processing unit shown in FIG. 2. A diagram illustrating a hierarchical structure of language data constructed in a database utilized by the speech generation AI function processing unit shown in FIG. 2. A flow chart illustrating an example of an AI customer service processing procedure in the business support system illustrating this embodiment. A flow chart illustrating an example of an AI customer service processing procedure in the business support system illustrating this embodiment. A diagram illustrating features of a user interface displayed in the business support system illustrating this embodiment. A diagram illustrating features of a user interface displayed in the business support system illustrating this embodiment. A diagram illustrating features of a user interface displayed in the business support system illustrating this embodiment. A diagram illustrating features of a user interface displayed in the business support system illustrating this embodiment. A diagram for explaining features of a user interface displayed in the business support system according to the present embodiment. A diagram for explaining features of a user interface displayed in the business support system according to the present embodiment. A diagram for explaining features of a user interface displayed in the business support system according to the present embodiment.

[0016] Next, the best mode for carrying out the present invention will be described with reference to the drawings.

[0017] 1 is a block diagram illustrating the configuration of a business support system according to this embodiment. In this embodiment, a business support system is shown in which a plurality of first data terminals 3-1 to 3-N operated by customers seated at tables in a restaurant where food is served, a third data terminal 5-1 to 5-N operated by a chef to purchase ingredients, a plurality of second data terminals 4-1 to 4-N operated by kitchen staff, a fourth data terminal 2-1 to 2-N linked to a POS system, and a server device 1 providing a platform 1A can communicate with each other via a predetermined communication medium.

[0018] In Figure 1, multiple first data terminals 3-1 to 3-N, third data terminals 5-1 to 5-N operated by chefs to purchase ingredients, multiple second data terminals 4-1 to 4-N operated by kitchen staff in the kitchen, and fourth data terminals 2-1 to 2-N linked to the POS system are equipped with the hardware resources and software resources shown in Figure 2, and each executes its own unique data processing according to the procedure shown in the flowchart described below.

[0019] FIG. 2 is a block diagram for explaining the configuration of the server device 1 shown in FIG. 1, and the same components as those in FIG. 1 are assigned the same reference numerals.

[0020] In FIG. 2, reference numeral 11 denotes a communication unit which connects and controls communication between first data terminals 3-1 to 3-N, second data terminals 4-1 to 4-N, third data terminals 5-1 to 5-N, and fourth data terminals 2-1 to 2-N which are connected to a network 21 as a communication medium.

[0021] A CPU 13 starts an operating system (OS) stored in an external memory 18 connected to the internal bus 12, and starts various applications installed via an API. It also executes the processing of various programs deployed on the RAM 16.

[0022] A keyboard 15 is used to input numerical values, text, and icon instructions for an application that is running.

[0023] Reference numeral 16 denotes an expandable RAM, which expands and stores the basic program of the platform 1A installed in the external memory 18. Reference numeral 17 denotes a display, which displays the program running status via various UI screens (not shown).

[0024] The voice generation AI function processing unit 16-1 acquires voice data uttered by customers in response to the menu screen displayed on the first data terminal 3-1 to 3-N, generates voice data according to language data for establishing a conversation to accept the customer's food order, and executes processing to respond to the first data terminal 3-1 to 3-N.

[0025] In addition, the voice generation AI function processing unit 16-1 is also configured to be able to perform a process of searching the order history stored in the customer database 14 from the characteristics of the language data extracted from the voice data and generating voice data that presents individual menus.

[0026] Furthermore, the voice generation AI function processing unit 16-1 is configured to be able to execute a process of referring to the latest material purchasing information stored in a purchasing database (not shown), searching the order history stored in the customer database 14 from the characteristics of the language data extracted from the voice data, and generating voice data that presents new menu items.

[0027] In addition, the voice generation AI function processing unit 16-1 is equipped with multiple voice response AI functions with different customer service attributes according to the needs of the restaurant, and customers can specify a specific language to be used for the voice response in order to decide what to order from the menu displayed on the menu screen displayed on the first data terminal 3-1 to 3-N.

[0028] Furthermore, the voice generation AI function processing unit 16-1 executes a function process to generate voice data based on a predetermined language for hearing the number of customers, their nationality, their hunger level, and their mood that day.

[0029] Here, the specified language used by the voice generation AI function processing unit 16-1 corresponds to multiple languages ​​and is equipped with translation dictionaries for each language, and is compatible with not only Japanese but also major languages ​​of the world (including English, French, Russian, German, Spanish, Italian, Chinese, Korean, etc.), and is configured to be able to flexibly accommodate other languages ​​by configuring the language dictionary used to be expandable.

[0030] In addition, in order to flexibly respond to the customer service requests made by the store as the server device 1, the voice generation AI function processing unit 16-1 is configured so that the store can select one from multiple voice generation AI function processing units 16-1 or switch between multiple voice generation AI function processing units 16-1.

[0031] The registration unit 16-2 analyzes the voice data generated by the voice generation AI function processing unit 16-1 and the language data extracted from the voice data uttered by customers entering the store, learns the characteristics and order history of customers, and registers them in the customer database 14.

[0032] Here, the registration unit 16-2 executes a process of registering information (gender, nationality, taste preferences, average customer spending, number of visits, number of customers) relating to the customers operating the first data terminals 3-1 to 3-N in the customer database 14.

[0033] The identification unit 16-3 analyzes the voice data uploaded from each of the first data terminals 3-1 to 3-N via the network 21 and performs a process to identify the customer's preferences for food orders (for example, in the case of a Chinese restaurant, this includes Sichuan cuisine, meat dishes, soups, fish dishes, etc.).

[0034] The notification unit 16-4 executes a process of relaying, via the network 21, a cooking video delivered from the kitchen for the ordered dish to any of the first data terminals 3-1 to 3-N operated by the customer identified by the identification unit 16-3.

[0035] The issuing unit 16-5 executes a process of issuing a statement of account via the network 21 to any one of the first data terminals 3-1 to 3-N operated by the customer.

[0036] The linking unit 16-6 executes a process for managing sales in real time in API linkage with the fourth data terminals 2-1 to 2-N related to the POS system. Note that sales, number of customers, average customer price, etc., adjusted to the current time conform to the POS system, so details will not be explained here.

[0037] Reference numeral 19 denotes a generation AI unit, which refers to a language database (not shown) and executes a process of generating language data in real time for establishing a conversation with a customer when placing an order. Note that whether the generation AI unit 19 uses an existing generation AI system or an independently developed generation AI system is a design decision.

[0038] In addition, the generation AI unit 19 is configured to be able to generate language data for inquiring about the number of customers, their nationality, how hungry they are, and their mood that day.

[0039] The server device 1 is configured to be able to execute a process of transferring the menu determined by the first data terminals 3-1 to 3-N to the kitchen devices operated by the kitchen staff.

[0040] In addition, the server device 1 executes a process of transferring order information including the name of the dish, the number of people, and the cooking method to the second data terminals 4-1 to 4-N operated by the kitchen staff, in accordance with the menu determined by the voice generation AI function processing unit 16-1.

[0041] Furthermore, the first data terminals 3-1 to 3-N are configured to be able to change the frequency, tone and speed of the voice emitted according to a character selected from a group of multiple characters to suit a customer seated at a chair at a table.

[0042] Furthermore, the server device 1 has a kitchen camera (live camera) installed in a kitchen (not shown) and performs a process of relaying cooking videos captured by the kitchen camera along with progress information on the ordered dishes to the first data terminals 3-1 to 3-N.

[0043] Figure 3 is a block diagram illustrating the configuration of the first data terminals 3-1 to 3-N, second data terminals 4-1 to 4-N, third data terminals 5-1 to 5-N, and fourth data terminals 2-1 to 2-N connected to the server device 1 shown in Figure 1. Note that the first data terminals 3-1 to 3-N are assumed to be pad devices or the like.

[0044] 3A, a CPU 301 executes various applications by loading an OS and control programs stored in a ROM 302 into a RAM 303 and executing them. Various information is input and icons displayed on a user interface screen (UI screen) are clicked directly on a display 311. A communication unit 304 controls communication for connecting to a server device 1 connected to a network 21.

[0045] In the RAM 303 shown in FIG. 3B, 303-1 is a menu processing unit that is configured to obtain the latest menu (today's recommended menu) from the platform 1A via the network 21 and display it on the display 311.

[0046] An upload unit 303-2 executes a process of uploading order information, either as voice or as menu selections made by customers seated at tables, to the platform 1 A. It should be noted that the first data terminals 3-1 to 3-N are each equipped with a microphone for voice input.

[0047] Reference numeral 303-3 denotes a UI control unit, which executes control to display on the display 311 a UI screen (FIG. 7 and subsequent drawings, which will be described later) presented by the platform 1A provided by the server device 1 shown in FIG.

[0048] 303-4 is a voice processing unit that performs a voice output function that acquires generated language data from the server device 1 and outputs it to a customer seated at a table, and a response function that directly responds to the server device 1 with the voice data output by the customer.

[0049] 4 and 5 are diagrams showing the hierarchical structure of language data constructed in the customer database 14 used by the speech generation AI function processing unit 16-1 shown in FIG. 2. Note that this example is merely an example, and is configured to be able to incorporate combinable language data strings. Furthermore, when this system is applied to an industry other than the food and beverage industry, a different hierarchical structure of language data will naturally be adopted.

[0050] The first layer contains customer, staff, store information, and conversation metadata. In the first layer, customer information, customer ID, nationality, language, number of visits, favorite food category, and allergy information, character strings are stored for all but the customer ID and number of visits, and integers are assigned to the customer ID and number of visits.

[0051] The second layer stores information associated with orders, recommendation systems, tables, and customer preferences, focusing on handling customer orders from the first layer.

[0052] Specifically, the order layer is assigned an order ID, a customer ID, a date and time, order details, an order status, and whether or not there is an additional order.

[0053] Similarly, a recommendation system is assigned a recommendation ID, a customer ID, a list of recommended dishes, and a reason for recommendation.

[0054] Similarly, a table ID, the number of seats, the reservation status, and the customer ID are assigned to each table.

[0055] Similarly, customer preferences are assigned customer ID, favorite flavors, inedible ingredients, favorite meal type, dietary restrictions, favorite dishes and ingredients. Furthermore, the third layer is assigned to the order layer, with dishes and billing information.

[0056] Here, dishes are assigned a dish ID, dish name, price, category, allergy information, and recommended occasion. Furthermore, transaction information is assigned a transaction ID, order ID, customer ID, total amount, and payment status. Furthermore, the fourth layer is assigned dish characteristics, including the dish ID, main ingredients, flavor characteristics, calories, recommended occasion, and seasonality.

[0057] Meanwhile, staff members in the first layer are assigned a staff ID, name, role, and schedule. Similarly, store information in the first layer is assigned a store ID, store name, opening date, business hours, address, phone number, menu information, and course reservation options.

[0058] In addition, the first layer of store information is assigned menu information in the second layer, and menu ID, dish ID, course name, course details, course price, and available time slot are assigned.

[0059] The first layer of dialogue metadata includes a dialogue ID, a category, keywords and phrases, sentiment analysis results for the dialogue, and whether or not a response was required.

[0060] Furthermore, the dialogue metadata in the first layer is assigned a feedback log in the second layer, and the feedback log is assigned a feedback ID, dialogue ID, customer ID, date and time, feedback content, and items requiring improvement.

[0061] This allows the generation AI unit 19 and the voice generation AI function processing unit 16-1 to work together to store and manage in the customer database 14 detailed order information, staff member in charge, and dialogue logs for each customer across the board, and language data to be referenced at the appropriate level.

[0062] The generation AI unit 19 periodically browses the customer information, order information, etc., stored in each layer of the customer database 14, and responds optimally to the customer, allowing the customer to enjoy their meal while experiencing the sense of security of being served by a concierge.

[0063] When a regular customer visits a store because the person in charge of serving the regular customer is on vacation or has been promoted, the customer's impression will be lowered by an unfamiliar response, but with this system, by sharing the customer database 14 even among store chains, it becomes possible to support appropriate and natural customer service no matter which store the regular customer visits.

[0064] 6 and 7 are flowcharts showing an example of an AI customer service processing procedure in the business support system according to this embodiment. Note that the drawings are shown as separate diagrams due to size limitations, but the numbers at the branch points shown in FIGS. 6 and 7 are assumed to be interconnected.

[0065] Below, we will explain an example of a customer service response assuming a situation where the voice generation AI function processing unit 16-1 generates and issues voice data after a customer visits a restaurant. Note that in the following explanation, the functions of the voice generation AI function processing unit 16-1 may be collectively referred to as Luna.

[0066] The combination of staff members who interact with customers and the devices they use is Luna (API-linked with the server device 1 shown in Figure 1), hall staff, kitchen tablet (data terminal), kitchen staff, and POS system (data terminal).

[0067] When a customer arrives at the store, they sit at an available table and press the call button (which also functions as a start button), and are notified that Luna has called them.

[0068] It is assumed that a corresponding message is displayed on the display 311 of the first data terminal 3-1 to 3-N, requesting the customer to talk to Luna.

[0069] Next, Luna acquires the language data generated by the generation AI unit 19 from the server device 1 and uses the speech processing unit 303-4 to greet the customer through a speaker unit (not shown), such as a message like "Welcome, thank you for your continued patronage." Furthermore, when Luna inquires about the number of customers, their nationalities, how hungry they are, and how they are feeling that day, the speech data in which the customers respond is converted into language data.

[0070] Next, the server device 1 identifies the customer ID stored in the customer database 14, browses the customer's eating and drinking history in the hierarchical information shown in Figures 4 and 5, generates today's recommended lineup as language data, transfers it to the first data terminals 3-1 to 3-N, and displays it on the display 311. The first data terminals 3-1 to 3-N then accept that the customer has selected an order from the lineup presented on the display 311.

[0071] Here, Luna checks whether there is any missing information before finalizing the order to be transmitted to the kitchen staff. For example, when a spinach salad is ordered, whether the sauce is French-based or Italian-based is not stored in the customer database 14.

[0072] Next, if Luna determines that there are no additional orders from the customer, it transmits the customer's order from the first data terminal 3-1 to 3-N to the second data terminal 4-1 to 4-N corresponding to the kitchen tablet. The order entry form to be transmitted is configured so that each store can freely lay it out.

[0073] Once the order is confirmed, Luna transmits the unit price and order quantity of the ordered dishes to the fourth data terminals 2-1 to 2-N linked to the POS system in order to prepare a statement to be billed when the meal is completed.

[0074] The wait staff checks the payment screen displayed on the display 311 of the second data terminal 4-1 to 4-N corresponding to the kitchen tablet to ensure that there are no discrepancies between the contents of the dish ordered by the customer and the order information calculated by the POS system.

[0075] After that, the wait staff receives the cooking progress information from the kitchen staff and begins preparing to serve the plated food. Note that if the serving itself is performed by an in-store robot capable of processing the generation AI unit 19, the progress information is shared and managed with the robot.

[0076] The food is then delivered by the wait staff to the tables where the customers are seated.

[0077] Here, Luna introduces the customer to information (linguistic information and audio information) about the store's history, new staff members, and the head chef, and checks whether the customer would like to place an additional order.

[0078] After that, when Luna receives a check request from the customer, it retrieves the accounting data already created by the POS system, displays the total amount, tax, and service charge on display 311, and confirms whether the customer wants to pay electronically or in cash, after which the payment process is carried out via the POS system.

[0079] The wait staff then hands the customer the receipt issued by the POS system and the credit card payment sheet, completing the entire food and beverage service.

[0080] Effect of First Embodiment According to this embodiment, the generation AI unit 19 can be utilized to support business development in the food and beverage industry in customer experience, human resource acquisition, training strategies, and store management.

[0081] Second Embodiment In the above embodiment, a system has been described in which staff are always present to serve food. However, a system in which a food serving robot moves between the kitchen and the tables may be configured to organically cooperate with the system.

[0082] Effect of Second Embodiment According to this embodiment, a flexible service support system can be established even when the digital transformation of stores progresses and a service format in which stores are run with a minimum number of staff is used.

[0083] [Third embodiment] In the above embodiment, it is not possible to check the kitchen staff or the cooking status, but the kitchen may be configured to include a kitchen camera and a distribution unit that relays cooking videos captured by the kitchen camera along with information on the progress of the ordered food to the first data terminals 3-1 to 3-N.

[0084] [Effects of the Third Embodiment] According to this embodiment, it is possible to provide customers waiting at their tables with a visual update on the progress of their ordered dishes in real time, providing a sense of realism that may encourage further customer orders.

[0085] 8 to 14 are diagrams illustrating the features of the user interface displayed in the business support system according to the present embodiment. Note that while this example uses Luna as an example, other voice response AIs may also be used.

[0086] When a family (for example, a group of four) comes to a restaurant and sits down at an available table, the speech generation AI function processing unit 16-1 responds via a speaker (not shown) on the first data terminals 3-1 to 3-N that can be operated on the table, saying, for example, "Welcome" or "Thank you for coming to our restaurant today" in Japanese.

[0087] In response to this, when one of the customers responds by voice to the first data terminal 3-1 to 3-N, the voice response AI will serve the customer from a series of menu displays, to ordering food, transmitting the order to the kitchen, the progress of the food from the kitchen, and handling the payment, and the following UI screen will be displayed on the first data terminal 3-1 to 3-N.

[0088] [UI screen upon arrival] When a customer arrives at a store, they sit at an empty table, and one of the first data terminals 3-1 to 3-N is placed on the table in an operable state or is propped up against a support that displays the screen at a predetermined inclination. The following description will be given assuming that the customer is operating one of the first data terminals 3-1 to 3-N.

[0089] When a customer first comes to the store, the UI screen shown in FIG. 8 is displayed on the display 311 of the first data terminal 3-1 to 3-N.

[0090] Here, the customer confirms the number of people seated, for example, "4," by pressing the "-" key and / or the "+" key.

[0091] However, it may be configured so that when you tap these messages, Luna speaks them in Japanese.

[0092] Next, the language to be used by the speech generation AI function processing unit 16-1 is selected. Here, Japanese, English, Chinese, and Korean are selectable as examples of languages. Japanese is currently selected.

[0093] Next, when a customer who visits the store presses the start button displayed on the display 311, the UI control unit 303-3 shown in Fig. 3 is activated, and the UI screen on the display 311 changes to the screen shown in Fig. 9. Luna, which functions as the voice generation AI function processing unit 16-1, speaks a message, for example, "Welcome. We have a great selection of ingredients today, so please feel free to ask us a question" in Japanese.

[0094] The first data terminals 3-1 to 3-N are each equipped with a speaker (not shown) and configured to output by voice the message received by the voice processing unit 303-4 from the server device 1. The display 311 also displays an operation method for the customer operating the first data terminal 3-1 to 3-N to communicate with Luna.

[0095] For example, messages such as "Tap the microphone button once to talk!!", "Select the order quantity from the right menu, or say the product number + order quantity", "Confirm the order details and tap 'Confirm order' to confirm", and "Ask us anything else and we'll answer!!" are displayed on the screen.

[0096] 9, a character image symbolizing Luna is displayed on the display 311. Details of the character image symbolizing Luna will be omitted.

[0097] Additionally, next to Luna on the display 311, an icon for voice input and an operation message (push the icon in the red circle to start a conversation) are displayed.

[0098] Furthermore, the message input line on the display 311 displays text that Luna has interpreted and confirmed based on the voice data uttered by the customer.

[0099] [Order Processing] Next, a case will be described in which a customer inputs a menu and voice commands to Luna running on the first data terminal 3-1 to 3-N.

[0100] First, the UI control unit 303-3 displays the UI screen shown in Fig. 10 on the display 311. Here, the menu selection items include, for example, "Recommended," "Quick Delivery," "First Try," "Excellent," "Pizza, Pasta, Gratin," "Salad," "Tempura," "Noodles and Rice," "Meat," "Fried Food," "Western A-la-Carte," "Sushi," "Western Deep Fried Food," and "Dessert."

[0101] As described above, customers input the dishes they want to eat by voice, as if they were talking to the display 311. Note that the UI screen shown in Fig. 10 displays recommended tempura, seared cod roe, shrimp ajillo, and clam soup, but these are merely examples of the izakaya menu.

[0102] When the customer taps the "Confirm Order Details" button on the UI screen shown in FIG. 10, the UI control unit 303-3 displays the UI screen shown in FIG. 11 for confirming the contents of interest on the display 311.

[0103] In this example, a customer orders three pieces of pickled ginger tempura and a tempura platter (serves 1-2). After checking the order details displayed on the display 311, the customer presses the button to confirm the order or the order history / checkout button. The UI control unit 303-3 then displays the UI screen shown in Figure 12 on the display 311 for confirming the order details.

[0104] In the UI screen shown in FIG. 12, tabs such as Prompt, Menu, Category, and Message are arranged as a HOME menu, and a Logout tab is also arranged for ending the operation.

[0105] In addition, the screen configuration shown in FIG. 12 is configured to separately display ongoing orders that are being cooked in the kitchen for each table, corresponding to multiple tables, and completed orders that have already been served to the tables, as in the UI screen shown in FIG. 13.

[0106] Next, when the customer presses the checkout button displayed on the display 311 for the completed order shown in Figure 13, the UI control unit 303-3 displays a UI screen on the display 311 for confirming the order details shown in Figure 14.

[0107] The UI screen shown in Fig. 14 corresponds to a situation where, for example, the table number is 7 (table7), the number of customers is 4, and a total bill of 3,681 yen is being billed. The UI screen shown in Fig. 14 has a back button and a checkout completion button for completing the checkout, and the customer presses the checkout completion button to pay the displayed bill amount.

[0108] The store accepts multiple payment methods, including electronic money, credit cards, and points. For cash payments, the store may also be configured to offer a separate service that awards bonus points to customers via their smartphones.

[0109] In addition, a dome camera may be installed in the kitchen to relay the progress of the dishes ordered by customers to the first data terminals 3-1 to 3-N as video, thereby providing customers with a sense of excitement.

[0110] Effect of the Fourth Embodiment According to this embodiment, Luna, which executes the functions of the voice generation AI function processing unit 16-1, supports the hospitality of customers by coordinating with a series of routines related to customer service, order taking, and accounting for the food provided by the store, thereby making it possible to support store management and customer management operations at low cost without constantly having to secure personnel for the sales promotion function to secure repeat customers.

[0111] Fifth Embodiment In order to prevent hallucination, which is a phenomenon in which an artificial intelligence confidently gives an answer that cannot be justified from the voice data it has learned, when the generation AI unit 19 generates voice data on the external memory 18, the voice generation AI function processing unit 16-1 shown in FIG. 2 may be configured to store a voice data dictionary to prevent the generation of arbitrary syllables.

[0112] Figure 15 is a diagram explaining the features of the user interface displayed in the business support system according to this embodiment, and is an example of a UI screen that allows the administrator of the server device 1 to store the correspondence between conversion words and their pronunciations (hiragana) in the external memory 18.

[0113] This prevents the voice generation AI function processing unit 16-1 from accidentally generating voice data that could be misunderstood as Lunacy, Lucy, Lunachan, etc. when responding to customers who visit the store and the name should be Luna.

[0114] [Effects of the Fifth Embodiment] According to this embodiment, it is possible to reduce the incidence of hallucination in the learning function of the voice generation AI in an environment where it is difficult to hear the voices spoken by customers at the store.

[0115] The present invention can also be realized by a process in which a program that realizes one or more of the functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in the computer of the system or device read and execute the program.The present invention can also be realized by a circuit (e.g., an ASIC) that realizes one or more of the functions.

[0116] The disclosure of the present invention described above can be summarized at least as follows.

[0117] (1) A business support system capable of communicating via a specified communication medium between a first data terminal operated by a customer visiting a restaurant and a server device that supports a customer service approach involving an order on the first data terminal, wherein the server device comprises: a voice response AI function processing means that acquires voice data uttered by the customer in response to a menu screen displayed on the first data terminal, generates voice data according to language data for establishing a conversation to accept the customer's food order, and responds to the first data terminal; and a registration means that analyzes the language data extracted from the voice data generated by the voice response AI function processing means, learns the customer's characteristics and order history, and registers the learned data in a database; and the first data terminal comprises: a speech generation means that acquires voice data from the server device and speaks it, and a response means that directly responds to the server device with the voice data spoken by the customer.

[0118] (2) The server device is characterized in that the voice response AI function processing means has a plurality of voice response AI functions with different customer service attributes according to the needs of the restaurant, and the first data terminal has a designation function for designating one of the voice response AI functions to execute the voice response AI function processing service to be provided to the restaurant.

[0119] (3) The voice response AI function processing means is characterized in that it searches the order history stored in the customer database from the characteristics of the voice data obtained from the first data terminal and generates language data that presents individual menus.

[0120] (4) The voice response AI function processing means is characterized in that it refers to the latest material purchasing information stored in the purchasing database, searches the customer's order history stored in the customer database from features extracted from the voice data, and generates voice data that presents alternative menu items.

[0121] (5) The voice response AI function processing means is characterized in that it refers to the latest material purchasing information stored in the purchasing database, searches the order history stored in the customer database from the characteristics of the voice data extracted from the voice data, and generates voice data that presents new menu items.

[0122] (6) The system is characterized by including a linking means for linking the payment of the menu determined by the voice response AI function processing means with a POS system.

[0123] (7) The server device is characterized by having a transfer means for transferring order information including the name of the dish, the number of people, and the cooking method to a second data terminal operated by kitchen staff in accordance with the menu determined by the voice response AI function processing means.

[0124] (8) The voice response AI function processing means is characterized by generating voice data based on a predetermined language to ask about the number of customers, their nationalities, their level of hunger, and their mood today.

[0125] (9) The predetermined language corresponds to a plurality of languages, and a translation dictionary for each language is provided.

[0126] (10) The first data terminal is characterized in that it is possible to change the frequency, tone and speed of the voice emitted according to a character selected from a group of multiple characters to suit the customer.

[0127] (11) A second data terminal operated by kitchen staff is communicatively connected to the server device via the specified communication medium, the second data terminal is equipped with a kitchen camera, and the server device is equipped with a distribution means for relaying and distributing cooking videos captured by the kitchen camera to the first data terminal along with progress information on the ordered food.

[0128] (12) The first data terminal is characterized in that it has a designation means for designating the type of language to be used, and responds to the server device with the voice data together with a language code corresponding to the type of language designated by the designation means.

[0129] 1 Server device 1A Platform 2-1 to 2-N Fourth data terminal 3-1 to 3-N First data terminal 4-1 to 4-N Second data terminal 5-1 to 5-N Third data terminal

Claims

1. A business support system capable of communication via a specified communication medium between a first data terminal operated by a customer visiting a restaurant and a server device that supports a customer service approach involving placing an order on the first data terminal, wherein the server device comprises: a voice response AI function processing means that acquires voice data spoken by the customer in response to a menu screen displayed on the first data terminal, generates voice data in accordance with language data for establishing a conversation to accept the customer's food order, and responds to the first data terminal; and a registration means that analyzes the language data extracted from the voice data generated by the voice response AI function processing means, learns the customer's characteristics and order history, and registers the learned data in a database; and the first data terminal comprises: a speech generation means that acquires voice data from the server device and speaks it, and a response means that directly responds to the server device with the voice data spoken by the customer.

2. The business support system described in claim 1, characterized in that: the server device, the voice response AI function processing means has a plurality of voice response AI functions with different customer service attributes according to the requests of the restaurant; and the first data terminal has a designation function for designating one of the voice response AI functions in order to execute the voice response AI function processing service to be provided to the restaurant.

3. The business support system described in claim 1, characterized in that the voice response AI function processing means searches the order history stored in the customer database from the characteristics of the voice data obtained from the first data terminal and generates language data to present individual menus.

4. The business support system described in claim 1, characterized in that the voice response AI function processing means refers to the latest material purchasing information stored in the purchasing database, searches the customer's order history stored in the customer database from features extracted from the voice data, and generates voice data that presents alternative menu items.

5. The business support system described in claim 1, characterized in that the voice response AI function processing means refers to the latest material purchasing information stored in the purchasing database, searches the order history accumulated in the customer database from the characteristics of the voice data extracted from the voice data, and generates voice data that presents new menu items.

6. The business support system according to claim 1, further comprising a linking means for linking the payment of the menu determined by the voice response AI function processing means with a POS system.

7. The business support system described in claim 1, characterized in that the server device is equipped with a transfer means for transferring order information including the name of the dish, the number of people, and the cooking method to a second data terminal operated by kitchen staff in accordance with the menu determined by the voice response AI function processing means.

8. The business support system described in claim 1, characterized in that the voice response AI function processing means generates voice data based on a specified language to inquire about the number of customers, their nationality, hunger level, and their mood that day.

9. The business support system according to claim 8, characterized in that the predetermined language corresponds to a plurality of languages, and a translation dictionary for each language is provided.

10. The business support system described in claim 1, characterized in that the first data terminal is capable of varying the voice frequency, tone, and speed emitted according to a character selected from a group of multiple characters to suit the customer.

11. The business support system described in claim 1, characterized in that a second data terminal operated by kitchen staff is communicatively connected to the server device via the specified communication medium, the second data terminal is equipped with a kitchen camera, and the server device is equipped with a distribution means for relaying cooking videos captured by the kitchen camera to the first data terminal along with progress information on the ordered food.

12. The business support system according to claim 1, characterized in that the first data terminal is provided with a designation means for designating the type of language to be used, and responds to the server device with the voice data together with a language code corresponding to the type of language designated by the designation means.

Citation Information

Patent Citations

  • Order receiving device and order receiving method for restaurant

    JP2005182140A

  • Dish order support system

    JP2005250766A

  • Order processing system

    JP2007004282A

  • Voice translating device, voice translating method, and voice translating program

    JP2017182310A

  • Server, electronic apparatus, control device, control method and program for electronic apparatus

    JP2019101667A