Business Support System

The business support system addresses generative AI's limitations by integrating voice response AI for flexible customer interactions and seamless order processing, enhancing customer experience and store management in the food and beverage industry.

JP7792713B2Active Publication Date: 2025-12-26FOOD AI LAB INC
View PDF 9 Cites 0 Cited by

Patent Information

Application Number
JP2024012503
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2024-01-31
Publication Date
2025-12-26
Estimated Expiration
2044-01-31

AI Technical Summary

Technical Problem

Generative AI in the food and beverage industry faces challenges in flexibility and effectiveness, particularly in responding to unexpected customer orders, and there is a need for improved systems to support business development in customer experience, talent acquisition, and store management.

Method used

A business support system utilizing generative AI that includes a voice response AI function processing means to acquire and generate voice data for customer interactions, analyze customer preferences, and integrate with POS systems for seamless order processing and management.

Benefits of technology

Enhances customer experience, supports talent acquisition and store management by providing flexible and accurate responses, reducing personnel requirements, and improving operational efficiency in food and beverage establishments.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007792713000001
    Figure 0007792713000001
  • Figure 0007792713000002
    Figure 0007792713000002
  • Figure 0007792713000003
    Figure 0007792713000003
Patent Text Reader

Abstract

To support business development by utilizing generative AI for customer experience, talent acquisition, training strategies, and store management in the food service industry.SOLUTION: In a business support system, a server device 1 comprises: a voice generative AI function processing unit 16-1 that acquires voice data issued by a customer to a menu screen displayed on first data terminals 3-1 to 3-N, generates voice data according to language data for establishing a conversation to receive the customer's food order, and responds to the first data terminals 3-1 to 3-N; and a registration unit 16-2 that analyzes the language data extracted from the voice data generated by the voice generative AI function processing unit 16-1, learns customer characteristics and order history, and registers them in a customer database 14.SELECTED DRAWING: Figure 2
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present invention relates to a business support system that uses generative AI to provide comprehensive support to manpower working in the food and beverage industry, thereby providing services that innovatively foster business operations. [Background technology]

[0002] Traditionally, franchised group chains have adopted a system in which customer service, cooking, and accounting are divided into separate roles, providing consistent service.

[0003] On the other hand, individual restaurants provide a service of serving food to customers while performing overlapping tasks such as customer service, cooking, and accounting.

[0004] Meanwhile, with the support of job-hunting sites, the employment environment has become such that it is common for employees who stay with one company to change jobs repeatedly, at least as they advance in their careers.

[0005] For this reason, it is becoming increasingly difficult to secure talented personnel in the food and beverage industry, and coupled with labor shortages and succession issues, there is a need for changes in the working environment.

[0006] Meanwhile, in computer-related technology, generative AI is attracting attention, and some customer service applications that utilize generative AI are being offered in the food and beverage industry.

[0007] The following Patent Document 1 discloses that "To provide a conversational artificial intelligence platform that utilizes elicitation question answering, in various examples, the conversational artificial intelligence (AI) platform uses structured data and unstructured data to generate responses to queries from users. In one example, if data for the response to the query is not stored in a structured data structure, the conversational AI platform searches for this data in an unstructured data structure."

[0008] Furthermore, paragraph 0003 of the following Patent Document 2 discloses that "In addition, a single AI assistant is typically tasked with responding to requests in a variety of different domains, such as, for example, ordering food and drink, setting a timer, disabling an alarm system, playing music, etc. However, because a single AI assistant is responsible for the entire range of possible domains, requests are often routed to the wrong domain's rule set for the request, thereby resulting in an inappropriate or inaccurate response. Consequently, even if these AI assistants may have a path to the necessary knowledge (e.g., a domain-specific application programming interface (API)), they may prove ineffective in certain domains due to, for example, improper routing of the request." [Prior art documents] [Patent documents]

[0009] [Patent Document 1] Japanese Patent Publication No. 2023-120130 [Patent Document 2] Special Publication No. 2023-525173 Summary of the Invention [Problem to be solved by the invention]

[0010] However, generative AI's learning level is still immature, and it is often unable to respond flexibly to customers who place orders according to unexpected routines, and improvements are needed. Meanwhile, in the food and beverage industry, there is a growing momentum to introduce and utilize generative AI not only in the field of customer service but also in the fields of talent acquisition and human resource development, and the field of system development is also in the trial and error stage of figuring out how to incorporate generative AI.

[0011] The present invention has been made to solve the above-mentioned problems, and aims to provide a business support system that can support business development in the food and beverage industry by utilizing generative AI in customer experience, talent acquisition, training strategies, and store management. [Means for solving the problem]

[0012] The business support system of the present invention for achieving the above object comprises the following configuration.

[0013] The business support system according to the present invention is a business support system capable of communicating, via a predetermined communication medium, between a first data terminal operated by a customer visiting a restaurant and a server device that supports a customer approach involving placing an order at the first data terminal, wherein the server device includes a voice response AI function processing means that acquires voice data uttered by the customer in response to a menu screen displayed on the first data terminal, generates voice data according to language data for establishing a conversation to accept a food order from the customer, and responds to the first data terminal with the voice data generated by the voice response AI function processing means; Voice data of the customer's response to By analyzing the above customers Note and a registration means for registering a sentence history in a database, wherein the first data terminal comprises a voice generation means for acquiring voice data from the server device and generating a voice, and a response means for directly responding to the server device with the voice data generated by the customer. The voice response AI function processing means generates voice data based on a predetermined language for asking about the number of customers, their nationalities, their hunger levels, and their moods today. It is characterized by: [Effects of the Invention]

[0014] According to the present invention, generative AI can be used to support business development in the food and beverage industry in customer experience, talent acquisition, training strategies, and store management. [Brief explanation of the drawings]

[0015] The drawings illustrate particular embodiments of the present invention, including essential features of the invention as well as alternative and preferred embodiments. [Figure 1] 1 is a block diagram illustrating the configuration of a business support system according to an embodiment of the present invention. [Figure 2] FIG. 2 is a block diagram illustrating the configuration of the server device shown in FIG. [Figure 3] 2A is a block diagram illustrating the configuration of first to fourth data terminals connected to the server device shown in FIG. 1, and FIG. 2B is a block diagram illustrating the configuration of the main part shown in FIG. 2A. [Figure 4] A diagram showing the hierarchical structure of language data constructed in the database used by the speech generation AI function processing unit shown in Figure 2. [Figure 5] A diagram showing the hierarchical structure of language data constructed in the database used by the speech generation AI function processing unit shown in Figure 2. [Figure 6] 10 is a flowchart showing an example of an AI customer service processing procedure in the business support system according to the present embodiment. [Figure 7] 10 is a flowchart showing an example of an AI customer service processing procedure in the business support system according to the present embodiment. [Figure 8] 3A to 3C are diagrams illustrating features of a user interface displayed in the business support system according to the present embodiment. [Figure 9] 3A to 3C are diagrams illustrating features of a user interface displayed in the business support system according to the present embodiment. [Figure 10] 3A to 3C are diagrams illustrating features of a user interface displayed in the business support system according to the present embodiment. [Figure 11] 3A to 3C are diagrams illustrating features of a user interface displayed in the business support system according to the present embodiment. [Figure 12] 3A to 3C are diagrams illustrating features of a user interface displayed in the business support system according to the present embodiment. [Figure 13] 3A to 3C are diagrams illustrating features of a user interface displayed in the business support system according to the present embodiment. [Figure 14] 3A to 3C are diagrams illustrating features of a user interface displayed in the business support system according to the present embodiment. [Figure 15]3A to 3C are diagrams illustrating features of a user interface displayed in the business support system according to the present embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0016] Next, the best mode for carrying out the present invention will be described with reference to the drawings.

[0017] <System configuration description> [First embodiment] 1 is a block diagram illustrating the configuration of a business support system according to this embodiment. In this embodiment, a business support system is exemplified in which a plurality of first data terminals 3-1 to 3-N operated by customers seated at tables in a restaurant where food is served, a third data terminal 5-1 to 5-N operated by a chef to purchase ingredients, a plurality of second data terminals 4-1 to 4-N operated by kitchen staff, a fourth data terminal 2-1 to 2-N linked to a POS system, and a server device 1 providing a platform 1A can communicate with each other via a predetermined communication medium.

[0018] In Figure 1, multiple first data terminals 3-1 to 3-N, third data terminals 5-1 to 5-N operated by chefs to purchase ingredients, multiple second data terminals 4-1 to 4-N operated by kitchen staff in the kitchen, and fourth data terminals 2-1 to 2-N linked to the POS system are equipped with the hardware resources and software resources shown in Figure 2, and each performs its own unique data processing according to the procedure shown in the flowchart described below.

[0019] FIG. 2 is a block diagram for explaining the configuration of the server device 1 shown in FIG. 1, and the same components as those in FIG. 1 are assigned the same reference numerals.

[0020] In FIG. 2, 11 denotes a communication unit which connects first data terminals 3-1 to 3-N, second data terminals 4-1 to 4-N, third data terminals 5-1 to 5-N, and fourth data terminals 2-1 to 2-N connected to a network 21 as a communication medium, and controls communication.

[0021] A CPU 13 starts an operating system (OS) stored in an external memory 18 connected to the internal bus 12, and starts various applications installed via the API. It also processes various programs deployed on the RAM 16.

[0022] 15 is a keyboard, which is used to input numbers, text, and icon commands for running applications.

[0023] Reference numeral 16 denotes an expandable RAM, which expands and stores the basic program of the platform 1A installed in the external memory 18. Reference numeral 17 denotes a display, which displays the program running status via various UI screens (not shown).

[0024] The voice generation AI function processing unit 16-1 acquires voice data uttered by customers in response to the menu screen displayed on the first data terminal 3-1 to 3-N, generates voice data according to language data for establishing a conversation to accept the customer's food order, and performs processing to respond to the first data terminal 3-1 to 3-N.

[0025] In addition, the voice generation AI function processing unit 16-1 is also configured to be able to perform a process of searching the order history stored in the customer database 14 from the characteristics of the language data extracted from the voice data and generating voice data that presents individual menus.

[0026] Furthermore, the voice generation AI function processing unit 16-1 is configured to be able to execute a process of referencing the latest material purchasing information stored in a purchasing database (not shown), searching the order history stored in the customer database 14 from the characteristics of the language data extracted from the voice data, and generating voice data that presents new menu items.

[0027] In addition, the voice generation AI function processing unit 16-1 is equipped with multiple voice response AI functions with different customer service attributes according to the needs of the restaurant, and customers can specify a specific language to be used for the voice response in order to decide what to order from the menu displayed on the menu screen displayed on the first data terminal 3-1 to 3-N.

[0028] Furthermore, the voice generation AI function processing unit 16-1 executes a function process of generating voice data based on a predetermined language for hearing the number of customers, their nationalities, their hunger level, and their mood that day.

[0029] Here, the specified language used by the speech generation AI function processing unit 16-1 corresponds to multiple languages ​​and is equipped with translation dictionaries for each language, and is compatible with not only Japanese but also major languages ​​of the world (including English, French, Russian, German, Spanish, Italian, Chinese, Korean, etc.), and is configured to be able to flexibly accommodate other languages ​​by configuring the language dictionary to be used to be expandable.

[0030] In addition, in order to flexibly respond to the customer service requests made by the store as the server device 1, the voice generation AI function processing unit 16-1 is configured so that the store can select one of multiple voice generation AI function processing units 16-1 or switch between multiple voice generation AI function processing units 16-1.

[0031] The registration unit 16-2 analyzes the voice data generated by the voice generation AI function processing unit 16-1 and the language data extracted from the voice data uttered by customers entering the store, learns the characteristics and order history of customers, and registers them in the customer database 14.

[0032] Here, the registration unit 16-2 executes a process of registering information (gender, nationality, taste preference, average customer spending, number of visits, number of customers) relating to the customers operating the first data terminals 3-1 to 3-N in the customer database 14.

[0033] The identification unit 16-3 analyzes the voice data uploaded from each of the first data terminals 3-1 to 3-N via the network 21 and performs a process to identify the customer's preferences for food orders (for example, in the case of a Chinese restaurant, this may include Sichuan cuisine, meat dishes, soups, fish dishes, etc.).

[0034] The notification unit 16-4 executes a process of relaying, via the network 21, the cooking video delivered from the kitchen for the ordered dish to any of the first data terminals 3-1 to 3-N operated by the customer identified by the identification unit 16-3.

[0035] The issuing unit 16-5 executes a process of issuing a statement of account via the network 21 to any one of the first data terminals 3-1 to 3-N operated by the customer.

[0036] The linking unit 16-6 executes processing for managing sales in real time in API linkage with the fourth data terminals 2-1 to 2-N related to the POS system. Sales, number of customers, average customer price, etc. based on the current time are based on the POS system, so we will not go into details here.

[0037] Reference numeral 19 denotes a generation AI unit, which refers to a language database (not shown) and executes a process of generating language data in real time to establish a conversation with a customer when placing an order. Note that whether the generation AI unit 19 uses an existing generation AI system or an independently developed generation AI system is a design decision.

[0038] Furthermore, the generation AI unit 19 is configured to be able to generate language data for hearing the number of customers, their nationalities, their hunger levels, and their moods today.

[0039] The server device 1 is configured to be able to execute a process of transferring the menu determined by the first data terminals 3-1 to 3-N to a kitchen device operated by a kitchen staff member.

[0040] In addition, the server device 1 executes a process of transferring order information including the name of the dish, the number of people, and the cooking method to the second data terminals 4-1 to 4-N operated by the kitchen staff, in accordance with the menu determined by the voice generation AI function processing unit 16-1.

[0041] Furthermore, the first data terminals 3-1 to 3-N are configured to be able to change the frequency, tone and speed of the voice emitted according to a character selected from a group of multiple characters to suit a customer seated at a chair at a table.

[0042] Furthermore, the server device 1 has a kitchen camera (live camera) installed in a kitchen (not shown) and executes a process of relaying cooking videos captured by the kitchen camera along with progress information on the ordered food to the first data terminals 3-1 to 3-N.

[0043] Figure 3 is a block diagram illustrating the configuration of first data terminals 3-1 to 3-N, second data terminals 4-1 to 4-N, third data terminals 5-1 to 5-N, and fourth data terminals 2-1 to 2-N connected to server device 1 shown in Figure 1. Note that the first data terminals 3-1 to 3-N are assumed to be pad devices or the like.

[0044] 3(a), 301 denotes a CPU, which executes various applications by loading an OS and control programs stored in a ROM 302 into a RAM 303 and executing them. Various information is input and icons displayed on a user interface screen (UI screen) are clicked directly on a display 311. 304 denotes a communication unit, which controls communication for connecting to a server device 1 connected to a network 21.

[0045] In the RAM 303 shown in FIG. 3(b), 303-1 is a menu processing unit that is configured to obtain the latest menu (today's recommended menu) from the platform 1A via the network 21 and display it on the display 311.

[0046] 303-2 is an uploading unit that executes a process of uploading order information, either as voice or as menu selections made by customers seated at tables, to the platform 1A. It should be noted that the first data terminals 3-1 to 3-N are each equipped with a microphone for voice input.

[0047] Reference numeral 303-3 denotes a UI control unit, which executes control to display on the display 311 a UI screen (FIG. 7 and subsequent drawings to be described later) presented by the platform 1A provided by the server device 1 shown in FIG.

[0048] 303-4 is a voice processing unit that performs a voice output function that acquires generated language data from the server device 1 and outputs it to a customer seated at a table, and a response function that directly responds to the server device 1 with the voice data output by the customer.

[0049] Figures 4 and 5 are diagrams showing the hierarchical structure of language data constructed in the customer database 14 used by the speech generation AI function processing unit 16-1 shown in Figure 2. Note that this example is merely an example, and is configured to be able to incorporate combinable language data strings. Furthermore, if this system is applied to an industry other than the food and beverage industry, a different hierarchical structure of language data will naturally be adopted.

[0050] The first layer contains customer, staff, store information, and conversation metadata. In the first layer, customer information, such as customer ID, nationality, language, number of visits, favorite food category, and allergy information, is stored as a string except for customer ID and number of visits, and customer ID and number of visits are assigned integers.

[0051] The second layer focuses on fulfilling orders from customers in the first layer and stores information associated with orders, recommendation systems, tables, and customer preferences.

[0052] Specifically, the order layer is assigned the order ID, customer ID, date and time, order details, order status, and whether or not there is an additional order.

[0053] Similarly, the recommendation system is assigned a recommendation ID, a customer ID, a list of recommended dishes, and a reason for the recommendation.

[0054] Similarly, a table is assigned a table ID, number of seats, reservation status, and customer ID.

[0055] Similarly, customer preferences are assigned customer ID, preferred flavors, inedible ingredients, preferred meal types, dietary restrictions, and preferred dishes and ingredients.Furthermore, the third layer assigns dishes and billing information to the order layer.

[0056] Here, each dish is assigned a dish ID, dish name, price, category, allergy information, and recommended occasion. Furthermore, each billing information is assigned a billing ID, order ID, customer ID, total amount, and payment status. Furthermore, the fourth layer is assigned dish characteristics, including the dish ID, main ingredients, flavor characteristics, calories, recommended occasion, and seasonality.

[0057] Meanwhile, staff members in the first layer are assigned staff IDs, names, roles, and schedules.Similarly, store information in the first layer is assigned store IDs, store names, opening dates, business hours, addresses, phone numbers, menu information, and course reservation options.

[0058] In addition, the store information in the first layer is assigned menu information in the second layer, and menu ID, dish ID, course name, course details, course price, and available time slots are assigned.

[0059] The first layer of dialogue metadata includes a dialogue ID, category, keywords and phrases, sentiment analysis results for the dialogue, and whether or not a response was required.

[0060] Furthermore, the interaction metadata in the first layer is assigned a feedback log in the second layer, and the feedback log is assigned a feedback ID, interaction ID, customer ID, date and time, feedback content, and items requiring improvement.

[0061] This allows the generation AI unit 19 and the voice generation AI function processing unit 16-1 to work together to store and manage in the customer database 14 the language data that should be referenced for each customer, including detailed order information, staff members, and dialogue logs across the board and at the appropriate level.

[0062] The generation AI unit 19 periodically browses the customer information, order information, etc., stored in each layer of the customer database 14, and responds optimally to the customer, allowing the customer to enjoy their meal while experiencing the peace of mind of being served by a concierge.

[0063] When a regular customer visits a store because the customer service representative is on vacation or has been promoted, the customer's impression of the store may be negatively affected by inexperienced service. However, with this system, by sharing the customer database 14 across a store chain, it becomes possible to provide appropriate and natural service to the regular customer no matter which store the regular customer visits.

[0064] 6 and 7 are flowcharts showing an example of an AI customer service processing procedure in the business support system according to this embodiment. Note that the drawings are divided into separate diagrams due to size limitations, but the numbers at the branch points shown in FIGS. 6 and 7 are assumed to be interconnected.

[0065] Below, we will explain an example of a customer service response assuming a situation where the voice generation AI function processing unit 16-1 generates and issues voice data after a customer visits a restaurant. Note that in the following explanation, the functions of the voice generation AI function processing unit 16-1 may be collectively referred to as Luna.

[0066] In addition, the combination of staff members who interact with customers and the devices they use will be Luna (which has API connectivity with the server device 1 shown in Figure 1), hall staff, kitchen tablet (data terminal), kitchen staff, and POS system (data terminal).

[0067] When a customer arrives at the store, they sit at an available table, press the call button (which also functions as a start button), and are notified that Luna has called them.

[0068] It is assumed that a corresponding message is displayed on the display 311 of the first data terminal 3-1 to 3-N, requesting the customer to talk to Luna.

[0069] Next, Luna acquires the language data generated by the generation AI unit 19 from the server device 1 and uses the speech processing unit 303-4 to greet the customer through a speaker unit (not shown), such as a message like "Welcome, thank you for your continued patronage." Furthermore, when Luna inquires about the number of customers, their nationalities, how hungry they are, and how they are feeling that day, the speech data in which the customers respond is converted into language data.

[0070] Next, the server device 1 identifies the customer ID stored in the customer database 14, browses the customer's eating and drinking history as hierarchical information shown in Figures 4 and 5, generates today's recommended lineup as language data, transfers it to the first data terminals 3-1 to 3-N, and displays it on the display 311. The first data terminals 3-1 to 3-N then accept that the customer has selected an order from the lineup presented on the display 311.

[0071] Here, Luna checks whether there is any missing information before finalizing the order to be transmitted to the kitchen staff. For example, when a spinach salad is ordered, whether the sauce is French-based or Italian-based may not be stored in the customer database 14.

[0072] Next, if Luna determines that there are no additional orders from the customer, it transmits the customer's order from the first data terminal 3-1 to 3-N to the second data terminal 4-1 to 4-N corresponding to the kitchen tablet. The order entry form to be transmitted is configured so that each store can freely lay it out.

[0073] Once the order is confirmed, Luna transmits the unit price and number of ordered dishes to the fourth data terminals 2-1 to 2-N linked to the POS system in order to create an invoice to be billed when the meal is completed.

[0074] The wait staff checks the payment screen displayed on the display 311 of the second data terminal 4-1 to 4-N corresponding to the kitchen tablet to ensure that there are no discrepancies between the food ordered by the customer and the order information calculated by the POS system.

[0075] After that, the wait staff receives the cooking progress information from the kitchen staff and begins preparing to serve the plated food. Note that if the serving itself is performed by an in-store robot capable of processing the generation AI unit 19, the progress information is shared and managed with the robot.

[0076] The food is then delivered by the wait staff to the tables where the customers are seated.

[0077] Here, Luna introduces customers to information (linguistic and audio information) about the restaurant's history, new staff members, and the head chef, and asks if they would like to order more.

[0078] After that, when Luna receives a check request from the customer, it retrieves the accounting data already created by the POS system, displays the total amount, tax, and service charge on display 311, and confirms whether the customer wants to pay electronically or in cash, after which the payment process is carried out via the POS system.

[0079] The wait staff then hands the customer the receipt issued by the POS system and the credit card payment sheet, completing the entire food and beverage service.

[0080] [Effects of the first embodiment] According to this embodiment, the generation AI unit 19 can be utilized to support business development in the food and beverage industry in customer experience, talent acquisition, training strategies, and store management.

[0081] Second Embodiment In the above embodiment, a system has been described in which staff are always present to serve food, but a system in which a food serving robot moves between the kitchen and the tables may also be configured to work in organic cooperation with the system.

[0082] [Effects of the second embodiment] According to this embodiment, a flexible service support system can be established even when store development progresses with digital transformation and a service model is used to run stores with minimal staff.

[0083] Third Embodiment In the above embodiment, it is not possible to check the kitchen staff or the cooking status, but the kitchen may be configured to have a kitchen camera and a distribution unit that relays cooking videos captured by the kitchen camera along with information on the progress of the ordered food to the first data terminals 3-1 to 3-N.

[0084] [Effects of the third embodiment] According to this embodiment, it is possible to provide customers waiting at their tables with a visual update on the progress of their ordered dishes in real time, providing a sense of realism that encourages further customer orders.

[0085] [Fourth embodiment] 8 to 14 are diagrams illustrating the features of the user interface displayed in the business support system according to this embodiment. Note that although Luna is used as an example in this example, other voice response AIs may also be used.

[0086] When a family (for example, a group of four) comes to a restaurant and sits down at an available table, the first data terminals 3-1 to 3-N that can be operated on the table respond with a voice response such as "Welcome" or "Thank you for visiting us today" in Japanese through a speaker (not shown) by the voice generation AI function processing unit 16-1.

[0087] In response to this, when one of the customers responds by voice to the first data terminal 3-1 to 3-N, the voice response AI will serve the customer from displaying a series of menu items, ordering food, transmitting the order to the kitchen, checking the progress of the food from the kitchen, and paying the bill, and the following UI screen will be displayed on the first data terminal 3-1 to 3-N.

[0088] [UI screen when visiting the store] When a customer arrives at the store and sits down at an empty table, one of the first data terminals 3-1 to 3-N is placed on the table in an operable state or is propped up against a support that displays the screen at a predetermined inclination. The following description will be given assuming that the customer is operating one of the first data terminals 3-1 to 3-N.

[0089] When a customer first enters the store, the UI screen shown in FIG. 8 is displayed on the display 311 of the first data terminal 3-1 to 3-N.

[0090] Here, the customer confirms the number of people seated, for example, "4," by pressing the "-" key and / or the "+" key.

[0091] However, you can configure Luna to speak these messages in Japanese when you tap them.

[0092] Next, select the language to be used by the speech generation AI function processing unit 16-1. Here, as examples of languages, Japanese, English, Chinese, and Korean are shown as selectable. Currently, Japanese is selected.

[0093] Next, when a customer who visits the store presses the START button displayed on the display 311, the UI control unit 303-3 shown in Fig. 3 is activated, and the UI screen on the display 311 changes to the screen shown in Fig. 9. Luna, which functions as the voice generation AI function processing unit 16-1, speaks a message, for example, "Welcome. We have a great selection of ingredients today, so please feel free to ask us a question" in Japanese.

[0094] The first data terminals 3-1 to 3-N are each equipped with a speaker (not shown) and configured to output aloud messages received by the voice processing unit 303-4 from the server device 1. The display 311 also displays an operation method for a customer operating the first data terminal 3-1 to 3-N to communicate with Luna.

[0095] For example, messages such as "Tap the microphone button once to talk!!", "Select the order quantity from the right menu, or say "product number + order quantity", "Confirm the order details and tap "Confirm order" to confirm", and "Ask us anything else and we'll answer!!" are displayed on the screen.

[0096] 9, a character image symbolizing Luna is displayed on the display 311. Details of the character image symbolizing Luna are omitted.

[0097] Additionally, next to Luna on the display 311, an icon for voice input and an operation message (push the icon in the red circle to start conversation) are displayed.

[0098] Furthermore, the message input line on display 311 displays text that Luna has interpreted and confirmed based on the voice data spoken by the customer.

[0099] [Order Processing] Next, a case will be described in which a customer inputs a menu and voice to Luna, which is running on the first data terminals 3-1 to 3-N.

[0100] First, the UI control unit 303-3 displays the UI screen shown in Fig. 10 on the display 311. Here, the menu selection items include, for example, "Recommended," "Quick Delivery," "First Try," "Excellent," "Pizza, Pasta, Gratin," "Salad," "Tempura," "Noodles and Rice," "Meat," "Fried Food," "Western A la Carte," "Sushi," "Western Deep Fried Food," and "Dessert."

[0101] As described above, customers input the food they want to eat by speaking into the display 311. The UI screen shown in Figure 10 displays recommended tempura, seared cod roe, shrimp ajillo, and clam soup, but these are just examples of the izakaya menu.

[0102] When the customer taps the "Confirm Order Details" button on the UI screen shown in FIG. 10, the UI control unit 303-3 displays on the display 311 the UI screen shown in FIG. 11 for confirming the details of interest.

[0103] In this example, a customer orders three pieces of pickled ginger tempura and a tempura platter (serves 1-2). After checking the order details displayed on display 311, the customer presses the button to confirm the order or the order history / checkout button. The UI control unit 303-3 then displays the UI screen shown in Figure 12 on display 311 for confirming the order details.

[0104] In the UI screen shown in FIG. 12, tabs such as Prompt, Menu, Category, and Message are arranged as a HOME menu, and a Logout tab is arranged for ending the operation.

[0105] In addition, the screen configuration shown in Figure 12 is configured to separately display ongoing orders that are being cooked in the kitchen for each table, corresponding to multiple tables, and completed orders that have already been served to the tables, as in the UI screen shown in Figure 13.

[0106] Next, when the customer presses the checkout button displayed on the display 311 for the completed order shown in Figure 13, the UI control unit 303-3 displays a UI screen on the display 311 for confirming the order details shown in Figure 14.

[0107] The UI screen shown in Figure 14 corresponds to a situation where, for example, the table number is 7 (table7), there are four customers, and a total bill of 3,681 yen is being charged. The UI screen shown in Figure 14 has a back button and a complete payment button to complete the transaction, and the customer presses the complete payment button to pay the displayed bill amount.

[0108] The store accepts multiple payment methods, including electronic money, credit cards, and points. For cash payments, the store may also be configured to offer a separate service that awards bonus points to customers via their smartphones.

[0109] A dome camera may be installed in the kitchen to relay video of the progress of the food ordered by customers to the first data terminals 3-1 to 3-N, thereby providing customers with an exciting feeling.

[0110] [Effects of the fourth embodiment] According to this embodiment, Luna, which executes the functions of the voice generation AI function processing unit 16-1, works in conjunction with a series of routines related to customer service, order taking, and accounting for the food provided by the store to support the hospitality of customers, thereby making it possible to support store management and customer management at low cost without having to constantly secure personnel for the sales promotion function to secure repeat customers.

[0111] Fifth Embodiment To prevent hallucination, a phenomenon in which an artificial intelligence confidently gives answers that cannot be justified from the voice data it has learned, when the generation AI unit 19 generates voice data on the external memory 18, the voice generation AI function processing unit 16-1 shown in Figure 2 may be configured to store a voice data dictionary to avoid generating arbitrary syllables.

[0112] Figure 15 is a diagram explaining the features of the user interface displayed in the business support system according to this embodiment, and is an example of a UI screen that allows the administrator of the server device 1 to store the correspondence between conversion words and their pronunciations (hiragana) in the external memory 18.

[0113] This prevents the voice generation AI function processing unit 16-1 from accidentally generating voice data that could be misunderstood as Lunacy, Lucy, Lunachan, etc. when responding to customers visiting the store, when the voice should be pronounced as Luna.

[0114] [Effects of the fifth embodiment] According to this embodiment, it is possible to reduce the incidence of hallucination in the learning function of the voice generation AI in an environment where it is difficult to hear the voices spoken by customers at the store.

[0115] The present invention can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program. It can also be realized by a circuit (e.g., ASIC) that realizes one or more functions.

[0116] The disclosure of the present invention described above can be summarized at least as follows.

[0117] (1) A business support system in which a first data terminal operated by a customer visiting a restaurant and a server device that supports a customer service approach involving an order placed on the first data terminal can communicate via a predetermined communication medium, wherein the server device includes a voice response AI function processing means that acquires voice data uttered by the customer in response to a menu screen displayed on the first data terminal, generates voice data according to language data for establishing a conversation to accept the customer's food order, and responds to the first data terminal; and Voice data of the customer's response to By analyzing the above customers Note and a registration means for registering a sentence history in a database, wherein the first data terminal comprises a voice generation means for acquiring voice data from the server device and generating a voice, and a response means for directly responding to the server device with the voice data generated by the customer. The voice response AI function processing means generates voice data based on a predetermined language for asking about the number of customers, their nationalities, their hunger levels, and their moods today. It is characterized by:

[0118] (2) The server device is characterized in that the voice response AI function processing means has multiple voice response AI functions with different customer service attributes according to the needs of the restaurant, and the first data terminal has a designation function for designating one of the voice response AI functions to execute the voice response AI function processing service to be provided to the restaurant.

[0119] (3) The voice response AI function processing means receives voice data from the first data terminal. Taka The system searches the order history stored in the customer database and generates language data to present an individual menu.

[0120] (4) The voice response AI function processing means refers to the latest material purchase information stored in the purchase database and executes the voice data in accordance with The system searches the customer's order history stored in a customer database and generates voice data that presents alternative menu items.

[0121] (5) The voice response AI function processing means refers to the latest material purchase information stored in the purchase database and executes the voice data in accordance with Is it a feature of the audio data? Customers The system searches the order history stored in the customer database and generates voice data to present new menu items.

[0122] (6) The device is characterized by including a linking means for linking the payment for the menu determined by the voice response AI function processing means with a POS system.

[0123] (7) The server device is characterized by having a transfer means for transferring order information including the name of the dish, the number of people, and the cooking method to a second data terminal operated by kitchen staff in accordance with the menu determined by the voice response AI function processing means.

[0125] ( 8 The predetermined language corresponds to a plurality of languages, and a translation dictionary for each language is provided.

[0126] ( 9 ) The first data terminal is characterized in that it is possible to change the frequency, tone and speed of the voice emitted according to a character selected from a group of multiple characters to suit the customer.

[0127] ( 10 ) A second data terminal operated by kitchen staff is communicatively connected to the server device via the specified communication medium, the second data terminal is equipped with a kitchen camera, and the server device is equipped with a distribution means for relaying and distributing cooking videos captured by the kitchen camera to the first data terminal along with information on the progress of the ordered food.

[0128] ( 11 ) The first data terminal is characterized in that it has a designation means for designating the type of language to be used, and responds to the server device with the voice data together with a language code corresponding to the type of language designated by the designation means. [Explanation of symbols]

[0129] 1. Server device 1A Platform 2-1~2-N 4th data terminal 3-1~3-N First data terminal 4-1~4-N Second data terminal 5-1~5-N Third Data Terminal

Claims

1. A business support system in which a first data terminal operated by a customer visiting a restaurant and a server device that supports a customer approach involving placing an order on the first data terminal can communicate with each other via a predetermined communication medium, The server device a voice response AI function processing means for acquiring voice data uttered by the customer in response to the menu screen displayed on the first data terminal, generating voice data according to language data for establishing a conversation to accept the customer's food order, and responding to the first data terminal; a registration means for analyzing the voice data generated by the voice response AI function processing means and registering the order history of the customer in a database; Equipped with The first data terminal a voice generating means for acquiring voice data from the server device and generating the voice data; a response means for directly responding to the server device with voice data uttered by the customer; Equipped with The business support system is characterized in that the voice response AI function processing means generates voice data based on a predetermined language to inquire about the number of customers, their nationality, their level of hunger, and their mood that day.

2. The server device The voice response AI function processing means has a plurality of voice response AI functions with different customer service attributes according to the requests of the restaurant, The first data terminal The business support system according to claim 1, characterized in that it has a designation function for designating one of the voice response AI functions in order to execute the voice response AI function processing service to be provided to the restaurant.

3. The business support system according to claim 1, characterized in that the voice response AI function processing means searches the order history stored in the customer database from the voice data acquired from the first data terminal and generates language data to present individual menus.

4. The business support system according to claim 1, characterized in that the voice response AI function processing means refers to the latest material purchasing information stored in a purchasing database, searches the customer's order history stored in a customer database according to the voice data, and generates voice data that presents alternative menu items.

5. The business support system according to claim 1, characterized in that the voice response AI function processing means refers to the latest material purchasing information stored in the purchasing database, searches the order history stored in the customer database from the characteristics of the voice data according to the voice data, and generates voice data that presents new menu items.

6. 2. The business support system according to claim 1, further comprising a linking means for linking the payment of the menu determined by the voice response AI function processing means with a POS system.

7. The server device The business support system according to claim 1, further comprising a transfer means for transferring order information including the name of the dish, the number of people, and the cooking method to a second data terminal operated by kitchen staff in accordance with the menu determined by the voice response AI function processing means.

8. 2. The business support system according to claim 1, wherein the predetermined language corresponds to a plurality of languages, and a translation dictionary for each language is provided.

9. The business support system according to claim 1, characterized in that the first data terminal is capable of varying the voice frequency, tone, and speed emitted according to a character selected from a group of multiple characters to suit the customer.

10. The business support system described in claim 1, characterized in that a second data terminal operated by kitchen staff is communicatively connected to the server device via the specified communication medium, the second data terminal is equipped with a kitchen camera, and the server device is equipped with a distribution means for relaying cooking videos captured by the kitchen camera to the first data terminal along with progress information on the ordered food.

11. The first data terminal A designation means for designating a language type to be used is provided, 2. The business support system according to claim 1, wherein the voice data is sent to the server device together with a language code corresponding to the language type designated by the designation means.

Citation Information

Patent Citations

  • Order receiving device and order receiving method for restaurant

    JP2005182140A

  • Dish order support system

    JP2005250766A

  • Order processing system

    JP2007004282A

  • Voice translating device, voice translating method, and voice translating program

    JP2017182310A

  • Server, electronic apparatus, control device, control method and program for electronic apparatus

    JP2019101667A