system

Abstract

We provide the system. [Solution] A means of obtaining information on available seats at a business location within a certain region, A means for presenting available business locations to the user based on the aforementioned vacancy information, A means of confirming a reservation at a business location selected by the user, A means of obtaining and providing order information for products at the business location in advance based on the aforementioned reservation, Means for completing payment processing related to the aforementioned reservation and order information, A system that includes this.

Description

Technical Field

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a persona chatbot control method performed by at least one processor, including steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

【Patent Document

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In the planning of a drinking party, the organizer always bears a heavy burden, and there is a problem that it takes a lot of time and effort especially for selecting and reserving the venue of the second party. Also, it is difficult for drunk participants to place orders smoothly after arriving at the store, and there are cases where it causes trouble to the store side. This invention aims to solve these problems and improve the efficiency of planning and operating a drinking party.

Means for Solving the Problems

[0005] This invention acquires real-time information on available seats at business locations within a given area and uses that information to present users with available locations. For business locations selected by the user, the system automatically confirms the reservation and acquires product order information for the business location in advance. Furthermore, by providing a system that includes a function to complete payment processing related to this reservation and order information, the burden on the organizer of a drinking party is reduced, and an environment is created where participants can start the drinking party smoothly after arriving.

[0006] "Seat availability information" refers to data regarding the current availability of seats at a business location in a specific region.

[0007] A "business location" refers to a commercial facility where users can eat, drink, or receive services.

[0008] "User" refers to an individual or group that uses the service.

[0009] "Confirming a reservation" refers to the process of registering the date, time, and number of people visiting a selected business location in advance.

[0010] "Product order information" refers to data indicating users' prior purchase requests for products and services offered at the business location.

[0011] "Payment processing" refers to the procedure for completing the financial transaction for reservations and orders. [Brief explanation of the drawing]

[0012] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] This is a conceptual diagram showing an example of the essential functions of a data processing device and a smart device according to the first embodiment. [Figure 3] This is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4]It is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] It is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] It is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] It is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] It is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] It shows an emotion map to which multiple emotions are mapped. [Figure 10] It shows an emotion map to which multiple emotions are mapped. [Figure 11] It is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] It is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] It is a sequence diagram showing the processing flow of the data processing system in Example 2 when an emotion engine is combined. [Figure 14] It is a sequence diagram showing the processing flow of the data processing system in Application Example 2 when an emotion engine is combined.

Embodiments for Carrying out the Invention

[0013] Hereinafter, an example of an embodiment of a system according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0014] First, the language used in the following description will be explained.

[0015] In the following embodiments, the numbered processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Also, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), and the like.

[0016] In the following embodiments, the numbered RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor.

[0017] In the following embodiments, the numbered storage is one or more non-volatile storage devices that store various programs, various parameters, and the like. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes, and the like.

[0018] In the following embodiments, the numbered communication I / F (Interface) is an interface that includes a communication processor, an antenna, and the like. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).

[0019] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0020] [First Embodiment]

[0021] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0022] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0023] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0024] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0025] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0026] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0027] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0028] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0029] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0030] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0031] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0032] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0033] This invention is a system that utilizes information about restaurants and bars within a specific area to reduce the burden faced by organizers of drinking parties and events. Through this system, users can find restaurants with available seats in real time and easily make reservations and orders. As a result, participants can start their drinking party immediately upon arrival, and restaurants can respond quickly to orders.

[0034] The server connects to reservation APIs for multiple locations within the region to obtain real-time availability information. This ensures that the latest availability information is immediately sent to the user's device. The server also considers user preference data and has a function to suggest recommended locations based on past usage history and preferences. This information is displayed on the user's device, allowing the user to choose a location that suits their preferences.

[0035] The terminal displays a list of service locations received from the server to the user and sends the user's selected location to the server. The user can easily make a reservation through the terminal and even pre-order items from the provided menu. This order data is also transmitted to the service location via the server, ensuring that service is ready upon arrival. The user's payment information is pre-registered, allowing for smooth payment processing.

[0036] For example, if a user is planning a second party in the Shibuya area, the system will immediately retrieve information on available seats and recommend popular izakayas (Japanese pubs) in the area. The user selects a venue and reserves seats for the specified number of people. Furthermore, they can order kushikatsu (deep-fried skewers) and drinks via mobile ordering before arrival, and these will be served immediately upon arrival at the restaurant. This entire process is automated, significantly reducing the burden on the organizer and supporting the smooth running of the event.

[0037] The following describes the processing flow.

[0038] Step 1:

[0039] The server connects to reservation APIs for multiple business locations within a designated area and retrieves real-time availability information. The retrieved information includes the name of the business location, the number of available seats, the location, and business hours, and this information is stored in a database.

[0040] Step 2:

[0041] The server runs an algorithm that recommends the most suitable business location based on the user's past usage history and preferences, and sends the result to the terminal.

[0042] Step 3:

[0043] The terminal displays a list of sales locations received from the server on the user interface. The user reviews the list and selects the sales location they wish to visit.

[0044] Step 4:

[0045] Users make reservations for their chosen business location via their device. They enter the necessary information (number of people, arrival time, etc.) into the reservation form and submit it to the server.

[0046] Step 5:

[0047] The server uses the reservation API for the business location to confirm the reservation based on the reservation information received from the user. After confirming that the reservation was successful, it returns reservation confirmation information to the terminal.

[0048] Step 6:

[0049] The terminal displays a menu of available items for the business location and provides an ordering interface for mobile ordering if necessary. The user orders the desired items and sends this information to the server.

[0050] Step 7:

[0051] The server processes user order information and transmits it to the service location. It provides all the necessary data to facilitate inventory checks and food preparation.

[0052] Step 8:

[0053] The user's device displays a screen for settling the amount related to the order and reservation using registered payment information. Once the user confirms and approves, the device sends the payment information to the server.

[0054] Step 9:

[0055] The server processes the payment through the online payment service and verifies the payment's success. A success notification is sent to the terminal and the business location, and the process is ready.

[0056] (Example 1)

[0057] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0058] Traditionally, organizers of parties and events spent a great deal of time and effort finding a venue that suited the preferences of all participants. Furthermore, they had to manually manage a wide range of processes, including checking availability, making reservations, placing orders in advance, and processing payments. This presented a significant burden while requiring quick responses. To address this, a system was needed that could acquire real-time availability information, suggest venues based on user preferences, and handle reservations, orders, and payments all in one place.

[0059] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0060] In this invention, the server includes means for acquiring vacancy information for multiple business locations within a certain region, means for presenting available business locations to the user based on the vacancy information, and means for analyzing the user's past usage information and recommending business locations. This makes it possible for the organizer to quickly and efficiently carry out all processes from checking vacancies to making reservations, ordering, and paying, without feeling burdened.

[0061] 1. "Within the region" refers to a specific geographical area and indicates information regarding business locations within that area.

[0062] 2. "Business location" refers to a facility or place used for conducting business, and includes restaurants, event venues, etc.

[0063] 3. "Availability information" refers to data regarding the number of available seats and reservation status at business locations.

[0064] 4. "User" refers to an individual or group that uses the system to obtain information about business locations and make reservations or orders.

[0065] 5. "Reservation" refers to the process by which a user secures the use of a specific business location at a designated date and time.

[0066] 6. "Product information" refers to detailed data about the products and services offered at sales offices.

[0067] 7. "Payment processing" refers to the process of completing financial transactions related to reservations or orders.

[0068] 8. "Analysis" refers to the process of examining data and uncovering important information and patterns.

[0069] 9. "Recommendation" refers to the act of suggesting the most suitable sales office based on the user's preferences and usage patterns.

[0070] 10. "Display means" refers to the interface or mechanism that allows users to receive information visually.

[0071] 11. "External digital map service" refers to an external technological platform that provides map-based information and is used to obtain seat availability information.

[0072] As an embodiment of this invention, the following system is constructed.

[0073] The server retrieves availability information from multiple sales offices within a given region via APIs. This utilizes external digital map services and reservation management APIs provided by the sales offices. The server processes the data received from these APIs and stores it in a database, ensuring that the latest availability information is always maintained. Furthermore, the server collects users' past usage information and analyzes it using machine learning algorithms to recommend sales offices that match the user's preferences. This makes it possible to provide personalized suggestions to individual users.

[0074] The terminal displays a list of sales locations sent from the server to the user. This interface utilizes applications developed using advanced frameworks such as React Native and Flutter®. Users can select a sales location via the terminal and confirm their reservation by specifying the desired date, time, and number of people. Furthermore, it is possible to place orders in advance from the provided menu, enabling smooth order processing at the sales location.

[0075] The user accesses the system using a terminal and enters a prompt, for example, "I want to find a recommended izakaya in the Shibuya area, reserve a table, and pre-order kushikatsu and beer." This is sent to a generating AI model, which then provides suggestions for the most suitable restaurant and order. This allows the user to efficiently make reservations and orders and receive smooth service upon arrival.

[0076] Through the mechanisms described above, this system reduces the burden on event organizers and enables a fast and efficient reservation and ordering process. This contributes to the success of the event.

[0077] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0078] Step 1:

[0079] The server connects to the reservation APIs of local sales offices to retrieve seat availability information. The API endpoints of the sales offices are provided as input, and the server sends an HTTP request based on this information. The data is received in JSON format, and the seat availability field is extracted. The server parses this information and updates its own database with the latest seat availability information.

[0080] Step 2:

[0081] The server retrieves the user's past usage data and analyzes their preferences. As input, the user's past booking history data is retrieved from the database. The server applies machine learning algorithms to rank sales offices based on the user's preferences. This analysis generates a personalized list of sales offices for each user.

[0082] Step 3:

[0083] The terminal presents the user with a list of sales offices sent from the server. The input is a list of recommended sales offices received from the server. The terminal displays the list in a user interface and provides filtering and detailed information display functions. When the user selects a specific sales office, selection data is generated.

[0084] Step 4:

[0085] Users make reservations at sales offices via their terminals. They provide reservation details such as the desired date, time, and number of people for the selected sales office, and this information is sent from the terminal to the server. The server processes the input data and confirms the reservation request for the sales office.

[0086] Step 5:

[0087] Users place orders for products in advance through a terminal. They select items from a menu provided on the terminal and enter the quantity. This order information is sent to the server. The server then transfers the order information to the sales office's system, preparing it for immediate service upon arrival.

[0088] Step 6:

[0089] The user's payment process is completed online. The user's payment information is pre-registered as input, and the transaction is executed through the payment platform based on this information. The server confirms that the payment is complete and provides confirmation to the user.

[0090] Through these steps, the system automates the entire process from booking to ordering and payment, providing an efficient experience.

[0091] (Application Example 1)

[0092] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0093] The aim is to alleviate the burden faced by organizers of drinking parties and events. In particular, it is necessary to solve problems in quickly selecting appropriate venues that meet the interests of participants and in smoothly handling reservations, orders, and payments. Furthermore, it is necessary to improve participant satisfaction by establishing a system that allows for prompt delivery of goods upon arrival.

[0094] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0095] In this invention, the server includes means for acquiring information on available seats at business locations within a certain area, means for presenting available business locations to an information terminal based on the available seat information, and means for confirming a reservation for a business location selected by the user. This reduces the burden on the organizer and makes it possible to quickly and easily select and reserve a suitable business location. Furthermore, it can increase the satisfaction of event participants by enabling pre-ordering and prompt delivery of goods, and by facilitating smooth transaction processing.

[0096] A "place of business" refers to a facility or space within a specific area where customers can visit to receive goods or services.

[0097] "Availability information" refers to data that shows the reservation status of seats and spaces within a business premises, indicating whether they are currently available or can be reserved.

[0098] A "user" is a person who searches for, makes reservations for, or places to order business through the system, and is the primary target audience of the system.

[0099] An "information terminal" is a computer or mobile device that users can operate to obtain information on available seats at a business location, enter orders, confirm reservations, and perform other similar actions.

[0100] "Reservation confirmation" refers to the formal acquisition of permission for use of the business location selected by the user for a specific date, time, and conditions.

[0101] "Product order information" refers to data containing details about the products and services offered at the business location, which users can select and specify in advance.

[0102] "Transaction processing" refers to a series of procedures involving the exchange of money and information related to the ordering of goods and the provision of services between a business location and another business location.

[0103] "Analysis" refers to the process of examining a user's past usage history in detail and extracting information based on their interests and preferences.

[0104] The system used to realize this application example can communicate with each other via servers, information terminals, and a communication network.

[0105] The servers are built on cloud platforms such as Amazon Web Services (AWS®) and run Node.js and Python (including Flask). The servers retrieve information on available seats at local locations via APIs, analyze users' past usage history and preference data, and generate recommended locations. This information is processed in real time and provided to the user's terminal.

[0106] The information terminal is a smartphone or tablet, running on iOS and Android® using Flutter. The information terminal displays business location information received from the server to the user and provides an interface for confirming reservations at the selected location. It also displays a menu for ordering products in advance. This allows the user to specify products and services before arrival. Reservation and order information is sent to the server through operations on the terminal, and preparations are made at the store.

[0107] Payment processing is handled securely through payment services such as Stripe. Users can quickly complete transactions related to reservations and orders using their pre-registered payment information.

[0108] As a concrete example, a user searches for an izakaya (Japanese pub) in the Shinjuku area using their smartphone, and the server suggests recommended locations based on available seating information. The user selects a location and pre-orders kushikatsu (deep-fried skewers) and cocktails, which are then served upon arrival. An example of a prompt message is: "Search for available seating at izakayas in the Shinjuku area that can be booked immediately, and list recommended establishments. Additionally, create a script that displays pre-orderable menu items and simplifies the booking and payment process."

[0109] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0110] Step 1:

[0111] The server retrieves seat availability information for business locations within a region via an API. It receives a request for regional information as input and queries the API. As output, it retrieves and stores seat availability data in real time.

[0112] Step 2:

[0113] The server analyzes the user's past usage history and preference data. Using the user's past history data as input, it generates an analysis model, such as an AI model, to analyze the user's preferences. The output is a list of recommended business locations.

[0114] Step 3:

[0115] The server sends availability information and recommended locations to the terminal. The server combines the availability information and recommendation list obtained as input and sends the data to the user terminal as output.

[0116] Step 4:

[0117] The terminal displays business location information to the user and accepts reservations. Input is information from the server, and the user selects a business location through the interface. The selected reservation information is sent to the server as output.

[0118] Step 5:

[0119] Users pre-order products through a terminal. Input is based on the provided menu information, and the user selects the products they wish to order. The output is the order information, which is then sent to the server.

[0120] Step 6:

[0121] The server transmits reservation and order information to the business location and instructs them to prepare. The input is reservation and order data from the user, which is passed to the business location's system. The output updates the information at the business location to ensure it is ready.

[0122] Step 7:

[0123] The terminal completes the user's payment processing. The input consists of pre-registered payment information and the order amount, and the transaction is completed via a payment system such as Stripe. The terminal displays the success or failure status to the user as output.

[0124] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0125] This system provides efficient and personalized support for users planning social gatherings and events. In particular, by incorporating an emotion engine, it recognizes the user's current emotional state and recommends venues and products that align with that emotion.

[0126] The server acquires real-time availability information for business locations within a designated area. This information is provided to the user's terminal and displayed as a list of business locations the user can visit. Furthermore, the server has an integrated emotion engine that can recognize the user's emotional state at that moment by analyzing user input, voice, facial expressions, etc.

[0127] The emotional data obtained by the emotion engine is used in the recommendation algorithm for users. For example, when a user is feeling stressed, the system prioritizes recommending business locations with a relaxing environment. Furthermore, customized products and menus may be suggested based on the user's emotions. This allows users to have a more comfortable and satisfying experience.

[0128] The terminal receives information from the server and provides functions for selecting a business location, making reservations, and mobile ordering. Users can easily complete reservations and place pre-orders through the terminal. In addition, special, emotion-based notifications are sent to the user's terminal to help enhance the user experience.

[0129] As a concrete example, consider a scenario where a user uses a device with emotion recognition enabled and uses this system. If the emotion engine determines that the user is tired, the server recommends a relaxing, green cafe and displays information about available seats at that location. The user then makes a reservation at the cafe via their device and orders their preferred drink before arriving, preparing for a peaceful moment.

[0130] Thus, the system of the present invention, by making full use of an emotion engine, achieves a high level of personalization that surpasses conventional reservation systems and provides optimal suggestions to the user.

[0131] The following describes the processing flow.

[0132] Step 1:

[0133] The server connects to reservation APIs for multiple locations within the region to obtain real-time availability information. This ensures that the latest data on available locations is available.

[0134] Step 2:

[0135] The terminal displays a list of business locations on the user interface based on vacancy information received from the server. Users can select locations of interest from the displayed list.

[0136] Step 3:

[0137] The user enables the emotion recognition function on their device. The device uses the camera and microphone to acquire emotions from the user's facial expressions and voice, and sends the emotion data to the server.

[0138] Step 4:

[0139] The server uses an emotion engine to analyze user emotion data. Based on the detected emotions, it selects the most suitable sales locations and products.

[0140] Step 5:

[0141] The server sends recommended locations and product menus to the terminal based on the user's emotions. The terminal then presents these to the user, offering them options for selection.

[0142] Step 6:

[0143] The user selects a recommended business location via the terminal and proceeds with the reservation process. The terminal sends the information entered in the reservation form to the server.

[0144] Step 7:

[0145] The server confirms the reservation for the specified business location based on the reservation data received from the user. Once confirmed, it notifies the terminal.

[0146] Step 8:

[0147] The terminal displays an interface that allows the user to pre-order products from a menu provided to them. The user selects the desired products and completes the order.

[0148] Step 9:

[0149] The server transmits order information to the business location, checks inventory, and prepares the order. It also processes payment information and completes the settlement.

[0150] Step 10:

[0151] The server confirms the completion of the payment and notifies both the user and the business location of the final confirmation of the reservation and order. This ensures a smooth experience for the user.

[0152] (Example 2)

[0153] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0154] Traditional reservation systems have faced challenges in providing personalized recommendations that adapt to the user's current emotional state. Furthermore, there is a need to select business locations that align with the user's desired experience and to streamline the pre-order and payment processing process.

[0155] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0156] In this invention, the server includes means for acquiring information on available seats at business locations within a certain area, means for presenting available business locations to the user based on the available seat information, means for analyzing the user's input data and recognizing their emotional state, and means for recommending business locations based on the emotional state. This makes it possible to recommend the most suitable business location according to the user's emotional state.

[0157] A "place of business" is a specific location where commercial activities take place, and it is a base where users can visit and enjoy goods and services.

[0158] "Vacancy information" refers to data about currently available seats and spaces at a specific business location, and this information is updated in real time.

[0159] A "user" refers to an individual or group that uses this system to make reservations for business locations or obtain information, and is a party that receives support for their decision-making.

[0160] "Emotional state" refers to data that indicates the user's emotions and psychological state, and is the mental state that is analyzed and recognized from the input information.

[0161] "Recommending" refers to the act of suggesting the most suitable option based on the user's preferences and circumstances.

[0162] "Confirming a reservation" is the process of guaranteeing use at the business location selected by the user and securing the right to use seats and services.

[0163] "Order information" refers to data about the details of the products and services selected by the user in advance, and is an instruction sheet provided along with the reservation.

[0164] "Payment processing" refers to the procedure for settling payments related to reservations and orders, and is the process of transferring legitimate payment from the user to the business location.

[0165] This invention is a system that provides personalized recommendations for business locations based on the user's emotional state. The system consists of a server and terminals, each performing a specific function.

[0166] The server collects real-time availability information from business locations within the region. This is done through API requests to a database of business locations. Furthermore, the server is equipped with an emotion engine that analyzes user input data, voice, and facial expressions. The emotion engine uses machine learning frameworks such as TENSORFLOW® and PyTorch and has the capability to recognize emotional states.

[0167] Based on the data obtained by the emotion engine, the server recommends suitable business locations for the user. The recommendation algorithm is designed to take into account the user's emotional state and suggest the best locations for users who want to relax and socialize.

[0168] The terminal receives information from the server and displays available locations to the user. The user can select a location through the terminal and complete a reservation online. Furthermore, the user can pre-select and order menu items, and payment processing is streamlined.

[0169] As a concrete example, consider a scenario where a user is feeling tired and uses this system. The server analyzes the user's emotions through an emotion engine and recommends a cafe with a relaxing environment. The user confirms that there are available seats at the cafe and makes a reservation via the terminal. It is also possible to order a preferred drink before arriving, allowing the user to prepare for a comfortable time.

[0170] An example of a prompt to the generating AI model is, "Recommend the best place to go if the user is feeling relaxed." In this way, the system is designed to provide the optimal experience tailored to the user.

[0171] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0172] Step 1:

[0173] The server collects vacancy information from business locations within the region. It receives API requests as input, retrieving information from a database of business locations. The output is real-time vacancy information, which is recorded in the database. This aggregates the most up-to-date available information to provide to users.

[0174] Step 2:

[0175] The user's terminal displays availability information received from the server. It receives data sent from the server as input. As output, it visually displays a list of business locations on the screen. The user can refer to this list and select a destination.

[0176] Step 3:

[0177] The server analyzes the user's emotional state using an emotion engine. It collects text, voice, and facial expression data from the user as input. Data processing using a generative AI model recognizes the user's current emotional state. Emotional data is generated as output. This allows the system to understand the user's state and enable personalized responses.

[0178] Step 4:

[0179] The server recommends appropriate business locations based on the user's emotional state. It processes emotional data and availability information as input. The output is a list of business locations that match the user's emotional state. This prioritizes providing locations that align with the user's mood.

[0180] Step 5:

[0181] The user selects a business location provided by the server via their terminal and makes a reservation. The user's selection is based on the business location information displayed on the terminal. The output confirms the reservation for the selected business location, and a reservation confirmation message is sent to the user.

[0182] Step 6:

[0183] The server retrieves and provides order information for the restaurant based on the user's reservation. It takes the reservation information as input to retrieve the restaurant's menu. The output presents a suitable order for the user. This allows the user to confirm their preferred order before arrival.

[0184] Step 7:

[0185] The terminal provides a procedure for processing payments based on the order information selected by the user. It processes the user's order details and payment data as input. As output, it displays a payment completion message to inform the user that the transaction is complete.

[0186] Through these processing steps, the entire system proposes an optimal experience to the user that is tailored to their emotions.

[0187] (Application Example 2)

[0188] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".

[0189] Traditional reservation systems do not take into account the user's current emotional state when recommending locations, making it difficult to suggest the most suitable locations and products for the user. Furthermore, there is a need to improve user satisfaction by achieving more sophisticated, emotion-based personalization.

[0190] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0191] In this invention, the server includes means for acquiring information on available seats at business locations within a certain area, means for recognizing the user's emotional state, and means for recommending the most suitable business location to the user based on the emotional state. This enables the recommendation of business locations according to the user's emotional state and personalized product suggestions.

[0192] A "business location" is a specific place that users can visit and where goods or services are provided.

[0193] "Vacancy information" refers to information about the spaces and seats currently available at the business location.

[0194] "Emotion recognition means" refers to technology that analyzes the user's facial expressions, voice, etc., to determine their emotional state at that moment.

[0195] "Method of confirming a reservation" refers to the method by which the user secures the business location they selected and formally confirms their visit.

[0196] "Order information" refers to detailed information about the goods or services that a user intends to purchase or use at a business location.

[0197] "Payment processing" refers to the act of completing the payment for the amount related to the reservation and order using the payment system.

[0198] "Past usage history" refers to records of visits to business locations and product orders that the user has made in the past.

[0199] An "interface" is a screen or input device that allows a user to access and operate a system.

[0200] A system implementing this invention can recommend the most suitable business location according to the user's emotional state and efficiently handle reservations and orders.

[0201] The server first acquires information on available seats at business locations within a given area. The server then transmits this information to a processing unit, which interacts with an emotion recognition system that recognizes the user's emotional state. This emotion recognition system utilizes facial recognition and voice analysis technologies, such as OpenCV or TensorFlow, to analyze emotions from the user's facial expressions and voice. This data is acquired through the user's smartphone camera and microphone.

[0202] The terminal presents the user with a list of the most suitable locations based on transmitted availability information and analyzed sentiment data. Once the user makes a selection from this list, the reservation for the selected location is confirmed via the terminal. Furthermore, based on the user's selection, it's possible to retrieve and provide order information in advance. For example, if the user wants to relax, a quiet cafe might be suggested, allowing them to pre-order their preferred drink from the cafe's menu.

[0203] To streamline these operations, the servers utilize cloud infrastructure such as AWS and GCP, and perform real-time processing using databases such as MySQL® and Firebase. Furthermore, payment processing related to reservations and orders can be completed via an application on the terminal. The terminal interface is designed for ease of use, and the information provided is highly accurate and customized, taking into account past usage history.

[0204] For example, if the emotion engine determines that a user is fatigued, the application will recommend a nearby cafe that offers a quiet environment based on the user's preferences and provide a smooth experience by allowing the user to pre-order a drink before arrival. An example of a prompt when using a generative AI model could be: "Design an application that recommends relaxing cafes to users determined to be fatigued by the emotion engine, and generate a program that provides a list of suitable cafes and a reservation function."

[0205] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0206] Step 1:

[0207] The server retrieves information on available seats at business locations within a given region. The input for this process includes regional information and identification information for each business location. The server queries a database of business locations to retrieve data related to seat availability. It then processes this data to generate real-time updated seat availability information.

[0208] Step 2:

[0209] The user's device activates emotion recognition capabilities and uses its camera and microphone to capture the user's facial expressions and voice. The input consists of camera images and audio data. The device analyzes this data using emotion analysis software such as OpenCV or TensorFlow to determine the user's emotional state (e.g., stress, relaxation). The analysis results are output as emotion data.

[0210] Step 3:

[0211] The server receives acquired vacancy information and user sentiment data as input and recommends the most suitable business location to the user based on this information. The server applies an algorithm that takes into account the characteristics of the business location and the user's past usage history to list business locations that match the user's state. It outputs information about the recommended business locations to send this list to the user's terminal.

[0212] Step 4:

[0213] The user selects a destination from a list of recommended locations displayed on the terminal. Using the user's selection as input, the terminal begins the reservation process for the selected location. The reservation information is sent to the server, and the reservation is confirmed. The server receives this reservation information and records it in its database.

[0214] Step 5:

[0215] The server prepares to take pre-orders for products at the business location based on reservation information. The inputs are reservation information and a list of available products. The server extracts products that the user is likely to like, creates a list for the user to pre-order, and outputs it to the terminal.

[0216] Step 6:

[0217] The user places an order on the terminal, and the terminal sends this information to the server. The server then notifies the business location of this order information and instructs them to prepare. Furthermore, the terminal retrieves information for payment processing and initiates the payment process. It outputs information indicating that the payment has been completed.

[0218] By rapidly performing real-time data processing and providing feedback to the user at each step, the entire process proceeds smoothly.

[0219] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0220] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0221] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0222] [Second Embodiment]

[0223] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0224] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0225] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0226] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0227] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0228] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0229] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0230] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0231] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0232] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0233] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0234] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0235] This invention is a system that utilizes information about restaurants and bars within a specific area to reduce the burden faced by organizers of drinking parties and events. Through this system, users can find restaurants with available seats in real time and easily make reservations and orders. As a result, participants can start their drinking party immediately upon arrival, and restaurants can respond quickly to orders.

[0236] The server connects to reservation APIs for multiple locations within the region to obtain real-time availability information. This ensures that the latest availability information is immediately sent to the user's device. The server also considers user preference data and has a function to suggest recommended locations based on past usage history and preferences. This information is displayed on the user's device, allowing the user to choose a location that suits their preferences.

[0237] The terminal displays a list of service locations received from the server to the user and sends the user's selected location to the server. The user can easily make a reservation through the terminal and even pre-order items from the provided menu. This order data is also transmitted to the service location via the server, ensuring that service is ready upon arrival. The user's payment information is pre-registered, allowing for smooth payment processing.

[0238] For example, if a user is planning a second party in the Shibuya area, the system will immediately retrieve information on available seats and recommend popular izakayas (Japanese pubs) in the area. The user selects a venue and reserves seats for the specified number of people. Furthermore, they can order kushikatsu (deep-fried skewers) and drinks via mobile ordering before arrival, and these will be served immediately upon arrival at the restaurant. This entire process is automated, significantly reducing the burden on the organizer and supporting the smooth running of the event.

[0239] The following describes the processing flow.

[0240] Step 1:

[0241] The server connects to reservation APIs for multiple business locations within a designated area and retrieves real-time availability information. The retrieved information includes the name of the business location, the number of available seats, the location, and business hours, and this information is stored in a database.

[0242] Step 2:

[0243] The server runs an algorithm that recommends the most suitable business location based on the user's past usage history and preferences, and sends the result to the terminal.

[0244] Step 3:

[0245] The terminal displays a list of sales locations received from the server on the user interface. The user reviews the list and selects the sales location they wish to visit.

[0246] Step 4:

[0247] Users make reservations for their chosen business location via their device. They enter the necessary information (number of people, arrival time, etc.) into the reservation form and submit it to the server.

[0248] Step 5:

[0249] The server uses the reservation API for the business location to confirm the reservation based on the reservation information received from the user. After confirming that the reservation was successful, it returns reservation confirmation information to the terminal.

[0250] Step 6:

[0251] The terminal displays a menu of available items for the business location and provides an ordering interface for mobile ordering if necessary. The user orders the desired items and sends this information to the server.

[0252] Step 7:

[0253] The server processes user order information and transmits it to the service location. It provides all the necessary data to facilitate inventory checks and food preparation.

[0254] Step 8:

[0255] The user's device displays a screen for settling the amount related to the order and reservation using registered payment information. Once the user confirms and approves, the device sends the payment information to the server.

[0256] Step 9:

[0257] The server processes the payment through the online payment service and verifies the payment's success. A success notification is sent to the terminal and the business location, and the process is ready.

[0258] (Example 1)

[0259] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0260] Traditionally, organizers of parties and events spent a great deal of time and effort finding a venue that suited the preferences of all participants. Furthermore, they had to manually manage a wide range of processes, including checking availability, making reservations, placing orders in advance, and processing payments. This presented a significant burden while requiring quick responses. To address this, a system was needed that could acquire real-time availability information, suggest venues based on user preferences, and handle reservations, orders, and payments all in one place.

[0261] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0262] In this invention, the server includes means for acquiring vacancy information for multiple business locations within a certain region, means for presenting available business locations to the user based on the vacancy information, and means for analyzing the user's past usage information and recommending business locations. This makes it possible for the organizer to quickly and efficiently carry out all processes from checking vacancies to making reservations, ordering, and paying, without feeling burdened.

[0263] 1. "Within the region" refers to a specific geographical area and indicates information regarding business locations within that area.

[0264] 2. "Business location" refers to a facility or place used for conducting business, and includes restaurants, event venues, etc.

[0265] 3. "Availability information" refers to data regarding the number of available seats and reservation status at business locations.

[0266] 4. "User" refers to an individual or group that uses the system to obtain information about business locations and make reservations or orders.

[0267] 5. "Reservation" refers to the process by which a user secures the use of a specific business location at a designated date and time.

[0268] 6. "Product information" refers to detailed data about the products and services offered at sales offices.

[0269] 7. "Payment processing" refers to the process of completing financial transactions related to reservations or orders.

[0270] 8. "Analysis" refers to the process of examining data and uncovering important information and patterns.

[0271] 9. "Recommendation" refers to the act of suggesting the most suitable sales office based on the user's preferences and usage patterns.

[0272] 10. "Display means" refers to the interface or mechanism that allows users to receive information visually.

[0273] 11. "External digital map service" refers to an external technological platform that provides map-based information and is used to obtain seat availability information.

[0274] As an embodiment of this invention, the following system is constructed.

[0275] The server retrieves availability information from multiple sales offices within a given region via APIs. This utilizes external digital map services and reservation management APIs provided by the sales offices. The server processes the data received from these APIs and stores it in a database, ensuring that the latest availability information is always maintained. Furthermore, the server collects users' past usage information and analyzes it using machine learning algorithms to recommend sales offices that match the user's preferences. This makes it possible to provide personalized suggestions to individual users.

[0276] The terminal displays a list of sales locations sent from the server to the user. This interface utilizes applications developed using advanced frameworks such as React Native and Flutter. Users can select a sales location via the terminal and confirm their reservation by specifying the desired date, time, and number of people. Furthermore, it is possible to place orders in advance from the provided menu, enabling smooth order processing at the sales location.

[0277] The user accesses the system using a terminal and enters a prompt, for example, "I want to find a recommended izakaya in the Shibuya area, reserve a table, and pre-order kushikatsu and beer." This is sent to a generating AI model, which then provides suggestions for the most suitable restaurant and order. This allows the user to efficiently make reservations and orders and receive smooth service upon arrival.

[0278] Through the mechanisms described above, this system reduces the burden on event organizers and enables a fast and efficient reservation and ordering process. This contributes to the success of the event.

[0279] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0280] Step 1:

[0281] The server connects to the reservation API of business locations within the region to obtain vacancy information. At this time, the API endpoint of the business location is provided as input, and the server sends an HTTP request based on this information. The data is received in JSON format, and the vacancy status field is extracted. The server analyzes this information and updates the latest vacancy information in its own database.

[0282] Step 2:

[0283] The server obtains the user's past usage data and analyzes the preferences. As input, the user's past reservation history data is retrieved from the database. The server applies a machine learning algorithm to rank the business locations based on the user's preferences. Through this analysis, a personalized business location list is generated for each user.

[0284] Step 3:

[0285] The terminal presents the business location list sent from the server to the user. As input, it is the recommended business location list received from the server. The terminal displays the list on the user interface and provides functions such as filtering and displaying detailed information. When the user selects a specific business location, selection data is generated.

[0286] Step 4:

[0287] The user makes a reservation for a business location via the terminal. Reservation details such as the desired date and time and the number of people for the selected business location are provided as input, and this information is sent from the terminal to the server. The server processes the input data and finalizes the reservation request to the business location.

[0288] Step 5:

[0289] Users place orders for products in advance through a terminal. They select items from a menu provided on the terminal and enter the quantity. This order information is sent to the server. The server then transfers the order information to the sales office's system, preparing it for immediate service upon arrival.

[0290] Step 6:

[0291] The user's payment process is completed online. The user's payment information is pre-registered as input, and the transaction is executed through the payment platform based on this information. The server confirms that the payment is complete and provides confirmation to the user.

[0292] Through these steps, the system automates the entire process from booking to ordering and payment, providing an efficient experience.

[0293] (Application Example 1)

[0294] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0295] The aim is to alleviate the burden faced by organizers of drinking parties and events. In particular, it is necessary to solve problems in quickly selecting appropriate venues that meet the interests of participants and in smoothly handling reservations, orders, and payments. Furthermore, it is necessary to improve participant satisfaction by establishing a system that allows for prompt delivery of goods upon arrival.

[0296] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0297] In this invention, the server includes means for acquiring information on available seats at business locations within a certain area, means for presenting available business locations to an information terminal based on the available seat information, and means for confirming a reservation for a business location selected by the user. This reduces the burden on the organizer and makes it possible to quickly and easily select and reserve a suitable business location. Furthermore, it can increase the satisfaction of event participants by enabling pre-ordering and prompt delivery of goods, and by facilitating smooth transaction processing.

[0298] A "place of business" refers to a facility or space within a specific area where customers can visit to receive goods or services.

[0299] "Availability information" refers to data that shows the reservation status of seats and spaces within a business premises, indicating whether they are currently available or can be reserved.

[0300] A "user" is a person who searches for, makes reservations for, or places to order business through the system, and is the primary target audience of the system.

[0301] An "information terminal" is a computer or mobile device that users can operate to obtain information on available seats at a business location, enter orders, confirm reservations, and perform other similar actions.

[0302] "Reservation confirmation" refers to the formal acquisition of permission for use of the business location selected by the user for a specific date, time, and conditions.

[0303] "Product order information" refers to data containing details about the products and services offered at the business location, which users can select and specify in advance.

[0304] "Transaction processing" refers to a series of procedures involving the exchange of money and information related to the ordering of goods and the provision of services between a business location and another business location.

[0305] "Analysis" refers to the process of examining a user's past usage history in detail and extracting information based on their interests and preferences.

[0306] The system for realizing this application example can communicate with each other via a server, an information terminal, and a communication network.

[0307] The server is built on a cloud platform such as Amazon Web Services (AWS), and Node.js and Python (such as Flask) operate on it. The server obtains the vacancy information of business locations within the region through an API, analyzes the user's past usage history and preference data, and generates recommended business locations. These information are processed in real time and provided to the user terminal.

[0308] The information terminal is a smartphone or a tablet, and operates on iOS and Android using Flutter. The information terminal presents the business location information received from the server to the user, and provides an interface for the user to confirm the reservation of the selected location. Also, a menu for pre-ordering products is displayed. The user can thus specify products and services before arrival. Through operations from the terminal, the reservation and order information are sent to the server, and preparations on the store side are advanced.

[0309] Payment processing is securely performed via a payment service such as Stripe. The user can quickly complete transactions related to reservation and order information using the pre-registered payment information.

[0310] As a specific example, the user searches for an izakaya in the Shinjuku area using a smartphone, and is presented with recommended locations based on the vacancy information obtained by the server. When the user selects a business location and pre-orders skewers and cocktails, these products are provided simultaneously upon arrival. An example of a prompt sentence is: "Search for vacancy information that can be reserved immediately at an izakaya in the Shinjuku area, list up recommended shops. Further, display a menu for pre-ordering, and create a script to simplify the reservation and payment process."

[0311] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0312] Step 1:

[0313] The server retrieves seat availability information for business locations within a region via an API. It receives a request for regional information as input and queries the API. As output, it retrieves and stores seat availability data in real time.

[0314] Step 2:

[0315] The server analyzes the user's past usage history and preference data. Using the user's past history data as input, it generates an analysis model, such as an AI model, to analyze the user's preferences. The output is a list of recommended business locations.

[0316] Step 3:

[0317] The server sends availability information and recommended locations to the terminal. The server combines the availability information and recommendation list obtained as input and sends the data to the user terminal as output.

[0318] Step 4:

[0319] The terminal displays business location information to the user and accepts reservations. Input is information from the server, and the user selects a business location through the interface. The selected reservation information is sent to the server as output.

[0320] Step 5:

[0321] Users pre-order products through a terminal. Input is based on the provided menu information, and the user selects the products they wish to order. The output is the order information, which is then sent to the server.

[0322] Step 6:

[0323] The server transmits reservation and order information to the business location and instructs them to prepare. The input is reservation and order data from the user, which is passed to the business location's system. The output updates the information at the business location to ensure it is ready.

[0324] Step 7:

[0325] The terminal completes the user's payment processing. The input consists of pre-registered payment information and the order amount, and the transaction is completed via a payment system such as Stripe. The terminal displays the success or failure status to the user as output.

[0326] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0327] This system provides efficient and personalized support for users planning social gatherings and events. In particular, by incorporating an emotion engine, it recognizes the user's current emotional state and recommends venues and products that align with that emotion.

[0328] The server acquires real-time availability information for business locations within a designated area. This information is provided to the user's terminal and displayed as a list of business locations the user can visit. Furthermore, the server has an integrated emotion engine that can recognize the user's emotional state at that moment by analyzing user input, voice, facial expressions, etc.

[0329] The emotional data obtained by the emotion engine is used in the recommendation algorithm for users. For example, when a user is feeling stressed, the system prioritizes recommending business locations with a relaxing environment. Furthermore, customized products and menus may be suggested based on the user's emotions. This allows users to have a more comfortable and satisfying experience.

[0330] The terminal receives information from the server and provides functions for selecting a business location, making reservations, and mobile ordering. Users can easily complete reservations and place pre-orders through the terminal. In addition, special, emotion-based notifications are sent to the user's terminal to help enhance the user experience.

[0331] As a concrete example, consider a scenario where a user uses a device with emotion recognition enabled and uses this system. If the emotion engine determines that the user is tired, the server recommends a relaxing, green cafe and displays information about available seats at that location. The user then makes a reservation at the cafe via their device and orders their preferred drink before arriving, preparing for a peaceful moment.

[0332] Thus, the system of the present invention, by making full use of an emotion engine, achieves a high level of personalization that surpasses conventional reservation systems and provides optimal suggestions to the user.

[0333] The following describes the processing flow.

[0334] Step 1:

[0335] The server connects to reservation APIs for multiple locations within the region to obtain real-time availability information. This ensures that the latest data on available locations is available.

[0336] Step 2:

[0337] The terminal displays a list of business locations on the user interface based on vacancy information received from the server. Users can select locations of interest from the displayed list.

[0338] Step 3:

[0339] The user enables the emotion recognition function on their device. The device uses the camera and microphone to acquire emotions from the user's facial expressions and voice, and sends the emotion data to the server.

[0340] Step 4:

[0341] The server uses an emotion engine to analyze user emotion data. Based on the detected emotions, it selects the most suitable sales locations and products.

[0342] Step 5:

[0343] The server sends recommended locations and product menus to the terminal based on the user's emotions. The terminal then presents these to the user, offering them options for selection.

[0344] Step 6:

[0345] The user selects a recommended business location via the terminal and proceeds with the reservation process. The terminal sends the information entered in the reservation form to the server.

[0346] Step 7:

[0347] The server confirms the reservation for the specified business location based on the reservation data received from the user. Once confirmed, it notifies the terminal.

[0348] Step 8:

[0349] The terminal displays an interface that allows the user to pre-order products from a menu provided to them. The user selects the desired products and completes the order.

[0350] Step 9:

[0351] The server transmits order information to the business location, checks inventory, and prepares the order. It also processes payment information and completes the settlement.

[0352] Step 10:

[0353] The server confirms the completion of the payment and notifies both the user and the business location of the final confirmation of the reservation and order. This ensures a smooth experience for the user.

[0354] (Example 2)

[0355] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0356] Traditional reservation systems have faced challenges in providing personalized recommendations that adapt to the user's current emotional state. Furthermore, there is a need to select business locations that align with the user's desired experience and to streamline the pre-order and payment processing process.

[0357] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0358] In this invention, the server includes means for acquiring information on available seats at business locations within a certain area, means for presenting available business locations to the user based on the available seat information, means for analyzing the user's input data and recognizing their emotional state, and means for recommending business locations based on the emotional state. This makes it possible to recommend the most suitable business location according to the user's emotional state.

[0359] A "place of business" is a specific location where commercial activities take place, and it is a base where users can visit and enjoy goods and services.

[0360] "Vacancy information" refers to data about currently available seats and spaces at a specific business location, and this information is updated in real time.

[0361] A "user" refers to an individual or group that uses this system to make reservations for business locations or obtain information, and is a party that receives support for their decision-making.

[0362] "Emotional state" refers to data that indicates the user's emotions and psychological state, and is the mental state that is analyzed and recognized from the input information.

[0363] "Recommending" refers to the act of suggesting the most suitable option based on the user's preferences and circumstances.

[0364] "Confirming a reservation" is the process of guaranteeing use at the business location selected by the user and securing the right to use seats and services.

[0365] "Order information" refers to data about the details of the products and services selected by the user in advance, and is an instruction sheet provided along with the reservation.

[0366] "Payment processing" refers to the procedure for settling payments related to reservations and orders, and is the process of transferring legitimate payment from the user to the business location.

[0367] This invention is a system that provides personalized recommendations for business locations based on the user's emotional state. The system consists of a server and terminals, each performing a specific function.

[0368] The server collects real-time availability information from business locations within the region. This is done through API requests to a database of business locations. Furthermore, the server is equipped with an emotion engine that analyzes user input data, voice, and facial expressions. The emotion engine uses machine learning frameworks such as TensorFlow and PyTorch and has the capability to recognize emotional states.

[0369] Based on the data obtained by the emotion engine, the server recommends suitable business locations for the user. The recommendation algorithm is designed to take into account the user's emotional state and suggest the best locations for users who want to relax and socialize.

[0370] The terminal receives information from the server and displays available locations to the user. The user can select a location through the terminal and complete a reservation online. Furthermore, the user can pre-select and order menu items, and payment processing is streamlined.

[0371] As a concrete example, consider a scenario where a user is feeling tired and uses this system. The server analyzes the user's emotions through an emotion engine and recommends a cafe with a relaxing environment. The user confirms that there are available seats at the cafe and makes a reservation via the terminal. It is also possible to order a preferred drink before arriving, allowing the user to prepare for a comfortable time.

[0372] An example of a prompt to the generating AI model is, "Recommend the best place to go if the user is feeling relaxed." In this way, the system is designed to provide the optimal experience tailored to the user.

[0373] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0374] Step 1:

[0375] The server collects vacancy information from business locations within the region. It receives API requests as input, retrieving information from a database of business locations. The output is real-time vacancy information, which is recorded in the database. This aggregates the most up-to-date available information to provide to users.

[0376] Step 2:

[0377] The user's terminal displays availability information received from the server. It receives data sent from the server as input. As output, it visually displays a list of business locations on the screen. The user can refer to this list and select a destination.

[0378] Step 3:

[0379] The server analyzes the user's emotional state using an emotion engine. It collects text, voice, and facial expression data from the user as input. Data processing using a generative AI model recognizes the user's current emotional state. Emotional data is generated as output. This allows the system to understand the user's state and enable personalized responses.

[0380] Step 4:

[0381] The server recommends appropriate business locations based on the user's emotional state. It processes emotional data and availability information as input. The output is a list of business locations that match the user's emotional state. This prioritizes providing locations that align with the user's mood.

[0382] Step 5:

[0383] The user selects a business location provided by the server via their terminal and makes a reservation. The user's selection is based on the business location information displayed on the terminal. The output confirms the reservation for the selected business location, and a reservation confirmation message is sent to the user.

[0384] Step 6:

[0385] The server retrieves and provides order information for the restaurant based on the user's reservation. It takes the reservation information as input to retrieve the restaurant's menu. The output presents a suitable order for the user. This allows the user to confirm their preferred order before arrival.

[0386] Step 7:

[0387] The terminal provides a procedure for processing payments based on the order information selected by the user. It processes the user's order details and payment data as input. As output, it displays a payment completion message to inform the user that the transaction is complete.

[0388] Through these processing steps, the entire system proposes an optimal experience to the user that is tailored to their emotions.

[0389] (Application Example 2)

[0390] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0391] Traditional reservation systems do not take into account the user's current emotional state when recommending locations, making it difficult to suggest the most suitable locations and products for the user. Furthermore, there is a need to improve user satisfaction by achieving more sophisticated, emotion-based personalization.

[0392] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0393] In this invention, the server includes means for acquiring information on available seats at business locations within a certain area, means for recognizing the user's emotional state, and means for recommending the most suitable business location to the user based on the emotional state. This enables the recommendation of business locations according to the user's emotional state and personalized product suggestions.

[0394] A "business location" is a specific place that users can visit and where goods or services are provided.

[0395] "Vacancy information" refers to information about the spaces and seats currently available at the business location.

[0396] "Emotion recognition means" refers to technology that analyzes the user's facial expressions, voice, etc., to determine their emotional state at that moment.

[0397] "Method of confirming a reservation" refers to the method by which the user secures the business location they selected and formally confirms their visit.

[0398] "Order information" refers to detailed information about the goods or services that a user intends to purchase or use at a business location.

[0399] "Payment processing" refers to the act of completing the payment for the amount related to the reservation and order using the payment system.

[0400] "Past usage history" refers to records of visits to business locations and product orders that the user has made in the past.

[0401] An "interface" is a screen or input device that allows a user to access and operate a system.

[0402] A system implementing this invention can recommend the most suitable business location according to the user's emotional state and efficiently handle reservations and orders.

[0403] The server first acquires information on available seats at business locations within a given area. The server then transmits this information to a processing unit, which interacts with an emotion recognition system that recognizes the user's emotional state. This emotion recognition system utilizes facial recognition and voice analysis technologies, such as OpenCV or TensorFlow, to analyze emotions from the user's facial expressions and voice. This data is acquired through the user's smartphone camera and microphone.

[0404] The terminal presents the user with a list of the most suitable locations based on transmitted availability information and analyzed sentiment data. Once the user makes a selection from this list, the reservation for the selected location is confirmed via the terminal. Furthermore, based on the user's selection, it's possible to retrieve and provide order information in advance. For example, if the user wants to relax, a quiet cafe might be suggested, allowing them to pre-order their preferred drink from the cafe's menu.

[0405] To streamline these operations, the servers utilize cloud infrastructure such as AWS and GCP, and perform real-time processing using databases such as MySQL and Firebase. Furthermore, payment processing related to reservations and orders can be completed via an application on the terminal. The terminal interface is designed for ease of use, and the information provided is highly accurate and customized, taking into account past usage history.

[0406] For example, if the emotion engine determines that a user is fatigued, the application will recommend a nearby cafe that offers a quiet environment based on the user's preferences and provide a smooth experience by allowing the user to pre-order a drink before arrival. An example of a prompt when using a generative AI model could be: "Design an application that recommends relaxing cafes to users determined to be fatigued by the emotion engine, and generate a program that provides a list of suitable cafes and a reservation function."

[0407] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0408] Step 1:

[0409] The server retrieves information on available seats at business locations within a given region. The input for this process includes regional information and identification information for each business location. The server queries a database of business locations to retrieve data related to seat availability. It then processes this data to generate real-time updated seat availability information.

[0410] Step 2:

[0411] The user's device activates emotion recognition capabilities and uses its camera and microphone to capture the user's facial expressions and voice. The input consists of camera images and audio data. The device analyzes this data using emotion analysis software such as OpenCV or TensorFlow to determine the user's emotional state (e.g., stress, relaxation). The analysis results are output as emotion data.

[0412] Step 3:

[0413] The server receives acquired vacancy information and user sentiment data as input and recommends the most suitable business location to the user based on this information. The server applies an algorithm that takes into account the characteristics of the business location and the user's past usage history to list business locations that match the user's state. It outputs information about the recommended business locations to send this list to the user's terminal.

[0414] Step 4:

[0415] The user selects a destination from a list of recommended locations displayed on the terminal. Using the user's selection as input, the terminal begins the reservation process for the selected location. The reservation information is sent to the server, and the reservation is confirmed. The server receives this reservation information and records it in its database.

[0416] Step 5:

[0417] The server prepares to take pre-orders for products at the business location based on reservation information. The inputs are reservation information and a list of available products. The server extracts products that the user is likely to like, creates a list for the user to pre-order, and outputs it to the terminal.

[0418] Step 6:

[0419] The user places an order on the terminal, and the terminal sends this information to the server. The server then notifies the business location of this order information and instructs them to prepare. Furthermore, the terminal retrieves information for payment processing and initiates the payment process. It outputs information indicating that the payment has been completed.

[0420] By rapidly performing real-time data processing and providing feedback to the user at each step, the entire process proceeds smoothly.

[0421] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0422] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0423] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[0424] [Third Embodiment]

[0425] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[0426] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0427] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0428] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[0429] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0430] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0431] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0432] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0433] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0434] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0435] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0436] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[0437] This invention is a system that utilizes information about restaurants and bars within a specific area to reduce the burden faced by organizers of drinking parties and events. Through this system, users can find restaurants with available seats in real time and easily make reservations and orders. As a result, participants can start their drinking party immediately upon arrival, and restaurants can respond quickly to orders.

[0438] The server connects to reservation APIs for multiple locations within the region to obtain real-time availability information. This ensures that the latest availability information is immediately sent to the user's device. The server also considers user preference data and has a function to suggest recommended locations based on past usage history and preferences. This information is displayed on the user's device, allowing the user to choose a location that suits their preferences.

[0439] The terminal displays a list of service locations received from the server to the user and sends the user's selected location to the server. The user can easily make a reservation through the terminal and even pre-order items from the provided menu. This order data is also transmitted to the service location via the server, ensuring that service is ready upon arrival. The user's payment information is pre-registered, allowing for smooth payment processing.

[0440] For example, if a user is planning a second party in the Shibuya area, the system will immediately retrieve information on available seats and recommend popular izakayas (Japanese pubs) in the area. The user selects a venue and reserves seats for the specified number of people. Furthermore, they can order kushikatsu (deep-fried skewers) and drinks via mobile ordering before arrival, and these will be served immediately upon arrival at the restaurant. This entire process is automated, significantly reducing the burden on the organizer and supporting the smooth running of the event.

[0441] The following describes the processing flow.

[0442] Step 1:

[0443] The server connects to reservation APIs for multiple business locations within a designated area and retrieves real-time availability information. The retrieved information includes the name of the business location, the number of available seats, the location, and business hours, and this information is stored in a database.

[0444] Step 2:

[0445] The server runs an algorithm that recommends the most suitable business location based on the user's past usage history and preferences, and sends the result to the terminal.

[0446] Step 3:

[0447] The terminal displays a list of sales locations received from the server on the user interface. The user reviews the list and selects the sales location they wish to visit.

[0448] Step 4:

[0449] Users make reservations for their chosen business location via their device. They enter the necessary information (number of people, arrival time, etc.) into the reservation form and submit it to the server.

[0450] Step 5:

[0451] The server uses the reservation API for the business location to confirm the reservation based on the reservation information received from the user. After confirming that the reservation was successful, it returns reservation confirmation information to the terminal.

[0452] Step 6:

[0453] The terminal displays a menu of available items for the business location and provides an ordering interface for mobile ordering if necessary. The user orders the desired items and sends this information to the server.

[0454] Step 7:

[0455] The server processes user order information and transmits it to the service location. It provides all the necessary data to facilitate inventory checks and food preparation.

[0456] Step 8:

[0457] The user's device displays a screen for settling the amount related to the order and reservation using registered payment information. Once the user confirms and approves, the device sends the payment information to the server.

[0458] Step 9:

[0459] The server processes the payment through the online payment service and verifies the payment's success. A success notification is sent to the terminal and the business location, and the process is ready.

[0460] (Example 1)

[0461] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0462] Traditionally, organizers of parties and events spent a great deal of time and effort finding a venue that suited the preferences of all participants. Furthermore, they had to manually manage a wide range of processes, including checking availability, making reservations, placing orders in advance, and processing payments. This presented a significant burden while requiring quick responses. To address this, a system was needed that could acquire real-time availability information, suggest venues based on user preferences, and handle reservations, orders, and payments all in one place.

[0463] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0464] In this invention, the server includes means for acquiring vacancy information for multiple business locations within a certain region, means for presenting available business locations to the user based on the vacancy information, and means for analyzing the user's past usage information and recommending business locations. This makes it possible for the organizer to quickly and efficiently carry out all processes from checking vacancies to making reservations, ordering, and paying, without feeling burdened.

[0465] 1. "Within the region" refers to a specific geographical area and indicates information regarding business locations within that area.

[0466] 2. "Business location" refers to a facility or place used for conducting business, and includes restaurants, event venues, etc.

[0467] 3. "Availability information" refers to data regarding the number of available seats and reservation status at business locations.

[0468] 4. "User" refers to an individual or group that uses the system to obtain information about business locations and make reservations or orders.

[0469] 5. "Reservation" refers to the process by which a user secures the use of a specific business location at a designated date and time.

[0470] 6. "Product information" refers to detailed data about the products and services offered at sales offices.

[0471] 7. "Payment processing" refers to the process of completing financial transactions related to reservations or orders.

[0472] 8. "Analysis" refers to the process of examining data and uncovering important information and patterns.

[0473] 9. "Recommendation" refers to the act of suggesting the most suitable sales office based on the user's preferences and usage patterns.

[0474] 10. "Display means" refers to the interface or mechanism that allows users to receive information visually.

[0475] 11. "External digital map service" refers to an external technological platform that provides map-based information and is used to obtain seat availability information.

[0476] As an embodiment of this invention, the following system is constructed.

[0477] The server retrieves availability information from multiple sales offices within a given region via APIs. This utilizes external digital map services and reservation management APIs provided by the sales offices. The server processes the data received from these APIs and stores it in a database, ensuring that the latest availability information is always maintained. Furthermore, the server collects users' past usage information and analyzes it using machine learning algorithms to recommend sales offices that match the user's preferences. This makes it possible to provide personalized suggestions to individual users.

[0478] The terminal displays a list of sales locations sent from the server to the user. This interface utilizes applications developed using advanced frameworks such as React Native and Flutter. Users can select a sales location via the terminal and confirm their reservation by specifying the desired date, time, and number of people. Furthermore, it is possible to place orders in advance from the provided menu, enabling smooth order processing at the sales location.

[0479] The user accesses the system using a terminal and enters a prompt, for example, "I want to find a recommended izakaya in the Shibuya area, reserve a table, and pre-order kushikatsu and beer." This is sent to a generating AI model, which then provides suggestions for the most suitable restaurant and order. This allows the user to efficiently make reservations and orders and receive smooth service upon arrival.

[0480] Through the mechanisms described above, this system reduces the burden on event organizers and enables a fast and efficient reservation and ordering process. This contributes to the success of the event.

[0481] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0482] Step 1:

[0483] The server connects to the reservation APIs of local sales offices to retrieve seat availability information. The API endpoints of the sales offices are provided as input, and the server sends an HTTP request based on this information. The data is received in JSON format, and the seat availability field is extracted. The server parses this information and updates its own database with the latest seat availability information.

[0484] Step 2:

[0485] The server retrieves the user's past usage data and analyzes their preferences. As input, the user's past booking history data is retrieved from the database. The server applies machine learning algorithms to rank sales offices based on the user's preferences. This analysis generates a personalized list of sales offices for each user.

[0486] Step 3:

[0487] The terminal presents the user with a list of sales offices sent from the server. The input is a list of recommended sales offices received from the server. The terminal displays the list in a user interface and provides filtering and detailed information display functions. When the user selects a specific sales office, selection data is generated.

[0488] Step 4:

[0489] Users make reservations at sales offices via their terminals. They provide reservation details such as the desired date, time, and number of people for the selected sales office, and this information is sent from the terminal to the server. The server processes the input data and confirms the reservation request for the sales office.

[0490] Step 5:

[0491] Users place orders for products in advance through a terminal. They select items from a menu provided on the terminal and enter the quantity. This order information is sent to the server. The server then transfers the order information to the sales office's system, preparing it for immediate service upon arrival.

[0492] Step 6:

[0493] The user's payment process is completed online. The user's payment information is pre-registered as input, and the transaction is executed through the payment platform based on this information. The server confirms that the payment is complete and provides confirmation to the user.

[0494] Through these steps, the system automates the entire process from booking to ordering and payment, providing an efficient experience.

[0495] (Application Example 1)

[0496] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0497] The aim is to alleviate the burden faced by organizers of drinking parties and events. In particular, it is necessary to solve problems in quickly selecting appropriate venues that meet the interests of participants and in smoothly handling reservations, orders, and payments. Furthermore, it is necessary to improve participant satisfaction by establishing a system that allows for prompt delivery of goods upon arrival.

[0498] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0499] In this invention, the server includes means for acquiring information on available seats at business locations within a certain area, means for presenting available business locations to an information terminal based on the available seat information, and means for confirming a reservation for a business location selected by the user. This reduces the burden on the organizer and makes it possible to quickly and easily select and reserve a suitable business location. Furthermore, it can increase the satisfaction of event participants by enabling pre-ordering and prompt delivery of goods, and by facilitating smooth transaction processing.

[0500] A "place of business" refers to a facility or space within a specific area where customers can visit to receive goods or services.

[0501] "Availability information" refers to data that shows the reservation status of seats and spaces within a business premises, indicating whether they are currently available or can be reserved.

[0502] A "user" is a person who searches for, makes reservations for, or places to order business through the system, and is the primary target audience of the system.

[0503] An "information terminal" is a computer or mobile device that users can operate to obtain information on available seats at a business location, enter orders, confirm reservations, and perform other similar actions.

[0504] "Reservation confirmation" refers to the formal acquisition of permission for use of the business location selected by the user for a specific date, time, and conditions.

[0505] "Product order information" refers to data containing details about the products and services offered at the business location, which users can select and specify in advance.

[0506] "Transaction processing" refers to a series of procedures involving the exchange of money and information related to the ordering of goods and the provision of services between a business location and another business location.

[0507] "Analysis" refers to the process of examining a user's past usage history in detail and extracting information based on their interests and preferences.

[0508] The system used to realize this application example can communicate with each other via servers, information terminals, and a communication network.

[0509] The servers are built on cloud platforms such as Amazon Web Services (AWS) and run Node.js and Python (including Flask). The servers retrieve information on available seats at local locations via APIs, analyze users' past usage history and preference data, and generate recommended locations. This information is processed in real time and provided to the user's device.

[0510] The information terminal is a smartphone or tablet, running on iOS and Android using Flutter. The terminal displays location information received from the server to the user and provides an interface for confirming reservations at the selected location. It also displays a menu for pre-ordering items, allowing users to specify products and services before arrival. Operation from the terminal sends reservation and order information to the server, allowing the store to prepare accordingly.

[0511] Payment processing is handled securely through payment services such as Stripe. Users can quickly complete transactions related to reservations and orders using their pre-registered payment information.

[0512] As a concrete example, a user searches for an izakaya (Japanese pub) in the Shinjuku area using their smartphone, and the server suggests recommended locations based on available seating information. The user selects a location and pre-orders kushikatsu (deep-fried skewers) and cocktails, which are then served upon arrival. An example of a prompt message is: "Search for available seating at izakayas in the Shinjuku area that can be booked immediately, and list recommended establishments. Additionally, create a script that displays pre-orderable menu items and simplifies the booking and payment process."

[0513] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0514] Step 1:

[0515] The server retrieves seat availability information for business locations within a region via an API. It receives a request for regional information as input and queries the API. As output, it retrieves and stores seat availability data in real time.

[0516] Step 2:

[0517] The server analyzes the user's past usage history and preference data. Using the user's past history data as input, it generates an analysis model, such as an AI model, to analyze the user's preferences. The output is a list of recommended business locations.

[0518] Step 3:

[0519] The server sends availability information and recommended locations to the terminal. The server combines the availability information and recommendation list obtained as input and sends the data to the user terminal as output.

[0520] Step 4:

[0521] The terminal displays business location information to the user and accepts reservations. Input is information from the server, and the user selects a business location through the interface. The selected reservation information is sent to the server as output.

[0522] Step 5:

[0523] Users pre-order products through a terminal. Input is based on the provided menu information, and the user selects the products they wish to order. The output is the order information, which is then sent to the server.

[0524] Step 6:

[0525] The server transmits reservation and order information to the business location and instructs them to prepare. The input is reservation and order data from the user, which is passed to the business location's system. The output updates the information at the business location to ensure it is ready.

[0526] Step 7:

[0527] The terminal completes the user's payment processing. The input consists of pre-registered payment information and the order amount, and the transaction is completed via a payment system such as Stripe. The terminal displays the success or failure status to the user as output.

[0528] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0529] This system provides efficient and personalized support for users planning social gatherings and events. In particular, by incorporating an emotion engine, it recognizes the user's current emotional state and recommends venues and products that align with that emotion.

[0530] The server acquires real-time availability information for business locations within a designated area. This information is provided to the user's terminal and displayed as a list of business locations the user can visit. Furthermore, the server has an integrated emotion engine that can recognize the user's emotional state at that moment by analyzing user input, voice, facial expressions, etc.

[0531] The emotional data obtained by the emotion engine is used in the recommendation algorithm for users. For example, when a user is feeling stressed, the system prioritizes recommending business locations with a relaxing environment. Furthermore, customized products and menus may be suggested based on the user's emotions. This allows users to have a more comfortable and satisfying experience.

[0532] The terminal receives information from the server and provides functions for selecting a business location, making reservations, and mobile ordering. Users can easily complete reservations and place pre-orders through the terminal. In addition, special, emotion-based notifications are sent to the user's terminal to help enhance the user experience.

[0533] As a concrete example, consider a scenario where a user uses a device with emotion recognition enabled and uses this system. If the emotion engine determines that the user is tired, the server recommends a relaxing, green cafe and displays information about available seats at that location. The user then makes a reservation at the cafe via their device and orders their preferred drink before arriving, preparing for a peaceful moment.

[0534] Thus, the system of the present invention, by making full use of an emotion engine, achieves a high level of personalization that surpasses conventional reservation systems and provides optimal suggestions to the user.

[0535] The following describes the processing flow.

[0536] Step 1:

[0537] The server connects to reservation APIs for multiple locations within the region to obtain real-time availability information. This ensures that the latest data on available locations is available.

[0538] Step 2:

[0539] The terminal displays a list of business locations on the user interface based on vacancy information received from the server. Users can select locations of interest from the displayed list.

[0540] Step 3:

[0541] The user enables the emotion recognition function on their device. The device uses the camera and microphone to acquire emotions from the user's facial expressions and voice, and sends the emotion data to the server.

[0542] Step 4:

[0543] The server uses an emotion engine to analyze user emotion data. Based on the detected emotions, it selects the most suitable sales locations and products.

[0544] Step 5:

[0545] The server sends recommended locations and product menus to the terminal based on the user's emotions. The terminal then presents these to the user, offering them options for selection.

[0546] Step 6:

[0547] The user selects a recommended business location via the terminal and proceeds with the reservation process. The terminal sends the information entered in the reservation form to the server.

[0548] Step 7:

[0549] The server confirms the reservation for the specified business location based on the reservation data received from the user. Once confirmed, it notifies the terminal.

[0550] Step 8:

[0551] The terminal displays an interface that allows the user to pre-order products from a menu provided to them. The user selects the desired products and completes the order.

[0552] Step 9:

[0553] The server transmits order information to the business location, checks inventory, and prepares the order. It also processes payment information and completes the settlement.

[0554] Step 10:

[0555] The server confirms the completion of the payment and notifies both the user and the business location of the final confirmation of the reservation and order. This ensures a smooth experience for the user.

[0556] (Example 2)

[0557] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0558] Traditional reservation systems have faced challenges in providing personalized recommendations that adapt to the user's current emotional state. Furthermore, there is a need to select business locations that align with the user's desired experience and to streamline the pre-order and payment processing process.

[0559] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0560] In this invention, the server includes means for acquiring information on available seats at business locations within a certain area, means for presenting available business locations to the user based on the available seat information, means for analyzing the user's input data and recognizing their emotional state, and means for recommending business locations based on the emotional state. This makes it possible to recommend the most suitable business location according to the user's emotional state.

[0561] A "place of business" is a specific location where commercial activities take place, and it is a base where users can visit and enjoy goods and services.

[0562] "Vacancy information" refers to data about currently available seats and spaces at a specific business location, and this information is updated in real time.

[0563] A "user" refers to an individual or group that uses this system to make reservations for business locations or obtain information, and is a party that receives support for their decision-making.

[0564] "Emotional state" refers to data that indicates the user's emotions and psychological state, and is the mental state that is analyzed and recognized from the input information.

[0565] "Recommending" refers to the act of suggesting the most suitable option based on the user's preferences and circumstances.

[0566] "Confirming a reservation" is the process of guaranteeing use at the business location selected by the user and securing the right to use seats and services.

[0567] "Order information" refers to data about the details of the products and services selected by the user in advance, and is an instruction sheet provided along with the reservation.

[0568] "Payment processing" refers to the procedure for settling payments related to reservations and orders, and is the process of transferring legitimate payment from the user to the business location.

[0569] This invention is a system that provides personalized recommendations for business locations based on the user's emotional state. The system consists of a server and terminals, each performing a specific function.

[0570] The server collects real-time availability information from business locations within the region. This is done through API requests to a database of business locations. Furthermore, the server is equipped with an emotion engine that analyzes user input data, voice, and facial expressions. The emotion engine uses machine learning frameworks such as TensorFlow and PyTorch and has the capability to recognize emotional states.

[0571] Based on the data obtained by the emotion engine, the server recommends suitable business locations for the user. The recommendation algorithm is designed to take into account the user's emotional state and suggest the best locations for users who want to relax and socialize.

[0572] The terminal receives information from the server and displays available locations to the user. The user can select a location through the terminal and complete a reservation online. Furthermore, the user can pre-select and order menu items, and payment processing is streamlined.

[0573] As a concrete example, consider a scenario where a user is feeling tired and uses this system. The server analyzes the user's emotions through an emotion engine and recommends a cafe with a relaxing environment. The user confirms that there are available seats at the cafe and makes a reservation via the terminal. It is also possible to order a preferred drink before arriving, allowing the user to prepare for a comfortable time.

[0574] An example of a prompt to the generating AI model is, "Recommend the best place to go if the user is feeling relaxed." In this way, the system is designed to provide the optimal experience tailored to the user.

[0575] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0576] Step 1:

[0577] The server collects vacancy information from business locations within the region. It receives API requests as input, retrieving information from a database of business locations. The output is real-time vacancy information, which is recorded in the database. This aggregates the most up-to-date available information to provide to users.

[0578] Step 2:

[0579] The user's terminal displays availability information received from the server. It receives data sent from the server as input. As output, it visually displays a list of business locations on the screen. The user can refer to this list and select a destination.

[0580] Step 3:

[0581] The server analyzes the user's emotional state using an emotion engine. It collects text, voice, and facial expression data from the user as input. Data processing using a generative AI model recognizes the user's current emotional state. Emotional data is generated as output. This allows the system to understand the user's state and enable personalized responses.

[0582] Step 4:

[0583] The server recommends appropriate business locations based on the user's emotional state. It processes emotional data and availability information as input. The output is a list of business locations that match the user's emotional state. This prioritizes providing locations that align with the user's mood.

[0584] Step 5:

[0585] The user selects a business location provided by the server via their terminal and makes a reservation. The user's selection is based on the business location information displayed on the terminal. The output confirms the reservation for the selected business location, and a reservation confirmation message is sent to the user.

[0586] Step 6:

[0587] The server retrieves and provides order information for the restaurant based on the user's reservation. It takes the reservation information as input to retrieve the restaurant's menu. The output presents a suitable order for the user. This allows the user to confirm their preferred order before arrival.

[0588] Step 7:

[0589] The terminal provides a procedure for processing payments based on the order information selected by the user. It processes the user's order details and payment data as input. As output, it displays a payment completion message to inform the user that the transaction is complete.

[0590] Through these processing steps, the entire system proposes an optimal experience to the user that is tailored to their emotions.

[0591] (Application Example 2)

[0592] Next, we will explain Application Example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0593] Traditional reservation systems do not take into account the user's current emotional state when recommending locations, making it difficult to suggest the most suitable locations and products for the user. Furthermore, there is a need to improve user satisfaction by achieving more sophisticated, emotion-based personalization.

[0594] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0595] In this invention, the server includes means for acquiring information on available seats at business locations within a certain area, means for recognizing the user's emotional state, and means for recommending the most suitable business location to the user based on the emotional state. This enables the recommendation of business locations according to the user's emotional state and personalized product suggestions.

[0596] A "business location" is a specific place that users can visit and where goods or services are provided.

[0597] "Vacancy information" refers to information about the spaces and seats currently available at the business location.

[0598] "Emotion recognition means" refers to technology that analyzes the user's facial expressions, voice, etc., to determine their emotional state at that moment.

[0599] "Method of confirming a reservation" refers to the method by which the user secures the business location they selected and formally confirms their visit.

[0600] "Order information" refers to detailed information about the goods or services that a user intends to purchase or use at a business location.

[0601] "Payment processing" refers to the act of completing the payment for the amount related to the reservation and order using the payment system.

[0602] "Past usage history" refers to records of visits to business locations and product orders that the user has made in the past.

[0603] An "interface" is a screen or input device that allows a user to access and operate a system.

[0604] A system implementing this invention can recommend the most suitable business location according to the user's emotional state and efficiently handle reservations and orders.

[0605] The server first acquires information on available seats at business locations within a given area. The server then transmits this information to a processing unit, which interacts with an emotion recognition system that recognizes the user's emotional state. This emotion recognition system utilizes facial recognition and voice analysis technologies, such as OpenCV or TensorFlow, to analyze emotions from the user's facial expressions and voice. This data is acquired through the user's smartphone camera and microphone.

[0606] The terminal presents the user with a list of the most suitable locations based on transmitted availability information and analyzed sentiment data. Once the user makes a selection from this list, the reservation for the selected location is confirmed via the terminal. Furthermore, based on the user's selection, it's possible to retrieve and provide order information in advance. For example, if the user wants to relax, a quiet cafe might be suggested, allowing them to pre-order their preferred drink from the cafe's menu.

[0607] To streamline these operations, the servers utilize cloud infrastructure such as AWS and GCP, and perform real-time processing using databases such as MySQL and Firebase. Furthermore, payment processing related to reservations and orders can be completed via an application on the terminal. The terminal interface is designed for ease of use, and the information provided is highly accurate and customized, taking into account past usage history.

[0608] For example, if the emotion engine determines that a user is fatigued, the application will recommend a nearby cafe that offers a quiet environment based on the user's preferences and provide a smooth experience by allowing the user to pre-order a drink before arrival. An example of a prompt when using a generative AI model could be: "Design an application that recommends relaxing cafes to users determined to be fatigued by the emotion engine, and generate a program that provides a list of suitable cafes and a reservation function."

[0609] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0610] Step 1:

[0611] The server retrieves information on available seats at business locations within a given region. The input for this process includes regional information and identification information for each business location. The server queries a database of business locations to retrieve data related to seat availability. It then processes this data to generate real-time updated seat availability information.

[0612] Step 2:

[0613] The user's device activates emotion recognition capabilities and uses its camera and microphone to capture the user's facial expressions and voice. The input consists of camera images and audio data. The device analyzes this data using emotion analysis software such as OpenCV or TensorFlow to determine the user's emotional state (e.g., stress, relaxation). The analysis results are output as emotion data.

[0614] Step 3:

[0615] The server receives acquired vacancy information and user sentiment data as input and recommends the most suitable business location to the user based on this information. The server applies an algorithm that takes into account the characteristics of the business location and the user's past usage history to list business locations that match the user's state. It outputs information about the recommended business locations to send this list to the user's terminal.

[0616] Step 4:

[0617] The user selects a destination from a list of recommended locations displayed on the terminal. Using the user's selection as input, the terminal begins the reservation process for the selected location. The reservation information is sent to the server, and the reservation is confirmed. The server receives this reservation information and records it in its database.

[0618] Step 5:

[0619] The server prepares to take pre-orders for products at the business location based on reservation information. The inputs are reservation information and a list of available products. The server extracts products that the user is likely to like, creates a list for the user to pre-order, and outputs it to the terminal.

[0620] Step 6:

[0621] The user places an order on the terminal, and the terminal sends this information to the server. The server then notifies the business location of this order information and instructs them to prepare. Furthermore, the terminal retrieves information for payment processing and initiates the payment process. It outputs information indicating that the payment has been completed.

[0622] By rapidly performing real-time data processing and providing feedback to the user at each step, the entire process proceeds smoothly.

[0623] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0624] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0625] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[0626] [Fourth Embodiment]

[0627] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[0628] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[0629] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0630] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[0631] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0632] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0633] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0634] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[0635] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0636] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0637] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0638] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0639] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0640] This invention is a system that utilizes information about restaurants and bars within a specific area to reduce the burden faced by organizers of drinking parties and events. Through this system, users can find restaurants with available seats in real time and easily make reservations and orders. As a result, participants can start their drinking party immediately upon arrival, and restaurants can respond quickly to orders.

[0641] The server connects to reservation APIs for multiple locations within the region to obtain real-time availability information. This ensures that the latest availability information is immediately sent to the user's device. The server also considers user preference data and has a function to suggest recommended locations based on past usage history and preferences. This information is displayed on the user's device, allowing the user to choose a location that suits their preferences.

[0642] The terminal displays a list of service locations received from the server to the user and sends the user's selected location to the server. The user can easily make a reservation through the terminal and even pre-order items from the provided menu. This order data is also transmitted to the service location via the server, ensuring that service is ready upon arrival. The user's payment information is pre-registered, allowing for smooth payment processing.

[0643] For example, if a user is planning a second party in the Shibuya area, the system will immediately retrieve information on available seats and recommend popular izakayas (Japanese pubs) in the area. The user selects a venue and reserves seats for the specified number of people. Furthermore, they can order kushikatsu (deep-fried skewers) and drinks via mobile ordering before arrival, and these will be served immediately upon arrival at the restaurant. This entire process is automated, significantly reducing the burden on the organizer and supporting the smooth running of the event.

[0644] The following describes the processing flow.

[0645] Step 1:

[0646] The server connects to reservation APIs for multiple business locations within a designated area and retrieves real-time availability information. The retrieved information includes the name of the business location, the number of available seats, the location, and business hours, and this information is stored in a database.

[0647] Step 2:

[0648] The server runs an algorithm that recommends the most suitable business location based on the user's past usage history and preferences, and sends the result to the terminal.

[0649] Step 3:

[0650] The terminal displays a list of sales locations received from the server on the user interface. The user reviews the list and selects the sales location they wish to visit.

[0651] Step 4:

[0652] Users make reservations for their chosen business location via their device. They enter the necessary information (number of people, arrival time, etc.) into the reservation form and submit it to the server.

[0653] Step 5:

[0654] The server uses the reservation API for the business location to confirm the reservation based on the reservation information received from the user. After confirming that the reservation was successful, it returns reservation confirmation information to the terminal.

[0655] Step 6:

[0656] The terminal displays a menu of available items for the business location and provides an ordering interface for mobile ordering if necessary. The user orders the desired items and sends this information to the server.

[0657] Step 7:

[0658] The server processes user order information and transmits it to the service location. It provides all the necessary data to facilitate inventory checks and food preparation.

[0659] Step 8:

[0660] The user's device displays a screen for settling the amount related to the order and reservation using registered payment information. Once the user confirms and approves, the device sends the payment information to the server.

[0661] Step 9:

[0662] The server processes the payment through the online payment service and verifies the payment's success. A success notification is sent to the terminal and the business location, and the process is ready.

[0663] (Example 1)

[0664] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0665] Traditionally, organizers of parties and events spent a great deal of time and effort finding a venue that suited the preferences of all participants. Furthermore, they had to manually manage a wide range of processes, including checking availability, making reservations, placing orders in advance, and processing payments. This presented a significant burden while requiring quick responses. To address this, a system was needed that could acquire real-time availability information, suggest venues based on user preferences, and handle reservations, orders, and payments all in one place.

[0666] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0667] In this invention, the server includes means for acquiring vacancy information for multiple business locations within a certain region, means for presenting available business locations to the user based on the vacancy information, and means for analyzing the user's past usage information and recommending business locations. This makes it possible for the organizer to quickly and efficiently carry out all processes from checking vacancies to making reservations, ordering, and paying, without feeling burdened.

[0668] 1. "Within the region" refers to a specific geographical area and indicates information regarding business locations within that area.

[0669] 2. "Business location" refers to a facility or place used for conducting business, and includes restaurants, event venues, etc.

[0670] 3. "Availability information" refers to data regarding the number of available seats and reservation status at business locations.

[0671] 4. "User" refers to an individual or group that uses the system to obtain information about business locations and make reservations or orders.

[0672] 5. "Reservation" refers to the process by which a user secures the use of a specific business location at a designated date and time.

[0673] 6. "Product information" refers to detailed data about the products and services offered at sales offices.

[0674] 7. "Payment processing" refers to the process of completing financial transactions related to reservations or orders.

[0675] 8. "Analysis" refers to the process of examining data and uncovering important information and patterns.

[0676] 9. "Recommendation" refers to the act of suggesting the most suitable sales office based on the user's preferences and usage patterns.

[0677] 10. "Display means" refers to the interface or mechanism that allows users to receive information visually.

[0678] 11. "External digital map service" refers to an external technological platform that provides map-based information and is used to obtain seat availability information.

[0679] As an embodiment of this invention, the following system is constructed.

[0680] The server retrieves availability information from multiple sales offices within a given region via APIs. This utilizes external digital map services and reservation management APIs provided by the sales offices. The server processes the data received from these APIs and stores it in a database, ensuring that the latest availability information is always maintained. Furthermore, the server collects users' past usage information and analyzes it using machine learning algorithms to recommend sales offices that match the user's preferences. This makes it possible to provide personalized suggestions to individual users.

[0681] The terminal displays a list of sales locations sent from the server to the user. This interface utilizes applications developed using advanced frameworks such as React Native and Flutter. Users can select a sales location via the terminal and confirm their reservation by specifying the desired date, time, and number of people. Furthermore, it is possible to place orders in advance from the provided menu, enabling smooth order processing at the sales location.

[0682] The user accesses the system using a terminal and enters a prompt, for example, "I want to find a recommended izakaya in the Shibuya area, reserve a table, and pre-order kushikatsu and beer." This is sent to a generating AI model, which then provides suggestions for the most suitable restaurant and order. This allows the user to efficiently make reservations and orders and receive smooth service upon arrival.

[0683] Through the mechanisms described above, this system reduces the burden on event organizers and enables a fast and efficient reservation and ordering process. This contributes to the success of the event.

[0684] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0685] Step 1:

[0686] The server connects to the reservation APIs of local sales offices to retrieve seat availability information. The API endpoints of the sales offices are provided as input, and the server sends an HTTP request based on this information. The data is received in JSON format, and the seat availability field is extracted. The server parses this information and updates its own database with the latest seat availability information.

[0687] Step 2:

[0688] The server retrieves the user's past usage data and analyzes their preferences. As input, the user's past booking history data is retrieved from the database. The server applies machine learning algorithms to rank sales offices based on the user's preferences. This analysis generates a personalized list of sales offices for each user.

[0689] Step 3:

[0690] The terminal presents the user with a list of sales offices sent from the server. The input is a list of recommended sales offices received from the server. The terminal displays the list in a user interface and provides filtering and detailed information display functions. When the user selects a specific sales office, selection data is generated.

[0691] Step 4:

[0692] Users make reservations at sales offices via their terminals. They provide reservation details such as the desired date, time, and number of people for the selected sales office, and this information is sent from the terminal to the server. The server processes the input data and confirms the reservation request for the sales office.

[0693] Step 5:

[0694] Users place orders for products in advance through a terminal. They select items from a menu provided on the terminal and enter the quantity. This order information is sent to the server. The server then transfers the order information to the sales office's system, preparing it for immediate service upon arrival.

[0695] Step 6:

[0696] The user's payment process is completed online. The user's payment information is pre-registered as input, and the transaction is executed through the payment platform based on this information. The server confirms that the payment is complete and provides confirmation to the user.

[0697] Through these steps, the system automates the entire process from booking to ordering and payment, providing an efficient experience.

[0698] (Application Example 1)

[0699] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0700] The aim is to alleviate the burden faced by organizers of drinking parties and events. In particular, it is necessary to solve problems in quickly selecting appropriate venues that meet the interests of participants and in smoothly handling reservations, orders, and payments. Furthermore, it is necessary to improve participant satisfaction by establishing a system that allows for prompt delivery of goods upon arrival.

[0701] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0702] In this invention, the server includes means for acquiring information on available seats at business locations within a certain area, means for presenting available business locations to an information terminal based on the available seat information, and means for confirming a reservation for a business location selected by the user. This reduces the burden on the organizer and makes it possible to quickly and easily select and reserve a suitable business location. Furthermore, it can increase the satisfaction of event participants by enabling pre-ordering and prompt delivery of goods, and by facilitating smooth transaction processing.

[0703] A "place of business" refers to a facility or space within a specific area where customers can visit to receive goods or services.

[0704] "Availability information" refers to data that shows the reservation status of seats and spaces within a business premises, indicating whether they are currently available or can be reserved.

[0705] A "user" is a person who searches for, makes reservations for, or places to order business through the system, and is the primary target audience of the system.

[0706] An "information terminal" is a computer or mobile device that users can operate to obtain information on available seats at a business location, enter orders, confirm reservations, and perform other similar actions.

[0707] "Reservation confirmation" refers to the formal acquisition of permission for use of the business location selected by the user for a specific date, time, and conditions.

[0708] "Product order information" refers to data containing details about the products and services offered at the business location, which users can select and specify in advance.

[0709] "Transaction processing" refers to a series of procedures involving the exchange of money and information related to the ordering of goods and the provision of services between a business location and another business location.

[0710] "Analysis" refers to the process of examining a user's past usage history in detail and extracting information based on their interests and preferences.

[0711] The system used to realize this application example can communicate with each other via servers, information terminals, and a communication network.

[0712] The servers are built on cloud platforms such as Amazon Web Services (AWS) and run Node.js and Python (including Flask). The servers retrieve information on available seats at local locations via APIs, analyze users' past usage history and preference data, and generate recommended locations. This information is processed in real time and provided to the user's device.

[0713] The information terminal is a smartphone or tablet, running on iOS and Android using Flutter. The terminal displays location information received from the server to the user and provides an interface for confirming reservations at the selected location. It also displays a menu for pre-ordering items, allowing users to specify products and services before arrival. Operation from the terminal sends reservation and order information to the server, allowing the store to prepare accordingly.

[0714] Payment processing is handled securely through payment services such as Stripe. Users can quickly complete transactions related to reservations and orders using their pre-registered payment information.

[0715] As a concrete example, a user searches for an izakaya (Japanese pub) in the Shinjuku area using their smartphone, and the server suggests recommended locations based on available seating information. The user selects a location and pre-orders kushikatsu (deep-fried skewers) and cocktails, which are then served upon arrival. An example of a prompt message is: "Search for available seating at izakayas in the Shinjuku area that can be booked immediately, and list recommended establishments. Additionally, create a script that displays pre-orderable menu items and simplifies the booking and payment process."

[0716] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0717] Step 1:

[0718] The server retrieves seat availability information for business locations within a region via an API. It receives a request for regional information as input and queries the API. As output, it retrieves and stores seat availability data in real time.

[0719] Step 2:

[0720] The server analyzes the user's past usage history and preference data. Using the user's past history data as input, it generates an analysis model, such as an AI model, to analyze the user's preferences. The output is a list of recommended business locations.

[0721] Step 3:

[0722] The server sends availability information and recommended locations to the terminal. The server combines the availability information and recommendation list obtained as input and sends the data to the user terminal as output.

[0723] Step 4:

[0724] The terminal displays business location information to the user and accepts reservations. Input is information from the server, and the user selects a business location through the interface. The selected reservation information is sent to the server as output.

[0725] Step 5:

[0726] Users pre-order products through a terminal. Input is based on the provided menu information, and the user selects the products they wish to order. The output is the order information, which is then sent to the server.

[0727] Step 6:

[0728] The server transmits reservation and order information to the business location and instructs them to prepare. The input is reservation and order data from the user, which is passed to the business location's system. The output updates the information at the business location to ensure it is ready.

[0729] Step 7:

[0730] The terminal completes the user's payment processing. The input consists of pre-registered payment information and the order amount, and the transaction is completed via a payment system such as Stripe. The terminal displays the success or failure status to the user as output.

[0731] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0732] This system provides efficient and personalized support for users planning social gatherings and events. In particular, by incorporating an emotion engine, it recognizes the user's current emotional state and recommends venues and products that align with that emotion.

[0733] The server acquires real-time availability information for business locations within a designated area. This information is provided to the user's terminal and displayed as a list of business locations the user can visit. Furthermore, the server has an integrated emotion engine that can recognize the user's emotional state at that moment by analyzing user input, voice, facial expressions, etc.

[0734] The emotional data obtained by the emotion engine is used in the recommendation algorithm for users. For example, when a user is feeling stressed, the system prioritizes recommending business locations with a relaxing environment. Furthermore, customized products and menus may be suggested based on the user's emotions. This allows users to have a more comfortable and satisfying experience.

[0735] The terminal receives information from the server and provides functions for selecting a business location, making reservations, and mobile ordering. Users can easily complete reservations and place pre-orders through the terminal. In addition, special, emotion-based notifications are sent to the user's terminal to help enhance the user experience.

[0736] As a concrete example, consider a scenario where a user uses a device with emotion recognition enabled and uses this system. If the emotion engine determines that the user is tired, the server recommends a relaxing, green cafe and displays information about available seats at that location. The user then makes a reservation at the cafe via their device and orders their preferred drink before arriving, preparing for a peaceful moment.

[0737] Thus, the system of the present invention, by making full use of an emotion engine, achieves a high level of personalization that surpasses conventional reservation systems and provides optimal suggestions to the user.

[0738] The following describes the processing flow.

[0739] Step 1:

[0740] The server connects to reservation APIs for multiple locations within the region to obtain real-time availability information. This ensures that the latest data on available locations is available.

[0741] Step 2:

[0742] The terminal displays a list of business locations on the user interface based on vacancy information received from the server. Users can select locations of interest from the displayed list.

[0743] Step 3:

[0744] The user enables the emotion recognition function on their device. The device uses the camera and microphone to acquire emotions from the user's facial expressions and voice, and sends the emotion data to the server.

[0745] Step 4:

[0746] The server uses an emotion engine to analyze user emotion data. Based on the detected emotions, it selects the most suitable sales locations and products.

[0747] Step 5:

[0748] The server sends recommended locations and product menus to the terminal based on the user's emotions. The terminal then presents these to the user, offering them options for selection.

[0749] Step 6:

[0750] The user selects a recommended business location via the terminal and proceeds with the reservation process. The terminal sends the information entered in the reservation form to the server.

[0751] Step 7:

[0752] The server confirms the reservation for the specified business location based on the reservation data received from the user. Once confirmed, it notifies the terminal.

[0753] Step 8:

[0754] The terminal displays an interface that allows the user to pre-order products from a menu provided to them. The user selects the desired products and completes the order.

[0755] Step 9:

[0756] The server transmits order information to the business location, checks inventory, and prepares the order. It also processes payment information and completes the settlement.

[0757] Step 10:

[0758] The server confirms the completion of the payment and notifies both the user and the business location of the final confirmation of the reservation and order. This ensures a smooth experience for the user.

[0759] (Example 2)

[0760] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0761] Traditional reservation systems have faced challenges in providing personalized recommendations that adapt to the user's current emotional state. Furthermore, there is a need to select business locations that align with the user's desired experience and to streamline the pre-order and payment processing process.

[0762] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0763] In this invention, the server includes means for acquiring information on available seats at business locations within a certain area, means for presenting available business locations to the user based on the available seat information, means for analyzing the user's input data and recognizing their emotional state, and means for recommending business locations based on the emotional state. This makes it possible to recommend the most suitable business location according to the user's emotional state.

[0764] A "place of business" is a specific location where commercial activities take place, and it is a base where users can visit and enjoy goods and services.

[0765] "Vacancy information" refers to data about currently available seats and spaces at a specific business location, and this information is updated in real time.

[0766] A "user" refers to an individual or group that uses this system to make reservations for business locations or obtain information, and is a party that receives support for their decision-making.

[0767] "Emotional state" refers to data that indicates the user's emotions and psychological state, and is the mental state that is analyzed and recognized from the input information.

[0768] "Recommending" refers to the act of suggesting the most suitable option based on the user's preferences and circumstances.

[0769] "Confirming a reservation" is the process of guaranteeing use at the business location selected by the user and securing the right to use seats and services.

[0770] "Order information" refers to data about the details of the products and services selected by the user in advance, and is an instruction sheet provided along with the reservation.

[0771] "Payment processing" refers to the procedure for settling payments related to reservations and orders, and is the process of transferring legitimate payment from the user to the business location.

[0772] This invention is a system that provides personalized recommendations for business locations based on the user's emotional state. The system consists of a server and terminals, each performing a specific function.

[0773] The server collects real-time availability information from business locations within the region. This is done through API requests to a database of business locations. Furthermore, the server is equipped with an emotion engine that analyzes user input data, voice, and facial expressions. The emotion engine uses machine learning frameworks such as TensorFlow and PyTorch and has the capability to recognize emotional states.

[0774] Based on the data obtained by the emotion engine, the server recommends suitable business locations for the user. The recommendation algorithm is designed to take into account the user's emotional state and suggest the best locations for users who want to relax and socialize.

[0775] The terminal receives information from the server and displays available locations to the user. The user can select a location through the terminal and complete a reservation online. Furthermore, the user can pre-select and order menu items, and payment processing is streamlined.

[0776] As a concrete example, consider a scenario where a user is feeling tired and uses this system. The server analyzes the user's emotions through an emotion engine and recommends a cafe with a relaxing environment. The user confirms that there are available seats at the cafe and makes a reservation via the terminal. It is also possible to order a preferred drink before arriving, allowing the user to prepare for a comfortable time.

[0777] An example of a prompt to the generating AI model is, "Recommend the best place to go if the user is feeling relaxed." In this way, the system is designed to provide the optimal experience tailored to the user.

[0778] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0779] Step 1:

[0780] The server collects vacancy information from business locations within the region. It receives API requests as input, retrieving information from a database of business locations. The output is real-time vacancy information, which is recorded in the database. This aggregates the most up-to-date available information to provide to users.

[0781] Step 2:

[0782] The user's terminal displays availability information received from the server. It receives data sent from the server as input. As output, it visually displays a list of business locations on the screen. The user can refer to this list and select a destination.

[0783] Step 3:

[0784] The server analyzes the user's emotional state using an emotion engine. It collects text, voice, and facial expression data from the user as input. Data processing using a generative AI model recognizes the user's current emotional state. Emotional data is generated as output. This allows the system to understand the user's state and enable personalized responses.

[0785] Step 4:

[0786] The server recommends appropriate business locations based on the user's emotional state. It processes emotional data and availability information as input. The output is a list of business locations that match the user's emotional state. This prioritizes providing locations that align with the user's mood.

[0787] Step 5:

[0788] The user selects a business location provided by the server via their terminal and makes a reservation. The user's selection is based on the business location information displayed on the terminal. The output confirms the reservation for the selected business location, and a reservation confirmation message is sent to the user.

[0789] Step 6:

[0790] The server retrieves and provides order information for the restaurant based on the user's reservation. It takes the reservation information as input to retrieve the restaurant's menu. The output presents a suitable order for the user. This allows the user to confirm their preferred order before arrival.

[0791] Step 7:

[0792] The terminal provides a procedure for processing payments based on the order information selected by the user. It processes the user's order details and payment data as input. As output, it displays a payment completion message to inform the user that the transaction is complete.

[0793] Through these processing steps, the entire system proposes an optimal experience to the user that is tailored to their emotions.

[0794] (Application Example 2)

[0795] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0796] Traditional reservation systems do not take into account the user's current emotional state when recommending locations, making it difficult to suggest the most suitable locations and products for the user. Furthermore, there is a need to improve user satisfaction by achieving more sophisticated, emotion-based personalization.

[0797] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0798] In this invention, the server includes means for acquiring information on available seats at business locations within a certain area, means for recognizing the user's emotional state, and means for recommending the most suitable business location to the user based on the emotional state. This enables the recommendation of business locations according to the user's emotional state and personalized product suggestions.

[0799] A "business location" is a specific place that users can visit and where goods or services are provided.

[0800] "Vacancy information" refers to information about the spaces and seats currently available at the business location.

[0801] "Emotion recognition means" refers to technology that analyzes the user's facial expressions, voice, etc., to determine their emotional state at that moment.

[0802] "Method of confirming a reservation" refers to the method by which the user secures the business location they selected and formally confirms their visit.

[0803] "Order information" refers to detailed information about the goods or services that a user intends to purchase or use at a business location.

[0804] "Payment processing" refers to the act of completing the payment for the amount related to the reservation and order using the payment system.

[0805] "Past usage history" refers to records of visits to business locations and product orders that the user has made in the past.

[0806] An "interface" is a screen or input device that allows a user to access and operate a system.

[0807] A system implementing this invention can recommend the most suitable business location according to the user's emotional state and efficiently handle reservations and orders.

[0808] The server first acquires information on available seats at business locations within a given area. The server then transmits this information to a processing unit, which interacts with an emotion recognition system that recognizes the user's emotional state. This emotion recognition system utilizes facial recognition and voice analysis technologies, such as OpenCV or TensorFlow, to analyze emotions from the user's facial expressions and voice. This data is acquired through the user's smartphone camera and microphone.

[0809] The terminal presents the user with a list of the most suitable locations based on transmitted availability information and analyzed sentiment data. Once the user makes a selection from this list, the reservation for the selected location is confirmed via the terminal. Furthermore, based on the user's selection, it's possible to retrieve and provide order information in advance. For example, if the user wants to relax, a quiet cafe might be suggested, allowing them to pre-order their preferred drink from the cafe's menu.

[0810] To streamline these operations, the servers utilize cloud infrastructure such as AWS and GCP, and perform real-time processing using databases such as MySQL and Firebase. Furthermore, payment processing related to reservations and orders can be completed via an application on the terminal. The terminal interface is designed for ease of use, and the information provided is highly accurate and customized, taking into account past usage history.

[0811] For example, if the emotion engine determines that a user is fatigued, the application will recommend a nearby cafe that offers a quiet environment based on the user's preferences and provide a smooth experience by allowing the user to pre-order a drink before arrival. An example of a prompt when using a generative AI model could be: "Design an application that recommends relaxing cafes to users determined to be fatigued by the emotion engine, and generate a program that provides a list of suitable cafes and a reservation function."

[0812] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0813] Step 1:

[0814] The server retrieves information on available seats at business locations within a given region. The input for this process includes regional information and identification information for each business location. The server queries a database of business locations to retrieve data related to seat availability. It then processes this data to generate real-time updated seat availability information.

[0815] Step 2:

[0816] The user's device activates emotion recognition capabilities and uses its camera and microphone to capture the user's facial expressions and voice. The input consists of camera images and audio data. The device analyzes this data using emotion analysis software such as OpenCV or TensorFlow to determine the user's emotional state (e.g., stress, relaxation). The analysis results are output as emotion data.

[0817] Step 3:

[0818] The server receives acquired vacancy information and user sentiment data as input and recommends the most suitable business location to the user based on this information. The server applies an algorithm that takes into account the characteristics of the business location and the user's past usage history to list business locations that match the user's state. It outputs information about the recommended business locations to send this list to the user's terminal.

[0819] Step 4:

[0820] The user selects a destination from a list of recommended locations displayed on the terminal. Using the user's selection as input, the terminal begins the reservation process for the selected location. The reservation information is sent to the server, and the reservation is confirmed. The server receives this reservation information and records it in its database.

[0821] Step 5:

[0822] The server prepares to take pre-orders for products at the business location based on reservation information. The inputs are reservation information and a list of available products. The server extracts products that the user is likely to like, creates a list for the user to pre-order, and outputs it to the terminal.

[0823] Step 6:

[0824] The user places an order on the terminal, and the terminal sends this information to the server. The server then notifies the business location of this order information and instructs them to prepare. Furthermore, the terminal retrieves information for payment processing and initiates the payment process. It outputs information indicating that the payment has been completed.

[0825] By rapidly performing real-time data processing and providing feedback to the user at each step, the entire process proceeds smoothly.

[0826] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0827] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0828] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.

[0829] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[0830] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.

[0831] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.

[0832] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.

[0833] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.

[0834] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."

[0835] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.

[0836] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.

[0837] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.

[0838] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[0839] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[0840] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[0841] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[0842] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[0843] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[0844] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[0845] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[0846] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted to be incorporated by reference.

[0847] The following is further disclosed regarding the embodiments described above.

[0848] (Claim 1)

[0849] A means of obtaining information on available seats at a business location within a certain region,

[0850] A means for presenting available business locations to the user based on the aforementioned vacancy information,

[0851] A means of confirming a reservation at a business location selected by the user,

[0852] A means of obtaining and providing order information for products at the business location in advance based on the aforementioned reservation,

[0853] Means for completing payment processing related to the aforementioned reservation and order information,

[0854] A system that includes this.

[0855] (Claim 2)

[0856] The system according to claim 1, further comprising means for analyzing the user's past usage history and recommending business locations to present.

[0857] (Claim 3)

[0858] The system according to claim 1, further comprising means for providing an interface that allows the user to directly input the aforementioned order information from their terminal.

[0859] "Example 1"

[0860] (Claim 1)

[0861] A means of obtaining information on available seats at multiple sales offices within a certain region,

[0862] A means of presenting available business locations to users based on the aforementioned vacancy information,

[0863] A method for analyzing users' past usage information and recommending sales locations,

[0864] A means of confirming a reservation at a sales office selected by the user,

[0865] A means of obtaining and providing product information of sales offices in advance based on the aforementioned reservation,

[0866] Means for completing payment processing related to the aforementioned reservation and product information,

[0867] A system that includes this.

[0868] (Claim 2)

[0869] The system according to claim 1, further comprising a display means that allows the user to directly input the aforementioned product information from their terminal.

[0870] (Claim 3)

[0871] The system according to claim 1, further comprising means for utilizing information from an external digital map service in order to provide information on available seats within the aforementioned area.

[0872] "Application Example 1"

[0873] (Claim 1)

[0874] A means of obtaining information on available seats at a business location within a certain region,

[0875] A means for displaying available business locations on an information terminal based on the aforementioned vacancy information,

[0876] A means of confirming a reservation at a business location selected by the user,

[0877] A means of obtaining and providing order information for products at the business location in advance based on the aforementioned reservation,

[0878] Means for completing transaction processing related to the aforementioned reservation and order information,

[0879] Based on the business location information acquired by the aforementioned information terminal, a means for promptly providing goods upon arrival,

[0880] A system that includes this.

[0881] (Claim 2)

[0882] The system according to claim 1, further comprising means for analyzing the user's past usage history and recommending business locations to present.

[0883] (Claim 3)

[0884] The system according to claim 1, further comprising means for providing an interface that allows the order information to be directly entered from the user's information terminal.

[0885] "Example 2 of combining an emotion engine"

[0886] (Claim 1)

[0887] A means of obtaining information on available seats at a business location within a certain region,

[0888] A means for presenting available business locations to the user based on the aforementioned vacancy information,

[0889] A means of analyzing user input data and recognizing emotional states,

[0890] A means of recommending a business location based on the aforementioned emotional state,

[0891] A means of confirming a reservation at a business location selected by the user,

[0892] A means of obtaining and providing order information for products at the business location in advance based on the aforementioned reservation,

[0893] Means for completing payment processing related to the aforementioned reservation and order information,

[0894] A system that includes this.

[0895] (Claim 2)

[0896] The system according to claim 1, further comprising means for analyzing the user's past usage history and recommending business locations to present.

[0897] (Claim 3)

[0898] The system according to claim 1, further comprising means for providing an interface that allows the user to directly input the aforementioned order information from their terminal.

[0899] "Application example 2 of combining emotional engines"

[0900] (Claim 1)

[0901] A means of obtaining information on available seats at a business location within a certain region,

[0902] A means for presenting available business locations to the user based on the aforementioned vacancy information,

[0903] An emotion recognition means for recognizing the user's emotional state,

[0904] A means of recommending the optimal business location to the user based on the aforementioned emotional state,

[0905] A means of confirming a reservation at a business location selected by the user,

[0906] A means of obtaining and providing order information for products at the business location in advance based on the aforementioned reservation,

[0907] Means for completing payment processing related to the aforementioned reservation and order information,

[0908] A system that includes this.

[0909] (Claim 2)

[0910] The system according to claim 1, further comprising means for analyzing the user's past usage history and recommending business locations in combination with the user's emotional state.

[0911] (Claim 3)

[0912] The system according to claim 1, further comprising means for providing an interface that allows the user's processing device to directly input the aforementioned order information. [Explanation of Symbols]

[0913] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>

Claims

1. A means of obtaining information on available seats at a business location within a certain region, A means for presenting available business locations to the user based on the aforementioned vacancy information, A means of confirming a reservation at a business location selected by the user, A means of obtaining and providing order information for products at the business location in advance based on the aforementioned reservation, Means for completing payment processing related to the aforementioned reservation and order information, A system that includes this.

2. The system according to claim 1, further comprising means for analyzing the user's past usage history and recommending business locations to present.

3. The system according to claim 1, further comprising means for providing an interface that allows the user to directly input the aforementioned order information from their terminal.

Images