System

Abstract

To provide a system.SOLUTION: A system includes: means for determining whether or not an age of a user is equal to or older than a predetermined age; means for, when the age of the user is equal to or older than the predetermined age, selecting a visit place related to sightseeing recommended to a person of the predetermined age or older in accordance with voice data or text data input by the user; and means for transmitting selection results of the visit place to a terminal operated by the user.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including a description and related instruction sentence regarding the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2022-180282 A Summary of the Invention [Problem to be solved by the invention]

[0004] Due to a lack of travel booking apps that are easy for seniors to use, there is a need for support that allows seniors to enjoy traveling with peace of mind. [Means for solving the problem]

[0005] The present invention solves the above-mentioned problems by providing a travel booking app with an easy-to-use interface specialized for seniors.

[0006] Specifically, the problem is solved by the following means.

[0007] Users can use their own devices to input questions or requests using voice or text data. The server obtains the user's login information and determines that they are a senior citizen. A generative AI on the server suggests tourist spots and hotels based on the user's questions and requests. The server sends the suggested tourist spot and hotel information to the user. The server provides information on medical institutions, pharmacy locations, and safe transportation options. When the user enters additional questions or requests, the server provides corresponding support. Based on the user's login information, the server generates prompts to suggest tourist spots and hotels that are popular with seniors. The generative AI on the server searches a database for information on tourist spots and hotels for seniors and makes suggestions.

[0008] Through the above measures, we will be able to provide a travel booking app that is easy for seniors to use, allowing them to enjoy their trips with peace of mind.

[0009] "Voice data" refers to the voice uttered by the user captured as digital data.

[0010] "Text data" refers to the data format of a character string entered by a user via a keyboard or touch screen.

[0011] "Login Information" refers to the identification information (e.g., user name, password, etc.) used by a user to access an application or system.

[0012] "Senior demographic" generally refers to seniors or older people, and in the context of the present invention specifically refers to seniors who are interested in traveling.

[0013] "Tourist attractions" refer to famous places and sights that people visit while traveling.

[0014] "Hotel" refers to an accommodation facility or part of an accommodation facility that is used by travelers to stay. An example of a "prompt" is a prompt such as "Please tell us about tourist spots and hotels that are popular among seniors."

[0015] "Generative AI" is a type of conversational AI model that uses natural language processing technology to respond to and provide suggestions in response to user questions and requests.

[0016] "Medical institution" refers to facilities that provide medical services, such as hospitals, clinics, and medical centers.

[0017] A "pharmacy" refers to a facility that provides medicines and pharmaceuticals, and is generally staffed by pharmacists.

[0018] "Safe transportation" refers to transportation or modes of travel that prioritize safety and convenience when traveling to a travel destination.

[0019] The above are definitions of important terms contained in the claims. These definitions are intended to facilitate understanding of the patent specification and clarify the scope of the patent. [Brief description of the drawings]

[0020] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Diagram 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. FIG. [Diagram 3] FIG. 11 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Diagram 5] FIG. 13 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6]FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 13 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 13 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] 4 is a sequence diagram showing a process flow of the data processing system according to the first embodiment. FIG. [Figure 12] 11 is a sequence diagram showing a process flow of the data processing system in application example 1. FIG. [Figure 13] FIG. 11 is a sequence diagram showing the flow of processing of the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 11 is a sequence diagram showing the flow of processing in the data processing system in application example 2 when combined with an emotion engine. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0021] Hereinafter, an example of an embodiment of a system according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0022] First, the terms used in the following description will be explained.

[0023] In the following embodiments, a signed processor (hereinafter simply referred to as a "processor") may be one arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be one type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), etc.

[0024] In the following embodiments, a signed RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by the processor.

[0025] In the following embodiments, the storage with the code is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g.,

[0026] Examples include hard disks, or magnetic tapes.

[0027] In the following embodiments, the communication I / F (Interface) with the code is a communication processor and

[0028] The communication I / F is an interface including a power supply, a power source, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0029] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. In addition, in this specification, the same idea as "A and / or B" is also applied when three or more things are expressed by connecting them with "and / or."

[0030] [First embodiment]

[0031] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0032] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0033] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a wide area network (WAN) and / or a local area network (LAN).

[0034] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0035] The reception device 38 includes a touch panel 38A and a microphone 38B, and receives user input. The touch panel 38A detects contact with a pointer (e.g., a pen or a finger) to receive user input by the touch of the pointer. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0036] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (e.g., voice and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs voice according to instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, an aperture, and a shutter, and an imaging element such as a Complementary Metal-Oxide-Semiconductor (CMOS) image sensor or a Charge Coupled Device (CCD) image sensor.

[0037] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for transmitting and receiving various types of information between the processor 46 and the processor 28 via the network 54.

[0038] FIG. 2 shows an example of main functions of the data processing device 12 and the smart device 14.

[0039] As shown in Fig. 2, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32. The specific process program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific process program 56 from the storage 32, and executes the read specific process program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific process program 56 executed on the RAM 30.

[0040] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0041] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores a reception output program 60. The reception output program 60 is used together with the specific processing program 56 by the data processing system 10. The processor 46 reads out the reception output program 60 from the storage 50, and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0042] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0043] The embodiment for carrying out the present invention includes the following specific contents.

[0044] 1. Means for inputting voice data or text data into the terminal:

[0045] A user can use his / her terminal to input questions or requests as voice data or text data. For example, the user can input voice data using the microphone 38B of the terminal.

[0046] 2.Method of obtaining user login information on the server:

[0047] The server obtains the user's login information and determines that the user is a senior citizen. For example, when the user logs in to an app, the server obtains the user's login information by inputting a username and password.

[0048] 3. Methods for suggesting tourist spots and hotels using generative AI:

[0049] The generative AI on the server will suggest tourist spots and hotels based on the user's questions and requests. The generative AI will search the database for information on tourist spots and hotels that are popular among seniors and make suggestions to the user.

[0050] 4. Means of transmitting tourist attraction and hotel information on the server:

[0051] The server sends detailed information about tourist spots and hotels received from the generative AI to the user. The server converts the information into an appropriate format (text data or audio data) and sends it to the user's device.

[0052] 5.Means of providing information on medical institutions and pharmacies, and safe transportation methods on the server:

[0053] The server provides information about medical facilities, pharmacy locations, and safe transportation options. For example, when a user requests information about medical facilities, the server provides information about medical facilities near the user's current location.

[0054] The above is a part of the embodiment of the present invention. These means concretely realize each function of the system, and provide a travel reservation application that is easy for seniors to use.

[0055] The process flow will be explained below.

[0056] Step 1: A user uses a terminal to input voice data or text data.

[0057] The user operates his / her own terminal and inputs questions or requests using voice data or text data.

[0058] Step 2: The server gets the user's login information and determines that the user is a senior citizen.

[0059] The server obtains the user's login information and determines that the user is a senior citizen.

[0060] When a user logs in to an app, they enter their username and password, and the server obtains the user's login information.

[0061] Step 3: The generative AI on the server suggests tourist spots and hotels based on the user's questions and requests.

[0062] The generative AI on the server receives questions and requests from users.

[0063] The generative AI searches a database for information on tourist spots and hotels that are popular among seniors and makes suggestions.

[0064] Step 4: The server sends the user the information of the suggested attractions and hotels.

[0065] The server sends detailed information about tourist spots and hotels received from the generative AI to the user.

[0066] The server converts the information into an appropriate format (text data or audio data) and sends it to the user's terminal.

[0067] Step 5: The server provides information about medical institutions and pharmacies, as well as safe transportation options.

[0068] The server provides information about medical facilities, pharmacy locations and safe transportation options.

[0069] When a user requests information about medical institutions, the server provides information about medical institutions near the user's current location.

[0070] The above is the specific flow of the program's processing. The user uses their own device to input voice or text data, the server obtains the user's login information, and the generative AI suggests tourist spots and hotels based on the user's questions and requests. The server sends the suggested information to the user in an appropriate format, and also provides information on medical institutions and pharmacies, as well as safe transportation methods.

[0071] Example 1

[0072] Next, a description will be given of Example 1. In the following description, the data processing device 12 is referred to as a "server" and the smart device 14 is referred to as a "terminal."

[0073] In providing travel reservation applications specifically targeted at seniors, there is a demand for them to be able to smoothly provide information on tourist destinations and accommodations in a format that is easy for seniors to use, as well as information on medical facilities and pharmacies, and safe transportation methods. However, with the current system, it is difficult for users to obtain this information without hassle. There is a need to provide a system that allows seniors to quickly and accurately obtain the information they need through a simple and convenient interface.

[0074] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0075] In this invention, the server includes a means for a user to input questions or requests using voice data or text data using his / her own information device, a means for the server to acquire authentication information of the user and determine that the user is a senior citizen, a means for a generative AI on the server to suggest tourist spots and accommodation facilities in response to the user's questions and requests, and a means for the server to transmit information on the tourist spots and accommodation facilities suggested to the user. This allows senior users to easily input information using voice or text and efficiently acquire information on tourist spots and accommodation facilities that meet their needs. In addition, information on medical facilities, pharmacies, and means of transportation is also provided quickly, allowing users to enjoy their trip with peace of mind.

[0076] "Information device" refers to electronic devices that allow users to input voice data or text data. Specifically, this includes smartphones, tablets, personal computers, etc.

[0077] "Authentication Information" refers to the information a User uses to log into a System, including, but not limited to, usernames, passwords, and other means of authentication.

[0078] "Generative AI" refers to artificial intelligence that searches a database and suggests appropriate information based on a user's request. This AI works using machine learning and natural language processing techniques.

[0079] "Tourist destinations" refer to places or facilities that are of interest to tourists, including historical sites, natural parks, and museums.

[0080] "Accommodation" refers to facilities for travelers to stay temporarily. Specifically, this includes hotels, inns, guest houses, etc.

[0081] A "server" refers to a computer system that processes user requests over a network and provides appropriate information.

[0082] "Medical facilities" refers to facilities for providing medical services, including hospitals, clinics, pharmacies, etc.

[0083] "Transportation" refers to a means by which a user travels from one point to another, including walking, bicycles, cars, and public transportation.

[0084] A "database" refers to an information system that systematically stores large amounts of information and allows it to be searched and retrieved as needed.

[0085] The present invention relates to a system for providing a travel reservation application specialized for seniors, and the details thereof will be described below.

[0086] System Configuration

[0087] The system includes the following main components:

[0088] 1. User terminal

[0089] 2. Server

[0090] 3. Generative AI

[0091] 4. Database

[0092] User terminal

[0093] A user inputs a question or request using voice or text data on his / her information device, such as a smartphone, tablet, or personal computer. The voice data is converted into text data using voice recognition software, such as the Google® Speech-to-Text API. This allows the user to easily input a question.

[0094] server

[0095] The server obtains the user's authentication information and determines whether the user is a senior based on the information. The authentication information may include a username and password, or other authentication method. This authentication process verifies whether the user is a senior.

[0096] Generative AI

[0097] The generative AI on the server proposes information on tourist spots and accommodations in response to the user's questions and requests. This generative AI uses machine learning and natural language processing technology to generate optimal suggestions based on the user's input. It searches for tourist spots and accommodations that are popular with seniors from the information stored in the database and provides the optimal results to the user.

[0098] Database

[0099] The database contains information about tourist destinations, accommodations, medical facilities, pharmacies, and transportation options. The generative AI uses this database to generate appropriate answers to user questions. The server also uses the database to provide information about medical facilities, pharmacies, and safe transportation options.

[0100] Examples

[0101] Consider a case where a user uses a smartphone to voice input the question, "What are some good places to see autumn leaves in Kyoto?" The device captures this voice data and converts it to text data using the Google Speech-to-Text API. This text data is sent to the server as the question, "What are some good places to see autumn leaves in Kyoto?" The server verifies the user's authentication information and sends the generative AI a prompt, "What are some good places to see autumn leaves in Kyoto?" The generative AI searches the database for appropriate information and generates results such as "Tenryu-ji Temple in Arashiyama" and "Tofuku-ji Temple." The server converts these results into text data and sends it to the user's smartphone. The user can receive a message on their smartphone saying, "We recommend Tenryu-ji Temple and Tofuku-ji Temple in Arashiyama."

[0102] Examples of prompt statements

[0103] "What hotels in Tokyo do you recommend?"

[0104] "Please tell me where the nearest pharmacy is."

[0105] "What are the best places to see autumn leaves in Kyoto?"

[0106] This allows senior users to plan their trips simply and efficiently, and since necessary medical and transportation information is provided quickly, they can enjoy their trip with peace of mind.

[0107] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0108] Step 1: User enters voice or text data

[0109] A user inputs a question or request using his / her own information device (e.g., a smartphone or tablet). The input format is voice data or text data.

[0110] The device captures the voice data and converts it into text data using voice recognition software such as the Google Speech-to-Text API.

[0111] Input: User's voice data (e.g. "What are the best places to see autumn leaves in Kyoto?")

[0112] Data processing: Converting voice data into text data

[0113] Output: Text data (e.g. "What are the best places to see autumn leaves in Kyoto?")

[0114] Step 2: The server obtains and validates the user's login information

[0115] The terminal sends the authentication information (username and password) entered by the user to the server.

[0116] The server checks the authentication information against a database to determine whether the user is a senior citizen.

[0117] Input: User authentication information (e.g. username "user123" and password "password123")

[0118] Data processing: Database matching of authentication information and senior citizen identification

[0119] Output: Judgment result (e.g., confirming that the user is a senior citizen)

[0120] Step 3: Generative AI suggests tourist destinations and accommodations

[0121] The server sends the user's text data and the judgment results to the generative AI.

[0122] The generative AI searches a database for information on relevant tourist destinations and accommodations, and generates optimal suggestions.

[0123] Input: User's text data and judgment result (e.g. "What are the recommended places to see autumn leaves in Kyoto?" and that the user is a senior citizen)

[0124] Data Computing: Information Retrieval and Suggestion Generation from Text Data

[0125] Output: Information on suggested tourist attractions and accommodations (e.g. "Tenryu-ji Temple in Arashiyama" and "Tofuku-ji Temple")

[0126] Step 4: Submit your destination and accommodation information

[0127] The server converts the information about tourist spots and accommodations received from the generative AI into text data and sends it to the user's device.

[0128] Input: Suggested information from generative AI (e.g. "Tenryu-ji Temple in Arashiyama" and "Tofuku-ji Temple")

[0129] Data processing: Converting proposal information into text data

[0130] Output: A text message sent to the user's device (e.g. "I recommend Tenryu-ji Temple and Tofuku-ji Temple in Arashiyama.")

[0131] Step 5: Provide information about medical facilities and pharmacies, and safe transportation

[0132] When a user requests information about medical facilities, pharmacies, or safe transportation, the device sends the request to the server.

[0133] The server obtains the user's current location information and provides information on appropriate medical facilities and pharmacies, as well as safe transportation options.

[0134] Input: User request (e.g. "Tell me where is the nearest hospital") and current location information

[0135] Data calculation: Information search and provision based on current location

[0136] Output: Information on appropriate medical facilities, pharmacies, and transportation (e.g., "We recommend Hospital C, which is within 1 km of your current location.")

[0137] This will enable senior users to easily obtain the information they need using voice or text, enabling them to enjoy their trip with peace of mind.

[0138] (Application example 1)

[0139] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0140] In recent years, there has been an increasing demand for digital services that support seniors in ordering meals and selecting health-conscious menus. However, conventional food delivery apps lack personalization based on the user's health condition and preferences, and do not provide sufficient convenience specifically for seniors. In addition, menu selection based on health condition and information on medical institutions and pharmacies are lacking, resulting in a lack of an environment in which seniors can use the apps with peace of mind. The present invention aims to solve these problems and provide a personalized food delivery service for seniors.

[0141] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0142] In this invention, the server includes a means for a user to input a question or request using voice data or text data using the user's own terminal, a means for the server to acquire the user's login information and determine that the user is a senior citizen, a means for a generative AI on the server to suggest a meal selection location and menu in response to the user's question or request, and a means for the server to transmit information on the meal selection location and menu suggested to the user. This enables senior users to easily use a food delivery service that suits their health condition and preferences.

[0143] A "user terminal" is a device that a user uses to input his or her questions or requests as voice data or text data.

[0144] "Login Information" means authentication information required for a user to access a system, and typically includes a username and password.

[0145] The "senior demographic" refers to a specific user group targeted at elderly people, and generally includes people in the middle-aged and older age groups.

[0146] "Generative AI" is an artificial intelligence system that generates and suggests appropriate information in response to users' questions and requests.

[0147] "Selected dining locations" refer to eateries or restaurants suggested to the user.

[0148] "Menu" refers to the list of foods and drinks served at an eatery or restaurant.

[0149] The "transmitting means" is a function for transmitting the proposed information from the server to the user terminal.

[0150] A "medical institution" refers to a facility such as a hospital or clinic that provides medical services to a user.

[0151] "Pharmacy" means a store or facility used for selling and dispensing medicines.

[0152] "Transportation" refers to the means of transportation used by a user to travel safely to a destination, and includes vehicles, public transportation, taxi services, and the like.

[0153] A "database" is a system that systematically organizes and stores various types of data that generative AI uses to search for information.

[0154] A "prompt" is an instruction given to a generative AI to generate or suggest specific information.

[0155] The present invention is a personalized food delivery application for senior users, and is a system that suggests optimal meal locations and menus based on the user's health condition and preferences. Hereinafter, an embodiment of the present invention will be described in detail.

[0156] First, a user uses his / her own device to input a question or request using voice data or text data. This device can be a smartphone, tablet, or PC, and has a dedicated application installed. Through this application, the user can use the voice input function or text input function to input a request, such as "I would like to order sushi."

[0157] The server then obtains the user's login information and determines whether the user is a senior citizen. This login information includes the user name and password, and identifies the senior citizen based on the user's age and profile information stored in the database. The login information is processed using the SSL / TLS protocol as a security measure.

[0158] If the user is determined to be a senior, the generative AI on the server will suggest dining options and menu options based on the user's questions and requests. The generative AI will analyze the request entered by the user and generate an appropriate prompt. Based on this prompt, the AI ​​will search a database for restaurants and menus that are popular with seniors and generate suggestions. For example, in response to a request such as "I want to eat Japanese food," it will suggest nearby Japanese restaurants with good reviews and healthy menu items.

[0159] The suggested information is sent from the server to the user's device. The communication protocol used for this transmission is HTTP / HTTPS, and the information is provided in the form of text data or audio data. The user can check the detailed information of the restaurant and menu that suits them on the device, and place an order or make a reservation.

[0160] As additional services, the system also provides information on medical institutions and pharmacies, as well as safe transportation options. When a user requests medical information, the system provides the locations and business information of medical institutions near the user's current location, and suggests safe transportation options.

[0161] For example, if a user requests "I want to eat Japanese food" by voice, the application will suggest nearby Japanese restaurants and the day's recommended low-sodium menu. In this case, the prompt for the generative AI model is as follows:

[0162] User request: I want to eat Japanese food

[0163] Health Condition: High Blood Pressure

[0164] Allergies to consider: Nuts

[0165] Information required from the AI: A list of Japanese restaurants based on the user's request, along with details of their menus

[0166] This will allow senior users to use food delivery services that are tailored to their health conditions and preferences, supporting a safe and secure dietary lifestyle.

[0167] The flow of the specific process in the application example 1 will be described with reference to FIG.

[0168] Step 1:

[0169] A user uses his / her own terminal to input a question or request using voice data or text data.

[0170] Specifically, the user opens an application on a device such as a smartphone or tablet and uses the voice input function to say, "I would like to order sushi," or uses the text input function to input similar text. The input for this step is voice data or text data, and the output is text data indicating the user's request.

[0171] Step 2:

[0172] The terminal converts the voice data into text data.

[0173] Specifically, when voice input is made, the voice data is converted to text data using voice analysis software on the terminal (e.g., Google Cloud Speech-to-Text API). The input of this step is voice data, and the output is text data.

[0174] Step 3:

[0175] The server obtains the user's login information and determines that the user is a senior citizen.

[0176] Specifically, the server verifies the username and password entered by the user when logging in to the application, and obtains the user's age information from a database (e.g., MySQL (registered trademark)). Whether the user belongs to the senior demographic is determined based on the age information. The input for this step is the user's login information, and the output is the determination result as to whether the user belongs to the senior demographic.

[0177] Step 4:

[0178] A generative AI on the server generates prompts to suggest dining options and menu options based on the user's questions and requests, and searches for information from a database.

[0179] Specifically, the generative AI (e.g., OpenAI's GPT model) generates a prompt based on the user's request and uses the prompt to search a database for restaurant and menu information suitable for seniors. The input for this step is the user's request data, and the output is information about the suggested dining locations and menus.

[0180] Step 5:

[0181] The server transmits suggested dining options and menu information to the user.

[0182] Specifically, the server sends the suggested information to the user's terminal via HTTP / HTTPS protocol. The information may be provided in the form of text data or audio data. The input of this step is the suggested information, and the output is the suggested information sent to the user's terminal.

[0183] Step 6:

[0184] The terminal displays the suggested information to the user.

[0185] Specifically, the application on the terminal displays the received information on the user interface, and if voice data is available, uses voice synthesis software to provide the information by voice. The input of this step is the suggested information sent from the server, and the output is the information displayed or played back to the user.

[0186] Step 7:

[0187] The user enters any additional questions or requests and the system responds with support.

[0188] Specifically, when the user enters an additional request such as "Please tell me other low-salt menu items," the server again uses generative AI to search for appropriate information and provide it to the user. The input for this step is the additional request, and the output is additional suggested information.

[0189] Furthermore, an emotion engine that estimates the emotion of the user may be combined. That is, the identification processing unit 290 may estimate the emotion of the user using the emotion identification model 59, and perform identification processing using the emotion of the user.

[0190] The embodiment for carrying out the present invention includes the following specific contents.

[0191] 1. Incorporating an emotion engine:

[0192] The system is equipped with an emotion engine that recognizes the user's emotions, analyzes emotions from the user's voice and text data, and grasps the user's emotional state.

[0193] 2. Emotion-based personalized suggestions:

[0194] The system customizes tourist attraction and hotel suggestions based on the user's emotional state captured by the emotion engine: for example, if the user is feeling happy or excited, it will suggest vibrant tourist attractions and entertainment venues.

[0195] 3. Collect user emotional feedback:

[0196] The system encourages users to provide feedback on the suggested attractions and hotels, and their emotional feedback is used to train the emotion engine and improve its suggestions.

[0197] 4. Sending a Customized Proposal:

[0198] The system sends customized tourist spot and hotel suggestions to the user based on the sentiment. The suggestions are converted into an appropriate format (text data or voice data) and sent to the user's device.

[0199] The above is a part of the embodiment of the present invention. This allows the system to recognize the user's emotions and provide customized tourist attractions and hotel suggestions based on the emotions. By collecting the user's emotion feedback, the system learns and improves the suggestions.

[0200] The process flow will be explained below.

[0201] Step 1: Run the emotion engine to recognize the user's emotions

[0202] The user inputs a question or request into the terminal using voice data or text data.

[0203] An emotion engine on the server receives the user's voice or text data and analyzes the emotion.

[0204] The emotion engine uses voice recognition in the case of voice data, and natural language processing in the case of text data to grasp emotions.

[0205] Step 2: Sentiment-based personalized suggestions in action

[0206] The generative AI on the server receives the user's emotional state as understood from the emotion engine.

[0207] Generative AI will customize a database of tourist attractions and hotels based on emotions to generate suggestions.

[0208] The customized offers are sent from the server to the user's terminal.

[0209] Step 3: Collecting user emotion feedback

[0210] Users provide feedback on suggested attractions and hotels.

[0211] The user's emotional feedback is transmitted to the server via the terminal.

[0212] The server collects users' emotional feedback and uses it to learn the emotion engine and improve its suggestions.

[0213] Step 4: How Sending a Customized Offer Works

[0214] The server sends customized tourist spot and hotel suggestions to the user's terminal.

[0215] The suggestions are converted into an appropriate format (text or audio) and displayed in an easily accessible way to the user.

[0216] The above is a specific flow of the processing of the invention that combines an emotion engine. The emotion engine that recognizes the user's emotions analyzes the user's voice and text data to grasp the user's emotional state. The generative AI customizes suggestions of tourist spots and hotels based on the emotions and sends them to the user. The user's emotional feedback is collected and used by the server to learn the emotion engine and improve the suggestions. Finally, the customized suggestions are sent to the user's device, where the user can access and use them.

[0217] Example 2

[0218] Next, a description will be given of Example 2. In the following description, the data processing device 12 is referred to as a "server" and the smart device 14 is referred to as a "terminal."

[0219] Current travel recommendation systems only provide uniform information without considering the user's age group or emotional state. As a result, appropriate information cannot be provided to senior users and users who want customized recommendations based on their emotions, resulting in lower satisfaction and limited use. In addition, the collection of user feedback and the use of learning from it have not been sufficiently carried out, and system improvements have been delayed. The purpose of this study is to solve the above problems.

[0220] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0221] In this invention, the server includes a means for a user to input a question or request by voice data or text data using the user's own terminal, a means for the server to obtain the user's login information and determine the user's age group, a means for a generative artificial intelligence on the server to suggest tourist spots and accommodations according to the user's questions and requests and the user's emotional state, a means for the server to transmit information on the tourist spots and accommodations suggested to the user, and a means for the terminal to collect user feedback and transmit it to the server. This enables customized suggestions based on the user's age group and emotional state, improving user satisfaction and enabling continuous improvement of the system using the collected feedback.

[0222] A "terminal" is an electronic device that a user uses to input voice or text data.

[0223] "Server" means a central processing unit for analyzing data received from Users and generating and sending appropriate offers.

[0224] "Generative artificial intelligence" refers to algorithms and systems that make customized suggestions based on a user's questions, desires, and emotional state.

[0225] "Emotional state" refers to the type of emotion (e.g., joy, excitement, sadness, etc.) analyzed from the user's voice data and text data.

[0226] A "tourist attraction" is a place or facility of interest that tourists are encouraged to visit.

[0227] "Accommodation facilities" refer to facilities such as hotels and inns where travelers can stay.

[0228] "Feedback" is data that expresses a user's opinions or thoughts about proposed information or services.

[0229] An "age group" is a specific group that is categorized based on a user's age.

[0230] "Medical services" refers to information about medical facilities and services that a user may require during their trip.

[0231] "Drug stores" is information about stores where medicines and medical supplies can be purchased.

[0232] A "safe means of transportation" is a highly safe means of transportation that is recommended for use by the user during the trip.

[0233] The present invention is a system that makes customization suggestions taking into account the user's emotional state and age group, and the procedure is described below.

[0234] Hardware and Software Used

[0235] The system includes a user terminal, a server, an emotion engine, and generative artificial intelligence. Specific software used includes a voice recognition engine, a text analysis engine, an emotion analysis engine, and a database management system. For example, a general voice recognition system is used for voice recognition, a general natural language processing tool is used for text analysis, and a general emotion analysis tool is used for emotion analysis.

[0236] Program Processing

[0237] The server first receives voice or text data from the user and analyzes it to understand the user's emotional state. A voice recognition engine and a text analysis engine are used for this. The emotion analysis engine evaluates the user's emotion (e.g., joy, surprise, sadness, etc.) from the analyzed data.

[0238] The server then uses generative artificial intelligence (AI) to generate recommendations for attractions and accommodations based on the user's age group and emotional state. The recommendations are customized to provide the user with the most appropriate options by pulling information from a database, such as a typical recommendation system.

[0239] The generated suggestions are sent from the server to the user's device, where the device can display or read the suggestions to the user. If the user provides feedback in response, the feedback is sent back to the server and analyzed by the emotion analysis engine. This allows the system to learn from the user's feedback based on their emotional state and use it to improve the accuracy of future suggestions.

[0240] Examples

[0241] For example, if a user verbally asks, "I want to do something fun with my friends this weekend," the system analyzes the voice data and recognizes that the user's emotional state is "excited." As a result, the system suggests lively events and entertainment venues (e.g., live concerts and amusement parks) to the user.

[0242] Examples of prompt statements

[0243] "I want to do something fun with my friends this weekend. Can you recommend some good places?"

[0244] In this way, the invention can take into account the user's age group and emotional state to provide personalized suggestions and collect user feedback for continuous improvement of the system.

[0245] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0246] Step 1:

[0247] The device receives voice or text data from the user. The user speaks into the device or types a question or request into the keyboard (example: "I want to do something fun with my friends this weekend"). This data is acquired through the device's microphone and keyboard. Input: Voice or text data containing the user's question or request. Output: Voice or text data to send to the server.

[0248] Step 2:

[0249] The terminal sends the user's voice data or text data to the server. In the case of voice data, encoding is performed, and in the case of text data, it is sent as is. Input: Voice data or text data obtained from the terminal. Output: Data sent to the server.

[0250] Step 3:

[0251] The server analyzes the data it receives and determines the user's emotional state. In the case of voice data, it is converted to text using a voice recognition engine, and emotion analysis is performed using a text analysis engine. An emotion analysis engine is used for emotion analysis. Input: User's voice data or text data. Output: User's emotional state (e.g., "excited").

[0252] Step 4:

[0253] The server obtains the user's login information and determines the age group. The login information contains basic information about the user, and the age group is analyzed based on that information. Input: User's login information. Output: User's age group (e.g., "young people").

[0254] Step 5:

[0255] The server uses generative artificial intelligence to generate suggestions for tourist attractions and accommodations based on the user's emotional state and age group. For example, amusement parks and live concerts are suggested based on the emotional state of "excitement" and the age group of "young people." Input: User's emotional state and age group. Output: Customized list of tourist attractions and accommodations.

[0256] Step 6:

[0257] The server converts the suggestions into text or audio data and sends it to the device. In the case of audio data, it uses a speech synthesis engine to convert the text to audio. Input: A list of customized suggestions. Output: Text or audio data sent to the device.

[0258] Step 7:

[0259] The terminal displays or plays audibly the suggestions received from the server to the user. The user can check the list of suggested tourist attractions and accommodations and obtain detailed information if necessary. Input: Text data or audio data sent from the server. Output: Displaying suggestions to the user or playing them audibly.

[0260] Step 8:

[0261] The user provides feedback on the proposed information. The user uses the terminal to input their thoughts and opinions on the proposed content by text or voice. Input: User feedback (voice data or text data). Output: Feedback data input to the terminal.

[0262] Step 9:

[0263] The device sends user feedback to the server. The feedback data is encoded in an easy-to-parse format. Input: User feedback data. Output: Feedback data sent to the server.

[0264] Step 10:

[0265] The server analyzes the user's feedback and determines the emotional state again. The feedback data is then analyzed by the emotion analysis engine and used to improve the quality of the next suggestions. Input: User's feedback data. Output: Emotion analysis results reflected in improvements.

[0266] (Application example 2)

[0267] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0268] Existing travel reservation systems and content distribution services are unable to make proposals that take into account the user's emotions, making it difficult to make optimal proposals that match the user's emotional state at any given time. In addition, particularly for seniors, there is a lack of support that responds to the user's emotions and special needs. This makes it difficult to improve user satisfaction and encourage repeat use.

[0269] The identification process by the identification processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means. In this invention, the server includes a means for a user to input a question or request by voice data or text data using his / her own terminal, a means for the server to acquire the user's login information and determine that the user is a senior citizen, a means for an emotion engine on the server to analyze the user's voice or text data and recognize the emotional state, a means for a generative AI to suggest tourist spots and hotels according to the user's question or request based on the emotional state recognized by the emotion engine, and a means for the server to transmit information on the suggested tourist spots and hotels to the user. This makes it possible to make suggestions optimized for the user's emotional state.

[0270] "User" means a person or entity that uses the system.

[0271] A "Terminal" is a device used by a User to access the System and enter or retrieve data.

[0272] "Voice data" refers to information input by a user through voice.

[0273] "Text data" refers to information entered by the user in the form of characters.

[0274] An "emotion engine" is a program or system that analyzes a user's voice or text data to recognize the user's emotional state.

[0275] An "emotional state" refers to the type of emotion a user is feeling (such as happiness, sadness, excitement, depression, etc.).

[0276] "Generative AI" is an artificial intelligence system that makes optimal suggestions based on the user's input information and emotional state.

[0277] "Tourist attractions" are travel destinations or places of interest that users can visit.

[0278] A "hotel" is a facility where users can stay.

[0279] "Suggestion" refers to the act of presenting options such as tourist spots and hotels to the user.

[0280] A "server" is a central computer system that receives input from users, processes data, and sends out various offers and information.

[0281] The present invention relates to a system for recommending optimal tourist spots and hotels based on the emotional state of a user. A specific embodiment for realizing this system is described below.

[0282] First, the user inputs a question or request using voice or text data on their own device. The device can be a smartphone, PC, tablet, etc. The data entered by the user is then sent to a server via the Internet.

[0283] The server acquires the user's login information and determines whether the user is a senior based on the login information by checking age information and past usage history.

[0284] Next, an "emotion engine" built on the server analyzes and recognizes the user's emotional state from the voice or text data. Examples of emotion engines include the NLP library SpaCy and the emotion analysis tool TextBlob.

[0285] Based on the emotional state recognized by the emotion engine, a generative AI on the server suggests tourist spots and hotels that correspond to the user's questions and requests. This generative AI searches for appropriate information from a database to make suggestions and generates prompt sentences. For example, it generates a prompt sentence such as "If the user is tired, recommend a hotel where they can relax."

[0286] The server sends the generated prompt sentences and information on suggested tourist spots and hotels to the user, allowing the user to receive suggestions optimized for his / her emotional state.

[0287] As a concrete example, if a user inputs "I'm a little tired," the emotion engine will recognize this and the generative AI will recommend hotels and tourist spots that have a relaxing effect. If a user asks the system, "Tell me some places where I can relax," the system will generate the prompt, "Please recommend some recommended places where I can relax based on the user's current emotional state."

[0288] By using this system, users can receive the optimal travel plan that matches their emotional state, improving the satisfaction of their travel experience. In addition, since it is specialized for seniors, it can also respond to the needs of each age group.

[0289] The flow of the specific process in the application example 2 will be described with reference to FIG.

[0290] Step 1:

[0291] A user uses their own device to input questions or requests using voice or text data. The input data is stored on the device as voice or text information. This data is then sent to a server via the internet. Input: User's voice data or text data. Output: Voice data or text data sent to the server.

[0292] Step 2:

[0293] The server receives the user's voice data or text data and also obtains the user's login information. Using the obtained login information, it is determined whether the user is a senior citizen. This determination is made by checking the user's age and past usage history. Input: User's login information. Output: Determination result of whether the user is a senior citizen.

[0294] Step 3:

[0295] An emotion engine on the server analyzes the user's voice or text data to recognize the emotional state. The emotion engine used can be an NLP library (e.g. SpaCy) or a sentiment analysis tool (e.g. TextBlob). Identifies the user's emotion (happiness, sadness, excitement, depression, etc.) through data analysis. Input: User's voice or text data. Output: Recognized emotional state.

[0296] Step 4:

[0297] A generative AI on the server suggests the most suitable tourist spots and hotels based on the recognized emotional state. The generative AI searches for appropriate information from a database and generates a prompt sentence that matches the user's emotional state. For example, it creates a prompt sentence that says, "If the user is tired, recommend a hotel where they can relax." Input: User's emotional state. Output: Generated prompt sentence and information on recommended tourist spots and hotels.

[0298] Step 5:

[0299] The server sends the generated prompt text and recommendation information to the user. The user can check this information on the terminal and select tourist spots and hotels that suit him / her. Input: The generated prompt text and recommendation information. Output: Information sent to the user's terminal.

[0300] Step 6:

[0301] The user selects the recommended tourist spot or hotel and actually visits / uses it. After that, the user again sends emotional feedback to the server, which helps improve the next suggestion. Emotional feedback is also sent from the device to the server. Input: User's emotional feedback. Output: Emotional feedback stored on the server.

[0302] This allows optimal suggestions to be made in accordance with the user's emotional state through a series of processes, thereby improving user satisfaction.

[0303] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires a voice indicating a user input for the result of the specific processing. The control unit 46A transmits the voice data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[0304] The data generation model 58 is a so-called generative AI (Artificial Intelligence).

[0305] An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by making a neural network perform deep learning. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating a voice, text data indicating a text, and image data indicating an image is input. The data generation model 58 performs inference on the input inference data according to the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0306] In the above embodiment, an example was given in which the specific process was performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0307] [Second embodiment]

[0308] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0309] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0310] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a wide area network (WAN) and / or a local area network (LAN).

[0311] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0312] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs the voice according to instructions from the processor 46.

[0313] Camera 42 is a small digital camera equipped with an optical system including a lens, an aperture, and a shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (e.g., an imaging range defined by an angle of view equivalent to the width of the field of vision of an average healthy person).

[0314] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for transmitting and receiving various types of information between the processor 46 and the processor 28 via the network 54. The transmission and reception of various types of information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is performed in a secure state.

[0315] Fig. 4 shows an example of main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0316] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32, and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0317] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0318] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50, and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0319] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal".

[0320] The embodiment for carrying out the present invention includes the following specific contents.

[0321] 1. Means for inputting voice data or text data into the terminal:

[0322] A user can use his / her terminal to input questions or requests as voice data or text data. For example, the user can input voice data using the microphone 238 of the terminal.

[0323] 2.Method of obtaining user login information on the server:

[0324] The server obtains the user's login information and determines that the user is a senior citizen. For example, when the user logs in to an app, the server obtains the user's login information by inputting a username and password.

[0325] 3. Methods for suggesting tourist spots and hotels using generative AI:

[0326] The generative AI on the server will suggest tourist spots and hotels based on the user's questions and requests. The generative AI will search the database for information on tourist spots and hotels that are popular among seniors and make suggestions to the user.

[0327] 4. Means of transmitting tourist attraction and hotel information on the server:

[0328] The server sends detailed information about tourist spots and hotels received from the generative AI to the user. The server converts the information into an appropriate format (text data or audio data) and sends it to the user's device.

[0329] 5.Means of providing information on medical institutions and pharmacies, and safe transportation methods on the server:

[0330] The server provides information about medical facilities, pharmacy locations, and safe transportation options. For example, when a user requests information about medical facilities, the server provides information about medical facilities near the user's current location.

[0331] The above is a part of the embodiment of the present invention. These means concretely realize each function of the system, and provide a travel reservation application that is easy for seniors to use.

[0332] The process flow will be explained below.

[0333] Step 1: A user uses a terminal to input voice data or text data.

[0334] The user operates his / her own terminal and inputs questions or requests using voice data or text data.

[0335] Step 2: The server gets the user's login information and determines that the user is a senior citizen.

[0336] The server obtains the user's login information and determines that the user is a senior citizen.

[0337] When a user logs in to an app, they enter their username and password, and the server obtains the user's login information.

[0338] Step 3: The generative AI on the server suggests tourist spots and hotels based on the user's questions and requests.

[0339] The generative AI on the server receives questions and requests from users.

[0340] The generative AI searches a database for information on tourist spots and hotels that are popular among seniors and makes suggestions.

[0341] Step 4: The server sends the user the information of the suggested attractions and hotels.

[0342] The server sends detailed information about tourist spots and hotels received from the generative AI to the user.

[0343] The server converts the information into an appropriate format (text data or audio data) and sends it to the user's terminal.

[0344] Step 5: The server provides information about medical institutions and pharmacies, as well as safe transportation options.

[0345] The server provides information about medical facilities, pharmacy locations and safe transportation options.

[0346] When a user requests information about medical institutions, the server provides information about medical institutions near the user's current location.

[0347] The above is the specific flow of the program's processing. The user uses their own device to input voice or text data, the server obtains the user's login information, and the generative AI suggests tourist spots and hotels in response to the user's questions and requests. The server sends the suggested information to the user in an appropriate format, and also provides information on medical institutions and pharmacies, as well as safe transportation methods.

[0348] Example 1

[0349] Next, a description will be given of Example 1. In the following description, the data processing device 12 is referred to as a "server" and the smart glasses 214 are referred to as a "terminal".

[0350] In providing travel reservation applications specifically targeted at seniors, there is a demand for them to be able to smoothly provide information on tourist destinations and accommodations in a format that is easy for seniors to use, as well as information on medical facilities and pharmacies, and safe transportation methods. However, with the current system, it is difficult for users to obtain this information without hassle. There is a need to provide a system that allows seniors to quickly and accurately obtain the information they need through a simple and convenient interface.

[0351] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0352] In this invention, the server includes a means for a user to input questions or requests using voice data or text data using his / her own information device, a means for the server to acquire authentication information of the user and determine that the user is a senior citizen, a means for a generative AI on the server to suggest tourist spots and accommodation facilities in response to the user's questions and requests, and a means for the server to transmit information on the tourist spots and accommodation facilities suggested to the user. This allows senior users to easily input information using voice or text and efficiently acquire information on tourist spots and accommodation facilities that meet their needs. In addition, information on medical facilities, pharmacies, and means of transportation is also provided quickly, allowing users to enjoy their trip with peace of mind.

[0353] "Information device" refers to electronic devices that allow users to input voice data or text data. Specifically, this includes smartphones, tablets, personal computers, etc.

[0354] "Authentication Information" refers to the information a User uses to log into a System, including, but not limited to, usernames, passwords, and other means of authentication.

[0355] "Generative AI" refers to artificial intelligence that searches a database and suggests appropriate information based on a user's request. This AI works using machine learning and natural language processing techniques.

[0356] "Tourist destinations" refer to places or facilities that are of interest to tourists, including historical sites, natural parks, and museums.

[0357] "Accommodation" refers to facilities for travelers to stay temporarily. Specifically, this includes hotels, inns, guest houses, etc.

[0358] A "server" refers to a computer system that processes user requests over a network and provides appropriate information.

[0359] "Medical facilities" refers to facilities for providing medical services, including hospitals, clinics, pharmacies, etc.

[0360] "Transportation" refers to a means by which a user travels from one point to another, including walking, bicycles, cars, and public transportation.

[0361] A "database" refers to an information system that systematically stores large amounts of information and allows it to be searched and retrieved as needed.

[0362] The present invention relates to a system for providing a travel reservation application specialized for seniors, and the details thereof will be described below.

[0363] System Configuration

[0364] The system includes the following main components:

[0365] 1. User terminal

[0366] 2. Server

[0367] 3. Generative AI

[0368] 4. Database

[0369] User terminal

[0370] Users input questions or requests using their own information devices, such as smartphones, tablets, or personal computers, as voice or text data. The voice data is converted into text data using voice recognition software, such as the Google Speech-to-Text API. This allows users to easily input their questions.

[0371] server

[0372] The server obtains the user's authentication information and determines whether the user is a senior based on the information. The authentication information may include a username and password, or other authentication method. This authentication process verifies whether the user is a senior.

[0373] Generative AI

[0374] The generative AI on the server proposes information on tourist spots and accommodations in response to the user's questions and requests. This generative AI uses machine learning and natural language processing technology to generate optimal suggestions based on the user's input. It searches for tourist spots and accommodations that are popular with seniors from the information stored in the database and provides the optimal results to the user.

[0375] Database

[0376] The database contains information about tourist destinations, accommodations, medical facilities, pharmacies, and transportation options. The generative AI uses this database to generate appropriate answers to user questions. The server also uses the database to provide information about medical facilities, pharmacies, and safe transportation options.

[0377] Examples

[0378] Consider a case where a user uses a smartphone to voice input the question, "What are some good places to see autumn leaves in Kyoto?" The device captures this voice data and converts it to text data using the Google Speech-to-Text API. This text data is sent to the server as the question, "What are some good places to see autumn leaves in Kyoto?" The server verifies the user's authentication information and sends the generative AI a prompt, "What are some good places to see autumn leaves in Kyoto?" The generative AI searches the database for appropriate information and generates results such as "Tenryu-ji Temple in Arashiyama" and "Tofuku-ji Temple." The server converts these results into text data and sends it to the user's smartphone. The user can receive a message on their smartphone saying, "We recommend Tenryu-ji Temple and Tofuku-ji Temple in Arashiyama."

[0379] Examples of prompt statements

[0380] "What hotels in Tokyo do you recommend?"

[0381] "Please tell me where the nearest pharmacy is."

[0382] "What are the best places to see autumn leaves in Kyoto?"

[0383] This allows senior users to plan their trips simply and efficiently, and since necessary medical and transportation information is provided quickly, they can enjoy their trip with peace of mind.

[0384] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0385] Step 1: User enters voice or text data

[0386] A user inputs a question or request using his / her own information device (e.g., a smartphone or tablet). The input format is voice data or text data.

[0387] The device captures the voice data and converts it into text data using voice recognition software such as the Google Speech-to-Text API.

[0388] Input: User's voice data (e.g. "What are the best places to see autumn leaves in Kyoto?")

[0389] Data processing: Converting voice data into text data

[0390] Output: Text data (e.g. "What are the best places to see autumn leaves in Kyoto?")

[0391] Step 2: The server obtains and validates the user's login information

[0392] The terminal sends the authentication information (username and password) entered by the user to the server.

[0393] The server checks the authentication information against a database to determine whether the user is a senior citizen.

[0394] Input: User authentication information (e.g. username "user123" and password "password123")

[0395] Data processing: Database matching of authentication information and senior citizen identification

[0396] Output: Judgment result (e.g., confirming that the user is a senior citizen)

[0397] Step 3: Generative AI suggests tourist destinations and accommodations

[0398] The server sends the user's text data and the judgment results to the generative AI.

[0399] The generative AI searches a database for information on relevant tourist destinations and accommodations, and generates optimal suggestions.

[0400] Input: User's text data and judgment result (e.g. "What are the recommended places to see autumn leaves in Kyoto?" and that the user is a senior citizen)

[0401] Data Computing: Information Retrieval and Suggestion Generation from Text Data

[0402] Output: Information on suggested tourist attractions and accommodations (e.g. "Tenryu-ji Temple in Arashiyama" and "Tofuku-ji Temple")

[0403] Step 4: Submit your destination and accommodation information

[0404] The server converts the information about tourist spots and accommodations received from the generative AI into text data and sends it to the user's device.

[0405] Input: Suggested information from generative AI (e.g. "Tenryu-ji Temple in Arashiyama" and "Tofuku-ji Temple")

[0406] Data processing: Converting proposal information into text data

[0407] Output: A text message sent to the user's device (e.g. "I recommend Tenryu-ji Temple and Tofuku-ji Temple in Arashiyama.")

[0408] Step 5: Provide information about medical facilities and pharmacies, and safe transportation

[0409] When a user requests information about medical facilities, pharmacies, or safe transportation, the device sends the request to the server.

[0410] The server obtains the user's current location information and provides information on appropriate medical facilities and pharmacies, as well as safe transportation options.

[0411] Input: User request (e.g. "Tell me where is the nearest hospital") and current location information

[0412] Data calculation: Information search and provision based on current location

[0413] Output: Information on appropriate medical facilities, pharmacies, and transportation (e.g., "We recommend Hospital C, which is within 1 km of your current location.")

[0414] This will enable senior users to easily obtain the information they need using voice or text, enabling them to enjoy their trip with peace of mind.

[0415] (Application example 1)

[0416] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal".

[0417] In recent years, there has been an increasing demand for digital services that support seniors in ordering meals and selecting health-conscious menus. However, conventional food delivery apps lack personalization based on the user's health condition and preferences, and do not provide sufficient convenience specifically for seniors. In addition, menu selection based on health condition and information on medical institutions and pharmacies are lacking, resulting in a lack of an environment in which seniors can use the apps with peace of mind. The present invention aims to solve these problems and provide a personalized food delivery service for seniors.

[0418] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0419] In this invention, the server includes a means for a user to input a question or request using voice data or text data using the user's own terminal, a means for the server to acquire the user's login information and determine that the user is a senior citizen, a means for a generative AI on the server to suggest a meal selection location and menu in response to the user's question or request, and a means for the server to transmit information on the meal selection location and menu suggested to the user. This enables senior users to easily use a food delivery service that suits their health condition and preferences.

[0420] A "user terminal" is a device that a user uses to input his or her questions or requests as voice data or text data.

[0421] "Login Information" means authentication information required for a user to access a system, and typically includes a username and password.

[0422] The "senior demographic" refers to a specific user group targeted at elderly people, and generally includes people in the middle-aged and older age groups.

[0423] "Generative AI" is an artificial intelligence system that generates and suggests appropriate information in response to users' questions and requests.

[0424] "Selected dining locations" refer to eateries or restaurants suggested to the user.

[0425] "Menu" refers to the list of foods and drinks served at an eatery or restaurant.

[0426] The "transmitting means" is a function for transmitting the proposed information from the server to the user terminal.

[0427] A "medical institution" refers to a facility such as a hospital or clinic that provides medical services to a user.

[0428] "Pharmacy" means a store or facility used for selling and dispensing medicines.

[0429] "Transportation" refers to the means of transportation used by a user to travel safely to a destination, and includes vehicles, public transportation, taxi services, and the like.

[0430] A "database" is a system that systematically organizes and stores various types of data that generative AI uses to search for information.

[0431] A "prompt" is an instruction given to a generative AI to generate or suggest specific information.

[0432] The present invention is a personalized food delivery application for senior users, and is a system that suggests optimal meal locations and menus based on the user's health condition and preferences. Hereinafter, an embodiment of the present invention will be described in detail.

[0433] First, a user uses his / her own device to input a question or request using voice data or text data. This device can be a smartphone, tablet, or PC, and has a dedicated application installed. Through this application, the user can use the voice input function or text input function to input a request, such as "I would like to order sushi."

[0434] The server then obtains the user's login information and determines whether the user is a senior citizen. This login information includes the user name and password, and identifies the senior citizen based on the user's age and profile information stored in the database. The login information is processed using the SSL / TLS protocol as a security measure.

[0435] If the user is determined to be a senior, the generative AI on the server will suggest dining options and menu options based on the user's questions and requests. The generative AI will analyze the request entered by the user and generate an appropriate prompt. Based on this prompt, the AI ​​will search a database for restaurants and menus that are popular with seniors and generate suggestions. For example, in response to a request such as "I want to eat Japanese food," it will suggest nearby Japanese restaurants with good reviews and healthy menu items.

[0436] The suggested information is sent from the server to the user's device. The communication protocol used for this transmission is HTTP / HTTPS, and the information is provided in the form of text data or audio data. The user can check the detailed information of the restaurant and menu that suits them on the device, and place an order or make a reservation.

[0437] As additional services, the system also provides information on medical institutions and pharmacies, as well as safe transportation options. When a user requests medical information, the system provides the locations and business information of medical institutions near the user's current location, and suggests safe transportation options.

[0438] For example, if a user requests "I want to eat Japanese food" by voice, the application will suggest nearby Japanese restaurants and the day's recommended low-sodium menu. In this case, the prompt for the generative AI model is as follows:

[0439] User request: I want to eat Japanese food

[0440] Health Condition: High Blood Pressure

[0441] Allergies to consider: Nuts

[0442] Information required from the AI: A list of Japanese restaurants based on the user's request, along with details of their menus

[0443] This will allow senior users to use food delivery services that are tailored to their health conditions and preferences, supporting a safe and secure dietary lifestyle.

[0444] The flow of the specific process in the application example 1 will be described with reference to FIG.

[0445] Step 1:

[0446] A user uses his / her own terminal to input a question or request using voice data or text data.

[0447] Specifically, the user opens an application on a device such as a smartphone or tablet and uses the voice input function to say, "I would like to order sushi," or uses the text input function to input similar text. The input for this step is voice data or text data, and the output is text data indicating the user's request.

[0448] Step 2:

[0449] The terminal converts the voice data into text data.

[0450] Specifically, when voice input is made, the voice data is converted to text data using voice analysis software on the terminal (e.g., Google Cloud Speech-to-Text API). The input of this step is voice data, and the output is text data.

[0451] Step 3:

[0452] The server obtains the user's login information and determines that the user is a senior citizen.

[0453] Specifically, the server verifies the username and password entered by the user when logging in to the application, and obtains the user's age information from a database (e.g., MySQL). Whether the user is a senior citizen or not is determined based on the age information. The input for this step is the user's login information, and the output is the determination result as to whether the user is a senior citizen or not.

[0454] Step 4:

[0455] A generative AI on the server generates prompts to suggest dining options and menu options based on the user's questions and requests, and searches for information from a database.

[0456] Specifically, a generative AI (e.g., OpenAI's GPT model) generates a prompt based on the user's request, and uses the prompt to search a database for restaurant and menu information suitable for seniors. The input for this step is the user's request data, and the output is information about the suggested dining locations and menus.

[0457] Step 5:

[0458] The server transmits suggested dining options and menu information to the user.

[0459] Specifically, the server sends the suggested information to the user's terminal via HTTP / HTTPS protocol. The information may be provided in the form of text data or audio data. The input of this step is the suggested information, and the output is the suggested information sent to the user's terminal.

[0460] Step 6:

[0461] The terminal displays the suggested information to the user.

[0462] Specifically, the application on the terminal displays the received information on the user interface, and if voice data is available, uses voice synthesis software to provide the information by voice. The input of this step is the suggested information sent from the server, and the output is the information displayed or played back to the user.

[0463] Step 7:

[0464] The user enters any additional questions or requests and the system responds with support.

[0465] Specifically, when the user enters an additional request such as "Please tell me other low-salt menu items," the server again uses generative AI to search for appropriate information and provide it to the user. The input for this step is the additional request, and the output is additional suggested information.

[0466] In addition, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0467] The embodiment for carrying out the present invention includes the following specific contents.

[0468] 1. Incorporating an emotion engine:

[0469] The system is equipped with an emotion engine that recognizes the user's emotions, analyzes emotions from the user's voice and text data, and grasps the user's emotional state.

[0470] 2. Emotion-based personalized suggestions:

[0471] The system customizes tourist attraction and hotel suggestions based on the user's emotional state captured by the emotion engine: for example, if the user is feeling happy or excited, it will suggest vibrant tourist attractions and entertainment venues.

[0472] 3. Collect user emotional feedback:

[0473] The system encourages users to provide feedback on the suggested attractions and hotels, and their emotional feedback is used to train the emotion engine and improve its suggestions.

[0474] 4. Sending a Customized Proposal:

[0475] The system sends customized tourist spot and hotel suggestions to the user based on the sentiment. The suggestions are converted into an appropriate format (text data or voice data) and sent to the user's device.

[0476] The above is a part of the embodiment of the present invention. This allows the system to recognize the user's emotions and provide customized tourist attractions and hotel suggestions based on the emotions. By collecting the user's emotion feedback, the system learns and improves the suggestions.

[0477] The process flow will be explained below.

[0478] Step 1: Run the emotion engine to recognize the user's emotions

[0479] The user inputs a question or request into the terminal using voice data or text data.

[0480] An emotion engine on the server receives the user's voice or text data and analyzes the emotion.

[0481] The emotion engine uses voice recognition in the case of voice data, and natural language processing in the case of text data to grasp emotions.

[0482] Step 2: Sentiment-based personalized suggestions in action

[0483] The generative AI on the server receives the user's emotional state as understood from the emotion engine.

[0484] Generative AI will customize a database of tourist attractions and hotels based on emotions to generate suggestions.

[0485] The customized offers are sent from the server to the user's terminal.

[0486] Step 3: Collecting user emotion feedback

[0487] Users provide feedback on suggested attractions and hotels.

[0488] The user's emotional feedback is transmitted to the server via the terminal.

[0489] The server collects users' emotional feedback and uses it to learn the emotion engine and improve its suggestions.

[0490] Step 4: How Sending a Customized Offer Works

[0491] The server sends customized tourist spot and hotel suggestions to the user's terminal.

[0492] The suggestions are converted into an appropriate format (text or audio) and displayed in an easily accessible way to the user.

[0493] The above is a specific flow of the processing of the invention that combines an emotion engine. The emotion engine that recognizes the user's emotions analyzes the user's voice and text data to grasp the user's emotional state. The generative AI customizes suggestions of tourist spots and hotels based on the emotions and sends them to the user. The user's emotional feedback is collected and used by the server to learn the emotion engine and improve the suggestions. Finally, the customized suggestions are sent to the user's device, where the user can access and use them.

[0494] Example 2

[0495] Next, a description will be given of Example 2. In the following description, the data processing device 12 is referred to as a "server" and the smart glasses 214 are referred to as a "terminal".

[0496] Current travel recommendation systems only provide uniform information without considering the user's age group or emotional state. As a result, appropriate information cannot be provided to senior users and users who want customized recommendations based on their emotions, resulting in lower satisfaction and limited use. In addition, the collection of user feedback and the use of learning from it have not been sufficiently carried out, and system improvements have been delayed. The purpose of this study is to solve the above problems.

[0497] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0498] In this invention, the server includes a means for a user to input a question or request by voice data or text data using the user's own terminal, a means for the server to obtain the user's login information and determine the user's age group, a means for a generative artificial intelligence on the server to suggest tourist spots and accommodations according to the user's questions and requests and the user's emotional state, a means for the server to transmit information on the tourist spots and accommodations suggested to the user, and a means for the terminal to collect user feedback and transmit it to the server. This enables customized suggestions based on the user's age group and emotional state, improving user satisfaction and enabling continuous improvement of the system using the collected feedback.

[0499] A "terminal" is an electronic device that a user uses to input voice or text data.

[0500] "Server" means a central processing unit for analyzing data received from Users and generating and sending appropriate offers.

[0501] "Generative artificial intelligence" refers to algorithms and systems that make customized suggestions based on a user's questions, desires, and emotional state.

[0502] "Emotional state" refers to the type of emotion (e.g., joy, excitement, sadness, etc.) analyzed from the user's voice data and text data.

[0503] A "tourist attraction" is a place or facility of interest that tourists are encouraged to visit.

[0504] "Accommodation facilities" refer to facilities such as hotels and inns where travelers can stay.

[0505] "Feedback" is data that expresses a user's opinions or thoughts about proposed information or services.

[0506] An "age group" is a specific group that is categorized based on a user's age.

[0507] "Medical services" refers to information about medical facilities and services that a user may require during their trip.

[0508] "Drug stores" is information about stores where medicines and medical supplies can be purchased.

[0509] A "safe means of transportation" is a highly safe means of transportation that is recommended for use by the user during the trip.

[0510] The present invention is a system that makes customization suggestions taking into account the user's emotional state and age group, and the procedure is described below.

[0511] Hardware and Software Used

[0512] The system includes a user terminal, a server, an emotion engine, and generative artificial intelligence. Specific software used includes a voice recognition engine, a text analysis engine, an emotion analysis engine, and a database management system. For example, a general voice recognition system is used for voice recognition, a general natural language processing tool is used for text analysis, and a general emotion analysis tool is used for emotion analysis.

[0513] Program Processing

[0514] The server first receives voice or text data from the user and analyzes it to understand the user's emotional state. A voice recognition engine and a text analysis engine are used for this. The emotion analysis engine evaluates the user's emotion (e.g., joy, surprise, sadness, etc.) from the analyzed data.

[0515] The server then uses generative artificial intelligence (AI) to generate recommendations for attractions and accommodations based on the user's age group and emotional state. The recommendations are customized to provide the user with the most appropriate options by pulling information from a database, such as a typical recommendation system.

[0516] The generated suggestions are sent from the server to the user's device, where the device can display or read the suggestions to the user. If the user provides feedback in response, the feedback is sent back to the server and analyzed by the emotion analysis engine. This allows the system to learn from the user's feedback based on their emotional state and use it to improve the accuracy of future suggestions.

[0517] Examples

[0518] For example, if a user verbally asks, "I want to do something fun with my friends this weekend," the system analyzes the voice data and recognizes that the user's emotional state is "excited." As a result, the system suggests lively events and entertainment venues (e.g., live concerts and amusement parks) to the user.

[0519] Examples of prompt statements

[0520] "I want to do something fun with my friends this weekend. Can you recommend some good places?"

[0521] In this way, the invention can take into account the user's age group and emotional state to provide personalized suggestions and collect user feedback for continuous improvement of the system.

[0522] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0523] Step 1:

[0524] The device receives voice or text data from the user. The user speaks into the device or types a question or request into the keyboard (example: "I want to do something fun with my friends this weekend"). This data is acquired through the device's microphone and keyboard. Input: Voice or text data containing the user's question or request. Output: Voice or text data to send to the server.

[0525] Step 2:

[0526] The terminal sends the user's voice data or text data to the server. In the case of voice data, encoding is performed, and in the case of text data, it is sent as is. Input: Voice data or text data obtained from the terminal. Output: Data sent to the server.

[0527] Step 3:

[0528] The server analyzes the data it receives and determines the user's emotional state. In the case of voice data, it is converted to text using a voice recognition engine, and emotion analysis is performed using a text analysis engine. An emotion analysis engine is used for emotion analysis. Input: User's voice data or text data. Output: User's emotional state (e.g., "excited").

[0529] Step 4:

[0530] The server obtains the user's login information and determines the age group. The login information contains basic information about the user, and the age group is analyzed based on that information. Input: User's login information. Output: User's age group (e.g., "young people").

[0531] Step 5:

[0532] The server uses generative artificial intelligence to generate suggestions for tourist attractions and accommodations based on the user's emotional state and age group. For example, amusement parks and live concerts are suggested based on the emotional state of "excitement" and the age group of "young people." Input: User's emotional state and age group. Output: Customized list of tourist attractions and accommodations.

[0533] Step 6:

[0534] The server converts the suggestions into text or audio data and sends it to the device. In the case of audio data, it uses a speech synthesis engine to convert the text to audio. Input: A list of customized suggestions. Output: Text or audio data sent to the device.

[0535] Step 7:

[0536] The terminal displays or plays audibly the suggestions received from the server to the user. The user can check the list of suggested tourist attractions and accommodations and obtain detailed information if necessary. Input: Text data or audio data sent from the server. Output: Displaying suggestions to the user or playing them audibly.

[0537] Step 8:

[0538] The user provides feedback on the proposed information. The user uses the terminal to input their thoughts and opinions on the proposed content by text or voice. Input: User feedback (voice data or text data). Output: Feedback data input to the terminal.

[0539] Step 9:

[0540] The device sends user feedback to the server. The feedback data is encoded in an easy-to-parse format. Input: User feedback data. Output: Feedback data sent to the server.

[0541] Step 10:

[0542] The server analyzes the user's feedback and determines the emotional state again. The feedback data is then analyzed by the emotion analysis engine and used to improve the quality of the next suggestions. Input: User's feedback data. Output: Emotion analysis results reflected in improvements.

[0543] (Application example 2)

[0544] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal".

[0545] Existing travel reservation systems and content distribution services are unable to make proposals that take into account the user's emotions, making it difficult to make optimal proposals that match the user's emotional state at any given time. In addition, particularly for seniors, there is a lack of support that responds to the user's emotions and special needs. This makes it difficult to improve user satisfaction and encourage repeat use.

[0546] The identification process by the identification processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means. In this invention, the server includes a means for a user to input a question or request by voice data or text data using his / her own terminal, a means for the server to acquire the user's login information and determine that the user is a senior citizen, a means for an emotion engine on the server to analyze the user's voice or text data and recognize the emotional state, a means for a generative AI to suggest tourist spots and hotels according to the user's question or request based on the emotional state recognized by the emotion engine, and a means for the server to transmit information on the suggested tourist spots and hotels to the user. This makes it possible to make suggestions optimized for the user's emotional state.

[0547] "User" means a person or entity that uses the system.

[0548] A "Terminal" is a device used by a User to access the System and enter or retrieve data.

[0549] "Voice data" refers to information input by a user through voice.

[0550] "Text data" refers to information entered by the user in the form of characters.

[0551] An "emotion engine" is a program or system that analyzes a user's voice or text data to recognize the user's emotional state.

[0552] An "emotional state" refers to the type of emotion a user is feeling (such as happiness, sadness, excitement, depression, etc.).

[0553] "Generative AI" is an artificial intelligence system that makes optimal suggestions based on the user's input information and emotional state.

[0554] "Tourist attractions" are travel destinations or places of interest that users can visit.

[0555] A "hotel" is a facility where users can stay.

[0556] "Suggestion" refers to the act of presenting options such as tourist spots and hotels to the user.

[0557] A "server" is a central computer system that receives input from users, processes data, and sends out various offers and information.

[0558] The present invention relates to a system for recommending optimal tourist spots and hotels based on the emotional state of a user. A specific embodiment for realizing this system is described below.

[0559] First, the user inputs a question or request using voice or text data on their own device. The device can be a smartphone, PC, tablet, etc. The data entered by the user is then sent to a server via the Internet.

[0560] The server acquires the user's login information and determines whether the user is a senior based on the login information by checking age information and past usage history.

[0561] Next, an "emotion engine" built on the server analyzes and recognizes the user's emotional state from the voice or text data. Examples of emotion engines include the NLP library SpaCy and the emotion analysis tool TextBlob.

[0562] Based on the emotional state recognized by the emotion engine, a generative AI on the server suggests tourist spots and hotels that correspond to the user's questions and requests. This generative AI searches for appropriate information from a database to make suggestions and generates prompt sentences. For example, it generates a prompt sentence such as "If the user is tired, recommend a hotel where they can relax."

[0563] The server sends the generated prompt sentences and information on suggested tourist spots and hotels to the user, allowing the user to receive suggestions optimized for his / her emotional state.

[0564] As a concrete example, if a user inputs "I'm a little tired," the emotion engine will recognize this and the generative AI will recommend hotels and tourist spots that have a relaxing effect. If a user asks the system, "Tell me some places where I can relax," the system will generate the prompt, "Please recommend some recommended places where I can relax based on the user's current emotional state."

[0565] By using this system, users can receive the optimal travel plan that matches their emotional state, improving the satisfaction of their travel experience. In addition, since it is specialized for seniors, it can also respond to the needs of each age group.

[0566] The flow of the specific process in the application example 2 will be described with reference to FIG.

[0567] Step 1:

[0568] A user uses their own device to input questions or requests using voice or text data. The input data is stored on the device as voice or text information. This data is then sent to a server via the internet. Input: User's voice data or text data. Output: Voice data or text data sent to the server.

[0569] Step 2:

[0570] The server receives the user's voice data or text data and also obtains the user's login information. Using the obtained login information, it is determined whether the user is a senior citizen. This determination is made by checking the user's age and past usage history. Input: User's login information. Output: Determination result of whether the user is a senior citizen.

[0571] Step 3:

[0572] An emotion engine on the server analyzes the user's voice or text data to recognize the emotional state. The emotion engine used can be an NLP library (e.g. SpaCy) or a sentiment analysis tool (e.g. TextBlob). Identifies the user's emotion (happiness, sadness, excitement, depression, etc.) through data analysis. Input: User's voice or text data. Output: Recognized emotional state.

[0573] Step 4:

[0574] A generative AI on the server suggests the most suitable tourist spots and hotels based on the recognized emotional state. The generative AI searches for appropriate information from a database and generates a prompt sentence that matches the user's emotional state. For example, it creates a prompt sentence that says, "If the user is tired, recommend a hotel where they can relax." Input: User's emotional state. Output: Generated prompt sentence and information on recommended tourist spots and hotels.

[0575] Step 5:

[0576] The server sends the generated prompt text and recommendation information to the user. The user can check this information on the terminal and select tourist spots and hotels that suit him / her. Input: The generated prompt text and recommendation information. Output: Information sent to the user's terminal.

[0577] Step 6:

[0578] The user selects the recommended tourist spot or hotel and actually visits / uses it. After that, the user again sends emotional feedback to the server, which helps improve the next suggestion. Emotional feedback is also sent from the device to the server. Input: User's emotional feedback. Output: Emotional feedback stored on the server.

[0579] This allows optimal suggestions to be made in accordance with the user's emotional state through a series of processes, thereby improving user satisfaction.

[0580] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires a voice indicating a user input for the result of the specific processing. The control unit 46A transmits the voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[0581] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by making a neural network perform deep learning. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating a voice, text data indicating a text, and image data indicating an image is input. The data generation model 58 performs inference on the input inference data according to the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0582] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[0583] [Third embodiment]

[0584] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[0585] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[0586] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a wide area network (WAN) and / or a local area network (LAN).

[0587] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[0588] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs the voice according to instructions from the processor 46.

[0589] Camera 42 is a small digital camera equipped with an optical system including a lens, an aperture, and a shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (e.g., an imaging range defined by an angle of view equivalent to the width of the field of vision of an average healthy person).

[0590] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for transmitting and receiving various types of information between the processor 46 and the processor 28 via the network 54. The transmission and reception of various types of information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is performed in a secure state.

[0591] Fig. 6 shows an example of main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0592] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32, and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0593] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0594] In the headset type terminal 314, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50, and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0595] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server", and the headset type terminal 314 will be referred to as the "terminal".

[0596] The embodiment for carrying out the present invention includes the following specific contents.

[0597] 1. Means for inputting voice data or text data into the terminal:

[0598] A user can use his / her terminal to input questions or requests as voice data or text data. For example, the user can input voice data using the microphone 238 of the terminal.

[0599] 2.Method of obtaining user login information on the server:

[0600] The server obtains the user's login information and determines that the user is a senior citizen. For example, when the user logs in to an app, the server obtains the user's login information by inputting a username and password.

[0601] 3. Methods for suggesting tourist spots and hotels using generative AI:

[0602] The generative AI on the server will suggest tourist spots and hotels based on the user's questions and requests. The generative AI will search the database for information on tourist spots and hotels that are popular among seniors and make suggestions to the user.

[0603] 4. Means of transmitting tourist attraction and hotel information on the server:

[0604] The server sends detailed information about tourist spots and hotels received from the generative AI to the user. The server converts the information into an appropriate format (text data or audio data) and sends it to the user's device.

[0605] 5.Means of providing information on medical institutions and pharmacies, and safe transportation methods on the server:

[0606] The server provides information about medical facilities, pharmacy locations, and safe transportation options. For example, when a user requests information about medical facilities, the server provides information about medical facilities near the user's current location.

[0607] The above is a part of the embodiment of the present invention. These means concretely realize each function of the system, and provide a travel reservation application that is easy for seniors to use.

[0608] The process flow will be explained below.

[0609] Step 1: A user uses a terminal to input voice data or text data.

[0610] Users operate their own terminals and input questions or requests using voice data or text data.

[0611] do.

[0612] Step 2: The server gets the user's login information and determines that the user is a senior citizen.

[0613] The server obtains the user's login information and determines that the user is a senior citizen.

[0614] When a user logs in to an app, they enter their username and password, and the server obtains the user's login information.

[0615] Step 3: The generative AI on the server suggests tourist spots and hotels based on the user's questions and requests.

[0616] The generative AI on the server receives questions and requests from users.

[0617] The generative AI searches a database for information on tourist spots and hotels that are popular among seniors and makes suggestions.

[0618] Step 4: The server sends the user the information of the suggested attractions and hotels.

[0619] The server sends detailed information about tourist spots and hotels received from the generative AI to the user.

[0620] The server converts the information into an appropriate format (text data or audio data) and sends it to the user's terminal.

[0621] Step 5: The server provides information about medical institutions and pharmacies, as well as safe transportation options.

[0622] The server provides information about medical facilities, pharmacy locations and safe transportation options.

[0623] When a user requests information about medical institutions, the server provides information about medical institutions near the user's current location.

[0624] The above is the specific flow of the program's processing. The user uses their own device to input voice or text data, the server obtains the user's login information, and the generative AI suggests tourist spots and hotels in response to the user's questions and requests. The server sends the suggested information to the user in an appropriate format, and also provides information on medical institutions and pharmacies, as well as safe transportation methods.

[0625] Example 1

[0626] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal".

[0627] In providing travel reservation applications specifically targeted at seniors, there is a demand for them to be able to smoothly provide information on tourist destinations and accommodations in a format that is easy for seniors to use, as well as information on medical facilities and pharmacies, and safe transportation methods. However, with the current system, it is difficult for users to obtain this information without hassle. There is a need to provide a system that allows seniors to quickly and accurately obtain the information they need through a simple and convenient interface.

[0628] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0629] In this invention, the server includes a means for a user to input questions or requests using voice data or text data using his / her own information device, a means for the server to acquire authentication information of the user and determine that the user is a senior citizen, a means for a generative AI on the server to suggest tourist spots and accommodation facilities in response to the user's questions and requests, and a means for the server to transmit information on the tourist spots and accommodation facilities suggested to the user. This allows senior users to easily input information using voice or text and efficiently acquire information on tourist spots and accommodation facilities that meet their needs. In addition, information on medical facilities, pharmacies, and means of transportation is also provided quickly, allowing users to enjoy their trip with peace of mind.

[0630] "Information device" refers to electronic devices that allow users to input voice data or text data. Specifically, this includes smartphones, tablets, personal computers, etc.

[0631] "Authentication Information" refers to the information a User uses to log into a System, including, but not limited to, usernames, passwords, and other means of authentication.

[0632] "Generative AI" refers to artificial intelligence that searches a database and suggests appropriate information based on a user's request. This AI works using machine learning and natural language processing techniques.

[0633] "Tourist destinations" refer to places or facilities that are of interest to tourists, including historical sites, natural parks, and museums.

[0634] "Accommodation" refers to facilities for travelers to stay temporarily. Specifically, this includes hotels, inns, guest houses, etc.

[0635] A "server" refers to a computer system that processes user requests over a network and provides appropriate information.

[0636] "Medical facilities" refers to facilities for providing medical services, including hospitals, clinics, pharmacies, etc.

[0637] "Transportation" refers to a means by which a user travels from one point to another, including walking, bicycles, cars, and public transportation.

[0638] A "database" refers to an information system that systematically stores large amounts of information and allows it to be searched and retrieved as needed.

[0639] The present invention relates to a system for providing a travel reservation application specialized for seniors, and the details thereof will be described below.

[0640] System Configuration

[0641] The system includes the following main components:

[0642] 1. User terminal

[0643] 2. Server

[0644] 3. Generative AI

[0645] 4. Database

[0646] User terminal

[0647] Users input questions or requests using their own information devices, such as smartphones, tablets, or personal computers, as voice or text data. The voice data is converted into text data using voice recognition software, such as the Google Speech-to-Text API. This allows users to easily input their questions.

[0648] server

[0649] The server obtains the user's authentication information and determines whether the user is a senior based on the information. The authentication information may include a username and password, or other authentication method. This authentication process verifies whether the user is a senior.

[0650] Generative AI

[0651] The generative AI on the server proposes information on tourist spots and accommodations in response to the user's questions and requests. This generative AI uses machine learning and natural language processing technology to generate optimal suggestions based on the user's input. It searches for tourist spots and accommodations that are popular with seniors from the information stored in the database and provides the optimal results to the user.

[0652] Database

[0653] The database contains information about tourist destinations, accommodations, medical facilities, pharmacies, and transportation options. The generative AI uses this database to generate appropriate answers to user questions. The server also uses the database to provide information about medical facilities, pharmacies, and safe transportation options.

[0654] Examples

[0655] Consider a case where a user uses a smartphone to voice input the question, "What are some good places to see autumn leaves in Kyoto?" The device captures this voice data and converts it to text data using the Google Speech-to-Text API. This text data is sent to the server as the question, "What are some good places to see autumn leaves in Kyoto?" The server verifies the user's authentication information and sends the generative AI a prompt, "What are some good places to see autumn leaves in Kyoto?" The generative AI searches the database for appropriate information and generates results such as "Tenryu-ji Temple in Arashiyama" and "Tofuku-ji Temple." The server converts these results into text data and sends it to the user's smartphone. The user can receive a message on their smartphone saying, "We recommend Tenryu-ji Temple and Tofuku-ji Temple in Arashiyama."

[0656] Examples of prompt statements

[0657] "What hotels in Tokyo do you recommend?"

[0658] "Please tell me where the nearest pharmacy is."

[0659] "What are the best places to see autumn leaves in Kyoto?"

[0660] This allows senior users to plan their trips simply and efficiently, and since necessary medical and transportation information is provided quickly, they can enjoy their trip with peace of mind.

[0661] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0662] Step 1: User enters voice or text data

[0663] A user inputs a question or request using his / her own information device (e.g., a smartphone or tablet). The input format is voice data or text data.

[0664] The device captures the voice data and converts it into text data using voice recognition software such as the Google Speech-to-Text API.

[0665] Input: User's voice data (e.g. "What are the best places to see autumn leaves in Kyoto?")

[0666] Data processing: Converting voice data into text data

[0667] Output: Text data (e.g. "What are the best places to see autumn leaves in Kyoto?")

[0668] Step 2: The server obtains and validates the user's login information

[0669] The terminal sends the authentication information (username and password) entered by the user to the server.

[0670] The server checks the authentication information against a database to determine whether the user is a senior citizen.

[0671] Input: User authentication information (e.g. username "user123" and password "password123")

[0672] Data processing: Database matching of authentication information and senior citizen identification

[0673] Output: Judgment result (e.g., confirming that the user is a senior citizen)

[0674] Step 3: Generative AI suggests tourist destinations and accommodations

[0675] The server sends the user's text data and the judgment results to the generative AI.

[0676] The generative AI searches a database for information on relevant tourist destinations and accommodations, and generates optimal suggestions.

[0677] Input: User's text data and judgment result (e.g. "What are the recommended places to see autumn leaves in Kyoto?" and that the user is a senior citizen)

[0678] Data Computing: Information Retrieval and Suggestion Generation from Text Data

[0679] Output: Information on suggested tourist attractions and accommodations (e.g. "Tenryu-ji Temple in Arashiyama" and "Tofuku-ji Temple")

[0680] Step 4: Submit your destination and accommodation information

[0681] The server converts the information about tourist spots and accommodations received from the generative AI into text data and sends it to the user's device.

[0682] Input: Suggested information from generative AI (e.g. "Tenryu-ji Temple in Arashiyama" and "Tofuku-ji Temple")

[0683] Data processing: Converting proposal information into text data

[0684] Output: A text message sent to the user's device (e.g. "I recommend Tenryu-ji Temple and Tofuku-ji Temple in Arashiyama.")

[0685] Step 5: Provide information about medical facilities and pharmacies, and safe transportation

[0686] When a user requests information about medical facilities, pharmacies, or safe transportation, the device sends the request to the server.

[0687] The server obtains the user's current location information and provides information on appropriate medical facilities and pharmacies, as well as safe transportation options.

[0688] Input: User request (e.g. "Tell me where is the nearest hospital") and current location information

[0689] Data calculation: Information search and provision based on current location

[0690] Output: Information on appropriate medical facilities, pharmacies, and transportation (e.g., "We recommend Hospital C, which is within 1 km of your current location.")

[0691] This will enable senior users to easily obtain the information they need using voice or text, enabling them to enjoy their trip with peace of mind.

[0692] (Application example 1)

[0693] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0694] In recent years, there has been an increasing demand for digital services that support seniors in ordering meals and selecting health-conscious menus. However, conventional food delivery apps lack personalization based on the user's health condition and preferences, and do not provide sufficient convenience specifically for seniors. In addition, menu selection based on health condition and information on medical institutions and pharmacies are lacking, resulting in a lack of an environment in which seniors can use the apps with peace of mind. The present invention aims to solve these problems and provide a personalized food delivery service for seniors.

[0695] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0696] In this invention, the server includes a means for a user to input a question or request using voice data or text data using the user's own terminal, a means for the server to acquire the user's login information and determine that the user is a senior citizen, a means for a generative AI on the server to suggest a meal selection location and menu in response to the user's question or request, and a means for the server to transmit information on the meal selection location and menu suggested to the user. This enables senior users to easily use a food delivery service that suits their health condition and preferences.

[0697] A "user terminal" is a device that a user uses to input his or her questions or requests as voice data or text data.

[0698] "Login Information" means authentication information required for a user to access a system, and typically includes a username and password.

[0699] The "senior demographic" refers to a specific user group targeted at elderly people, and generally includes people in the middle-aged and older age groups.

[0700] "Generative AI" is an artificial intelligence system that generates and suggests appropriate information in response to users' questions and requests.

[0701] "Selected dining locations" refer to eateries or restaurants suggested to the user.

[0702] "Menu" refers to the list of foods and drinks served at an eatery or restaurant.

[0703] The "transmitting means" is a function for transmitting the proposed information from the server to the user terminal.

[0704] A "medical institution" refers to a facility such as a hospital or clinic that provides medical services to a user.

[0705] "Pharmacy" means a store or facility used for selling and dispensing medicines.

[0706] "Transportation" refers to the means of transportation used by a user to travel safely to a destination, and includes vehicles, public transportation, taxi services, and the like.

[0707] A "database" is a system that systematically organizes and stores various types of data that generative AI uses to search for information.

[0708] A "prompt" is an instruction given to a generative AI to generate or suggest specific information.

[0709] The present invention is a personalized food delivery application for senior users, and is a system that suggests optimal meal locations and menus based on the user's health condition and preferences. Hereinafter, an embodiment of the present invention will be described in detail.

[0710] First, a user uses his / her own device to input a question or request using voice data or text data. This device can be a smartphone, tablet, or PC, and has a dedicated application installed. Through this application, the user can use the voice input function or text input function to input a request, such as "I would like to order sushi."

[0711] The server then obtains the user's login information and determines whether the user is a senior citizen. This login information includes the user name and password, and identifies the senior citizen based on the user's age and profile information stored in the database. The login information is processed using the SSL / TLS protocol as a security measure.

[0712] If the user is determined to be a senior, the generative AI on the server will suggest dining options and menu options based on the user's questions and requests. The generative AI will analyze the request entered by the user and generate an appropriate prompt. Based on this prompt, the AI ​​will search a database for restaurants and menus that are popular with seniors and generate suggestions. For example, in response to a request such as "I want to eat Japanese food," it will suggest nearby Japanese restaurants with good reviews and healthy menu items.

[0713] The suggested information is sent from the server to the user's device. The communication protocol used for this transmission is HTTP / HTTPS, and the information is provided in the form of text data or audio data. The user can check the detailed information of the restaurant and menu that suits them on the device, and place an order or make a reservation.

[0714] As additional services, the system also provides information on medical institutions and pharmacies, as well as safe transportation options. When a user requests medical information, the system provides the locations and business information of medical institutions near the user's current location, and suggests safe transportation options.

[0715] For example, if a user requests "I want to eat Japanese food" by voice, the application will suggest nearby Japanese restaurants and the day's recommended low-sodium menu. In this case, the prompt for the generative AI model is as follows:

[0716] User request: I want to eat Japanese food

[0717] Health Condition: High Blood Pressure

[0718] Allergies to consider: Nuts

[0719] Information required from the AI: A list of Japanese restaurants based on the user's request, along with details of their menus

[0720] This will allow senior users to use food delivery services that are tailored to their health conditions and preferences, supporting a safe and secure dietary lifestyle.

[0721] The flow of the specific process in the application example 1 will be described with reference to FIG.

[0722] Step 1:

[0723] A user uses his / her own terminal to input a question or request using voice data or text data.

[0724] Specifically, the user opens an application on a device such as a smartphone or tablet and uses the voice input function to say, "I would like to order sushi," or uses the text input function to input similar text. The input for this step is voice data or text data, and the output is text data indicating the user's request.

[0725] Step 2:

[0726] The terminal converts the voice data into text data.

[0727] Specifically, when voice input is made, the voice data is converted to text data using voice analysis software on the terminal (e.g., Google Cloud Speech-to-Text API). The input of this step is voice data, and the output is text data.

[0728] Step 3:

[0729] The server obtains the user's login information and determines that the user is a senior citizen.

[0730] Specifically, the server verifies the username and password entered by the user when logging in to the application, and obtains the user's age information from a database (e.g., MySQL). Whether the user is a senior citizen or not is determined based on the age information. The input for this step is the user's login information, and the output is the determination result as to whether the user is a senior citizen or not.

[0731] Step 4:

[0732] A generative AI on the server generates prompts to suggest dining options and menu options based on the user's questions and requests, and searches for information from a database.

[0733] Specifically, a generative AI (e.g., OpenAI's GPT model) generates a prompt based on the user's request, and uses the prompt to search a database for restaurant and menu information suitable for seniors. The input for this step is the user's request data, and the output is information about the suggested dining locations and menus.

[0734] Step 5:

[0735] The server transmits suggested dining options and menu information to the user.

[0736] Specifically, the server sends the suggested information to the user's terminal via HTTP / HTTPS protocol. The information may be provided in the form of text data or audio data. The input of this step is the suggested information, and the output is the suggested information sent to the user's terminal.

[0737] Step 6:

[0738] The terminal displays the suggested information to the user.

[0739] Specifically, the application on the terminal displays the received information on the user interface, and if voice data is available, uses voice synthesis software to provide the information by voice. The input of this step is the suggested information sent from the server, and the output is the information displayed or played back to the user.

[0740] Step 7:

[0741] The user enters any additional questions or requests and the system responds with support.

[0742] Specifically, when the user enters an additional request such as "Please tell me other low-salt menu items," the server again uses generative AI to search for appropriate information and provide it to the user. The input for this step is the additional request, and the output is additional suggested information.

[0743] In addition, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0744] The embodiment for carrying out the present invention includes the following specific contents.

[0745] 1. Incorporating an emotion engine:

[0746] The system is equipped with an emotion engine that recognizes the user's emotions, analyzes emotions from the user's voice and text data, and grasps the user's emotional state.

[0747] 2. Emotion-based personalized suggestions:

[0748] The system customizes tourist attraction and hotel suggestions based on the user's emotional state captured by the emotion engine: for example, if the user is feeling happy or excited, it will suggest vibrant tourist attractions and entertainment venues.

[0749] 3. Collect user emotional feedback:

[0750] The system encourages users to provide feedback on the suggested attractions and hotels, and their emotional feedback is used to train the emotion engine and improve its suggestions.

[0751] 4. Sending a Customized Proposal:

[0752] The system sends customized tourist spot and hotel suggestions to the user based on the sentiment. The suggestions are converted into an appropriate format (text data or voice data) and sent to the user's device.

[0753] The above is a part of the embodiment of the present invention. This allows the system to recognize the user's emotions and provide customized tourist attractions and hotel suggestions based on the emotions. By collecting the user's emotion feedback, the system learns and improves the suggestions.

[0754] The process flow will be explained below.

[0755] Step 1: Run the emotion engine to recognize the user's emotions

[0756] The user inputs a question or request into the terminal using voice data or text data.

[0757] An emotion engine on the server receives the user's voice or text data and analyzes the emotion.

[0758] The emotion engine uses voice recognition in the case of voice data, and natural language processing in the case of text data to grasp emotions.

[0759] Step 2: Sentiment-based personalized suggestions in action

[0760] The generative AI on the server receives the user's emotional state as understood from the emotion engine.

[0761] Generative AI will customize a database of tourist attractions and hotels based on emotions to generate suggestions.

[0762] The customized offers are sent from the server to the user's terminal.

[0763] Step 3: Collecting user emotion feedback

[0764] Users provide feedback on suggested attractions and hotels.

[0765] The user's emotional feedback is transmitted to the server via the terminal.

[0766] The server collects users' emotional feedback and uses it to learn the emotion engine and improve its suggestions.

[0767] Step 4: How Sending a Customized Offer Works

[0768] The server sends customized tourist spot and hotel suggestions to the user's terminal.

[0769] The suggestions are converted into an appropriate format (text or audio) and displayed in an easily accessible way to the user.

[0770] The above is a specific flow of the processing of the invention that combines an emotion engine. The emotion engine that recognizes the user's emotions analyzes the user's voice and text data to grasp the user's emotional state. The generative AI customizes suggestions of tourist spots and hotels based on the emotions and sends them to the user. The user's emotional feedback is collected and used by the server to learn the emotion engine and improve the suggestions. Finally, the customized suggestions are sent to the user's device, where the user can access and use them.

[0771] Example 2

[0772] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal".

[0773] Current travel recommendation systems only provide uniform information without considering the user's age group or emotional state. As a result, appropriate information cannot be provided to senior users and users who want customized recommendations based on their emotions, resulting in lower satisfaction and limited use. In addition, the collection of user feedback and the use of learning from it have not been sufficiently carried out, and system improvements have been delayed. The purpose of this study is to solve the above problems.

[0774] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0775] In this invention, the server includes a means for a user to input a question or request by voice data or text data using the user's own terminal, a means for the server to obtain the user's login information and determine the user's age group, a means for a generative artificial intelligence on the server to suggest tourist spots and accommodations according to the user's questions and requests and the user's emotional state, a means for the server to transmit information on the tourist spots and accommodations suggested to the user, and a means for the terminal to collect user feedback and transmit it to the server. This enables customized suggestions based on the user's age group and emotional state, improving user satisfaction and enabling continuous improvement of the system using the collected feedback.

[0776] A "terminal" is an electronic device that a user uses to input voice or text data.

[0777] "Server" means a central processing unit for analyzing data received from Users and generating and sending appropriate offers.

[0778] "Generative artificial intelligence" refers to algorithms and systems that make customized suggestions based on a user's questions, desires, and emotional state.

[0779] "Emotional state" refers to the type of emotion (e.g., joy, excitement, sadness, etc.) analyzed from the user's voice data and text data.

[0780] A "tourist attraction" is a place or facility of interest that tourists are encouraged to visit.

[0781] "Accommodation facilities" refer to facilities such as hotels and inns where travelers can stay.

[0782] "Feedback" is data that expresses a user's opinions or thoughts about proposed information or services.

[0783] An "age group" is a specific group that is categorized based on a user's age.

[0784] "Medical services" refers to information about medical facilities and services that a user may require during their trip.

[0785] "Drug stores" is information about stores where medicines and medical supplies can be purchased.

[0786] A "safe means of transportation" is a highly safe means of transportation that is recommended for use by the user during the trip.

[0787] The present invention is a system that makes customization suggestions taking into account the user's emotional state and age group, and the procedure is described below.

[0788] Hardware and Software Used

[0789] The system includes a user terminal, a server, an emotion engine, and generative artificial intelligence. Specific software used includes a voice recognition engine, a text analysis engine, an emotion analysis engine, and a database management system. For example, a general voice recognition system is used for voice recognition, a general natural language processing tool is used for text analysis, and a general emotion analysis tool is used for emotion analysis.

[0790] Program Processing

[0791] The server first receives voice or text data from the user and analyzes it to understand the user's emotional state. A voice recognition engine and a text analysis engine are used for this. The emotion analysis engine evaluates the user's emotion (e.g., joy, surprise, sadness, etc.) from the analyzed data.

[0792] The server then uses generative artificial intelligence (AI) to generate recommendations for attractions and accommodations based on the user's age group and emotional state. The recommendations are customized to provide the user with the most appropriate options by pulling information from a database, such as a typical recommendation system.

[0793] The generated suggestions are sent from the server to the user's device, where the device can display or read the suggestions to the user. If the user provides feedback in response, the feedback is sent back to the server and analyzed by the emotion analysis engine. This allows the system to learn from the user's feedback based on their emotional state and use it to improve the accuracy of future suggestions.

[0794] Examples

[0795] For example, if a user verbally asks, "I want to do something fun with my friends this weekend," the system analyzes the voice data and recognizes that the user's emotional state is "excited." As a result, the system suggests lively events and entertainment venues (e.g., live concerts and amusement parks) to the user.

[0796] Examples of prompt statements

[0797] "I want to do something fun with my friends this weekend. Can you recommend some good places?"

[0798] In this way, the invention can take into account the user's age group and emotional state to provide personalized suggestions and collect user feedback for continuous improvement of the system.

[0799] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0800] Step 1:

[0801] The device receives voice or text data from the user. The user speaks into the device or types a question or request into the keyboard (example: "I want to do something fun with my friends this weekend"). This data is acquired through the device's microphone and keyboard. Input: Voice or text data containing the user's question or request. Output: Voice or text data to send to the server.

[0802] Step 2:

[0803] The terminal sends the user's voice data or text data to the server. In the case of voice data, encoding is performed, and in the case of text data, it is sent as is. Input: Voice data or text data obtained from the terminal. Output: Data sent to the server.

[0804] Step 3:

[0805] The server analyzes the data it receives and determines the user's emotional state. In the case of voice data, it is converted to text using a voice recognition engine, and emotion analysis is performed using a text analysis engine. An emotion analysis engine is used for emotion analysis. Input: User's voice data or text data. Output: User's emotional state (e.g., "excited").

[0806] Step 4:

[0807] The server obtains the user's login information and determines the age group. The login information contains basic information about the user, and the age group is analyzed based on that information. Input: User's login information. Output: User's age group (e.g., "young people").

[0808] Step 5:

[0809] The server uses generative artificial intelligence to generate suggestions for tourist attractions and accommodations based on the user's emotional state and age group. For example, amusement parks and live concerts are suggested based on the emotional state of "excitement" and the age group of "young people." Input: User's emotional state and age group. Output: Customized list of tourist attractions and accommodations.

[0810] Step 6:

[0811] The server converts the suggestions into text or audio data and sends it to the device. In the case of audio data, it uses a speech synthesis engine to convert the text to audio. Input: A list of customized suggestions. Output: Text or audio data sent to the device.

[0812] Step 7:

[0813] The terminal displays or plays audibly the suggestions received from the server to the user. The user can check the list of suggested tourist attractions and accommodations and obtain detailed information if necessary. Input: Text data or audio data sent from the server. Output: Displaying suggestions to the user or playing them audibly.

[0814] Step 8:

[0815] The user provides feedback on the proposed information. The user uses the terminal to input their thoughts and opinions on the proposed content by text or voice. Input: User feedback (voice data or text data). Output: Feedback data input to the terminal.

[0816] Step 9:

[0817] The device sends user feedback to the server. The feedback data is encoded in an easy-to-parse format. Input: User feedback data. Output: Feedback data sent to the server.

[0818] Step 10:

[0819] The server analyzes the user's feedback and determines the emotional state again. The feedback data is then analyzed by the emotion analysis engine and used to improve the quality of the next suggestions. Input: User's feedback data. Output: Emotion analysis results reflected in improvements.

[0820] (Application example 2)

[0821] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server", and the headset type terminal 314 will be referred to as a "terminal".

[0822] Existing travel reservation systems and content distribution services are unable to make proposals that take into account the user's emotions, making it difficult to make optimal proposals that match the user's emotional state at any given time. In addition, particularly for seniors, there is a lack of support that responds to the user's emotions and special needs. This makes it difficult to improve user satisfaction and encourage repeat use.

[0823] The identification process by the identification processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means. In this invention, the server includes a means for a user to input a question or request by voice data or text data using his / her own terminal, a means for the server to acquire the user's login information and determine that the user is a senior citizen, a means for an emotion engine on the server to analyze the user's voice or text data and recognize the emotional state, a means for a generative AI to suggest tourist spots and hotels according to the user's question or request based on the emotional state recognized by the emotion engine, and a means for the server to transmit information on the suggested tourist spots and hotels to the user. This makes it possible to make suggestions optimized for the user's emotional state.

[0824] "User" means a person or entity that uses the system.

[0825] A "Terminal" is a device used by a User to access the System and enter or retrieve data.

[0826] "Voice data" refers to information input by a user through voice.

[0827] "Text data" refers to information entered by the user in the form of characters.

[0828] An "emotion engine" is a program or system that analyzes a user's voice or text data to recognize the user's emotional state.

[0829] An "emotional state" refers to the type of emotion a user is feeling (such as happiness, sadness, excitement, depression, etc.).

[0830] "Generative AI" is an artificial intelligence system that makes optimal suggestions based on the user's input information and emotional state.

[0831] "Tourist attractions" are travel destinations or places of interest that users can visit.

[0832] A "hotel" is a facility where users can stay.

[0833] "Suggestion" refers to the act of presenting options such as tourist spots and hotels to the user.

[0834] A "server" is a central computer system that receives input from users, processes data, and sends out various offers and information.

[0835] The present invention relates to a system for recommending optimal tourist spots and hotels based on the emotional state of a user. A specific embodiment for realizing this system is described below.

[0836] First, the user inputs a question or request using voice or text data on their own device. The device can be a smartphone, PC, tablet, etc. The data entered by the user is then sent to a server via the Internet.

[0837] The server acquires the user's login information and determines whether the user is a senior based on the login information by checking age information and past usage history.

[0838] Next, an "emotion engine" built on the server analyzes and recognizes the user's emotional state from the voice or text data. Examples of emotion engines include the NLP library SpaCy and the emotion analysis tool TextBlob.

[0839] Based on the emotional state recognized by the emotion engine, a generative AI on the server suggests tourist spots and hotels that correspond to the user's questions and requests. This generative AI searches for appropriate information from a database to make suggestions and generates prompt sentences. For example, it generates a prompt sentence such as "If the user is tired, recommend a hotel where they can relax."

[0840] The server sends the generated prompt sentences and information on suggested tourist spots and hotels to the user, allowing the user to receive suggestions optimized for his / her emotional state.

[0841] As a concrete example, if a user inputs "I'm a little tired," the emotion engine will recognize this and the generative AI will recommend hotels and tourist spots that have a relaxing effect. If a user asks the system, "Tell me some places where I can relax," the system will generate the prompt, "Please recommend some recommended places where I can relax based on the user's current emotional state."

[0842] By using this system, users can receive the optimal travel plan that matches their emotional state, improving the satisfaction of their travel experience. In addition, since it is specialized for seniors, it can also respond to the needs of each age group.

[0843] The flow of the specific process in the application example 2 will be described with reference to FIG.

[0844] Step 1:

[0845] A user uses their own device to input questions or requests using voice or text data. The input data is stored on the device as voice or text information. This data is then sent to a server via the internet. Input: User's voice data or text data. Output: Voice data or text data sent to the server.

[0846] Step 2:

[0847] The server receives the user's voice data or text data and also obtains the user's login information. Using the obtained login information, it is determined whether the user is a senior citizen. This determination is made by checking the user's age and past usage history. Input: User's login information. Output: Determination result of whether the user is a senior citizen.

[0848] Step 3:

[0849] An emotion engine on the server analyzes the user's voice or text data to recognize the emotional state. The emotion engine used can be an NLP library (e.g. SpaCy) or a sentiment analysis tool (e.g. TextBlob). Identifies the user's emotion (happiness, sadness, excitement, depression, etc.) through data analysis. Input: User's voice or text data. Output: Recognized emotional state.

[0850] Step 4:

[0851] A generative AI on the server suggests the most suitable tourist spots and hotels based on the recognized emotional state. The generative AI searches for appropriate information from a database and generates a prompt sentence that matches the user's emotional state. For example, it creates a prompt sentence that says, "If the user is tired, recommend a hotel where they can relax." Input: User's emotional state. Output: Generated prompt sentence and information on recommended tourist spots and hotels.

[0852] Step 5:

[0853] The server sends the generated prompt text and recommendation information to the user. The user can check this information on the terminal and select tourist spots and hotels that suit him / her. Input: The generated prompt text and recommendation information. Output: Information sent to the user's terminal.

[0854] Step 6:

[0855] The user selects the recommended tourist spot or hotel and actually visits / uses it. After that, the user again sends emotional feedback to the server, which helps improve the next suggestion. Emotional feedback is also sent from the device to the server. Input: User's emotional feedback. Output: Emotional feedback stored on the server.

[0856] This allows optimal suggestions to be made in accordance with the user's emotional state through a series of processes, thereby improving user satisfaction.

[0857] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input for the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[0858] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by making a neural network perform deep learning. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating a voice, text data indicating a text, and image data indicating an image is input. The data generation model 58 performs inference on the input inference data according to the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0859] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[0860] [Fourth embodiment]

[0861] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[0862] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[0863] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a wide area network (WAN) and / or a local area network (LAN).

[0864] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. In addition, the microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[0865] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs the voice according to instructions from the processor 46.

[0866] Camera 42 is a small digital camera equipped with an optical system including a lens, an aperture, and a shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (e.g., an imaging range defined by an angle of view equivalent to the width of the field of vision of an average healthy person).

[0867] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for transmitting and receiving various types of information between the processor 46 and the processor 28 via the network 54. The transmission and reception of various types of information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is performed in a secure state.

[0868] The control target 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, legs, etc. The posture and behavior of the robot 414 are controlled by controlling the motors of the arms, hands, legs, etc. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[0869] Fig. 8 shows an example of main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0870] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32, and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0871] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0872] In the robot 414, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50, and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0873] Next, a description will be given of the specific processing by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal".

[0874] The embodiment for carrying out the present invention includes the following specific contents.

[0875] 1. Means for inputting voice data or text data into the terminal:

[0876] A user can use his / her terminal to input questions or requests as voice data or text data. For example, the user can input voice data using the microphone 238 of the terminal.

[0877] 2.Method of obtaining user login information on the server:

[0878] The server obtains the user's login information and determines that the user is a senior citizen. For example, when the user logs in to an app, the server obtains the user's login information by inputting a username and password.

[0879] 3. Methods for suggesting tourist spots and hotels using generative AI:

[0880] The generative AI on the server will suggest tourist spots and hotels based on the user's questions and requests. The generative AI will search the database for information on tourist spots and hotels that are popular among seniors and make suggestions to the user.

[0881] 4. Means of transmitting tourist attraction and hotel information on the server:

[0882] The server sends detailed information about tourist spots and hotels received from the generative AI to the user. The server converts the information into an appropriate format (text data or audio data) and sends it to the user's device.

[0883] 5.Means of providing information on medical institutions and pharmacies, and safe transportation methods on the server:

[0884] The server provides information about medical facilities, pharmacy locations, and safe transportation options. For example, when a user requests information about medical facilities, the server provides information about medical facilities near the user's current location.

[0885] The above is a part of the embodiment of the present invention. These means concretely realize each function of the system, and provide a travel reservation application that is easy for seniors to use.

[0886] The process flow will be explained below.

[0887] Step 1: A user uses a terminal to input voice data or text data.

[0888] The user operates his / her own terminal and inputs questions or requests using voice data or text data.

[0889] Step 2: The server gets the user's login information and determines that the user is a senior citizen.

[0890] The server obtains the user's login information and determines that the user is a senior citizen.

[0891] When a user logs in to an app, they enter their username and password, and the server obtains the user's login information.

[0892] Step 3: The generative AI on the server suggests tourist spots and hotels based on the user's questions and requests.

[0893] The generative AI on the server receives questions and requests from users.

[0894] The generative AI searches a database for information on tourist spots and hotels that are popular among seniors and makes suggestions.

[0895] Step 4: The server sends the user the information of the suggested attractions and hotels.

[0896] The server sends detailed information about tourist spots and hotels received from the generative AI to the user.

[0897] The server converts the information into an appropriate format (text data or audio data) and sends it to the user's terminal.

[0898] Step 5: The server provides information about medical institutions and pharmacies, as well as safe transportation options.

[0899] The server provides information about medical facilities, pharmacy locations and safe transportation options.

[0900] When a user requests information about medical institutions, the server provides information about medical institutions near the user's current location.

[0901] The above is the specific flow of the program's processing. The user uses their own device to input voice or text data, the server obtains the user's login information, and the generative AI suggests tourist spots and hotels in response to the user's questions and requests. The server sends the suggested information to the user in an appropriate format, and also provides information on medical institutions and pharmacies, as well as safe transportation methods.

[0902] Example 1

[0903] Next, a description will be given of Example 1. In the following description, the data processing device 12 is referred to as a "server" and the robot 414 is referred to as a "terminal."

[0904] In providing travel reservation applications specifically targeted at seniors, there is a demand for them to be able to smoothly provide information on tourist destinations and accommodations in a format that is easy for seniors to use, as well as information on medical facilities and pharmacies, and safe transportation methods. However, with the current system, it is difficult for users to obtain this information without hassle. There is a need to provide a system that allows seniors to quickly and accurately obtain the information they need through a simple and convenient interface.

[0905] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0906] In this invention, the server includes a means for a user to input questions or requests using voice data or text data using his / her own information device, a means for the server to acquire authentication information of the user and determine that the user is a senior citizen, a means for a generative AI on the server to suggest tourist spots and accommodation facilities in response to the user's questions and requests, and a means for the server to transmit information on the tourist spots and accommodation facilities suggested to the user. This allows senior users to easily input information using voice or text and efficiently acquire information on tourist spots and accommodation facilities that meet their needs. In addition, information on medical facilities, pharmacies, and means of transportation is also provided quickly, allowing users to enjoy their trip with peace of mind.

[0907] "Information device" refers to electronic devices that allow users to input voice data or text data. Specifically, this includes smartphones, tablets, personal computers, etc.

[0908] "Authentication Information" refers to the information a User uses to log into a System, including, but not limited to, usernames, passwords, and other means of authentication.

[0909] "Generative AI" refers to artificial intelligence that searches a database and suggests appropriate information based on a user's request. This AI works using machine learning and natural language processing techniques.

[0910] "Tourist destinations" refer to places or facilities that are of interest to tourists, including historical sites, natural parks, and museums.

[0911] "Accommodation" refers to facilities for travelers to stay temporarily. Specifically, this includes hotels, inns, guest houses, etc.

[0912] A "server" refers to a computer system that processes user requests over a network and provides appropriate information.

[0913] "Medical facilities" refers to facilities for providing medical services, including hospitals, clinics, pharmacies, etc.

[0914] "Transportation" refers to a means by which a user travels from one point to another, including walking, bicycles, cars, and public transportation.

[0915] A "database" refers to an information system that systematically stores large amounts of information and allows it to be searched and retrieved as needed.

[0916] The present invention relates to a system for providing a travel reservation application specialized for seniors, and the details thereof will be described below.

[0917] System Configuration

[0918] The system includes the following main components:

[0919] 1. User terminal

[0920] 2. Server

[0921] 3. Generative AI

[0922] 4. Database

[0923] User terminal

[0924] Users input questions or requests using their own information devices, such as smartphones, tablets, or personal computers, as voice or text data. The voice data is converted into text data using voice recognition software, such as the Google Speech-to-Text API. This allows users to easily input their questions.

[0925] server

[0926] The server obtains the user's authentication information and determines whether the user is a senior based on the information. The authentication information may include a username and password, or other authentication method. This authentication process verifies whether the user is a senior.

[0927] Generative AI

[0928] The generative AI on the server proposes information on tourist spots and accommodations in response to the user's questions and requests. This generative AI uses machine learning and natural language processing technology to generate optimal suggestions based on the user's input. It searches for tourist spots and accommodations that are popular with seniors from the information stored in the database and provides the optimal results to the user.

[0929] Database

[0930] The database contains information about tourist destinations, accommodations, medical facilities, pharmacies, and transportation options. The generative AI uses this database to generate appropriate answers to user questions. The server also uses the database to provide information about medical facilities, pharmacies, and safe transportation options.

[0931] Examples

[0932] Consider a case where a user uses a smartphone to voice input the question, "What are some good places to see autumn leaves in Kyoto?" The device captures this voice data and converts it to text data using the Google Speech-to-Text API. This text data is sent to the server as the question, "What are some good places to see autumn leaves in Kyoto?" The server verifies the user's authentication information and sends the generative AI a prompt, "What are some good places to see autumn leaves in Kyoto?" The generative AI searches the database for appropriate information and generates results such as "Tenryu-ji Temple in Arashiyama" and "Tofuku-ji Temple." The server converts these results into text data and sends it to the user's smartphone. The user can receive a message on their smartphone saying, "We recommend Tenryu-ji Temple and Tofuku-ji Temple in Arashiyama."

[0933] Examples of prompt statements

[0934] "What hotels in Tokyo do you recommend?"

[0935] "Please tell me where the nearest pharmacy is."

[0936] "What are the best places to see autumn leaves in Kyoto?"

[0937] This allows senior users to plan their trips simply and efficiently, and since necessary medical and transportation information is provided quickly, they can enjoy their trip with peace of mind.

[0938] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0939] Step 1: User enters voice or text data

[0940] A user inputs a question or request using his / her own information device (e.g., a smartphone or tablet). The input format is voice data or text data.

[0941] The device captures the voice data and converts it into text data using voice recognition software such as the Google Speech-to-Text API.

[0942] Input: User's voice data (e.g. "What are the best places to see autumn leaves in Kyoto?")

[0943] Data processing: Converting voice data into text data

[0944] Output: Text data (e.g. "What are the best places to see autumn leaves in Kyoto?")

[0945] Step 2: The server obtains and validates the user's login information

[0946] The terminal sends the authentication information (username and password) entered by the user to the server.

[0947] The server checks the authentication information against a database to determine whether the user is a senior citizen.

[0948] Input: User authentication information (e.g. username "user123" and password "password123")

[0949] Data processing: Database matching of authentication information and senior citizen identification

[0950] Output: Judgment result (e.g., confirming that the user is a senior citizen)

[0951] Step 3: Generative AI suggests tourist destinations and accommodations

[0952] The server sends the user's text data and the judgment results to the generative AI.

[0953] The generative AI searches a database for information on relevant tourist destinations and accommodations, and generates optimal suggestions.

[0954] Input: User's text data and judgment result (e.g. "What are the recommended places to see autumn leaves in Kyoto?" and that the user is a senior citizen)

[0955] Data Computing: Information Retrieval and Suggestion Generation from Text Data

[0956] Output: Information on suggested tourist attractions and accommodations (e.g. "Tenryu-ji Temple in Arashiyama" and "Tofuku-ji Temple")

[0957] Step 4: Submit your destination and accommodation information

[0958] The server converts the information about tourist spots and accommodations received from the generative AI into text data and sends it to the user's device.

[0959] Input: Suggested information from generative AI (e.g. "Tenryu-ji Temple in Arashiyama" and "Tofuku-ji Temple")

[0960] Data processing: Converting proposal information into text data

[0961] Output: A text message sent to the user's device (e.g. "I recommend Tenryu-ji Temple and Tofuku-ji Temple in Arashiyama.")

[0962] Step 5: Provide information about medical facilities and pharmacies, and safe transportation

[0963] When a user requests information about medical facilities, pharmacies, or safe transportation, the device sends the request to the server.

[0964] The server obtains the user's current location information and provides information on appropriate medical facilities and pharmacies, as well as safe transportation options.

[0965] Input: User request (e.g. "Tell me where is the nearest hospital") and current location information

[0966] Data calculation: Information search and provision based on current location

[0967] Output: Information on appropriate medical facilities, pharmacies, and transportation (e.g., "We recommend Hospital C, which is within 1 km of your current location.")

[0968] This will enable senior users to easily obtain the information they need using voice or text, enabling them to enjoy their trip with peace of mind.

[0969] (Application example 1)

[0970] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[0971] In recent years, there has been an increasing demand for digital services that support seniors in ordering meals and selecting health-conscious menus. However, conventional food delivery apps lack personalization based on the user's health condition and preferences, and do not provide sufficient convenience specifically for seniors. In addition, menu selection based on health condition and information on medical institutions and pharmacies are lacking, resulting in a lack of an environment in which seniors can use the apps with peace of mind. The present invention aims to solve these problems and provide a personalized food delivery service for seniors.

[0972] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0973] In this invention, the server includes a means for a user to input a question or request using voice data or text data using the user's own terminal, a means for the server to acquire the user's login information and determine that the user is a senior citizen, a means for a generative AI on the server to suggest a meal selection location and menu in response to the user's question or request, and a means for the server to transmit information on the meal selection location and menu suggested to the user. This enables senior users to easily use a food delivery service that suits their health condition and preferences.

[0974] A "user terminal" is a device that a user uses to input his or her questions or requests as voice data or text data.

[0975] "Login Information" means authentication information required for a user to access a system, and typically includes a username and password.

[0976] The "senior demographic" refers to a specific user group targeted at elderly people, and generally includes people in the middle-aged and older age groups.

[0977] "Generative AI" is an artificial intelligence system that generates and suggests appropriate information in response to users' questions and requests.

[0978] "Selected dining locations" refer to eateries or restaurants suggested to the user.

[0979] "Menu" refers to the list of foods and drinks served at an eatery or restaurant.

[0980] The "transmitting means" is a function for transmitting the proposed information from the server to the user terminal.

[0981] A "medical institution" refers to a facility such as a hospital or clinic that provides medical services to a user.

[0982] "Pharmacy" means a store or facility used for selling and dispensing medicines.

[0983] "Transportation" refers to the means of transportation used by a user to travel safely to a destination, and includes vehicles, public transportation, taxi services, and the like.

[0984] A "database" is a system that systematically organizes and stores various types of data that generative AI uses to search for information.

[0985] A "prompt" is an instruction given to a generative AI to generate or suggest specific information.

[0986] The present invention is a personalized food delivery application for senior users, and is a system that suggests optimal meal locations and menus based on the user's health condition and preferences. Hereinafter, an embodiment of the present invention will be described in detail.

[0987] First, a user uses his / her own device to input a question or request using voice data or text data. This device can be a smartphone, tablet, or PC, and has a dedicated application installed. Through this application, the user can use the voice input function or text input function to input a request, such as "I would like to order sushi."

[0988] The server then obtains the user's login information and determines whether the user is a senior citizen. This login information includes the user name and password, and identifies the senior citizen based on the user's age and profile information stored in the database. The login information is processed using the SSL / TLS protocol as a security measure.

[0989] If the user is determined to be a senior, the generative AI on the server will suggest dining options and menu options based on the user's questions and requests. The generative AI will analyze the request entered by the user and generate an appropriate prompt. Based on this prompt, the AI ​​will search a database for restaurants and menus that are popular with seniors and generate suggestions. For example, in response to a request such as "I want to eat Japanese food," it will suggest nearby Japanese restaurants with good reviews and healthy menu items.

[0990] The suggested information is sent from the server to the user's device. The communication protocol used for this transmission is HTTP / HTTPS, and the information is provided in the form of text data or audio data. The user can check the detailed information of the restaurant and menu that suits them on the device, and place an order or make a reservation.

[0991] As additional services, the system also provides information on medical institutions and pharmacies, as well as safe transportation options. When a user requests medical information, the system provides the locations and business information of medical institutions near the user's current location, and suggests safe transportation options.

[0992] For example, if a user requests "I want to eat Japanese food" by voice, the application will suggest nearby Japanese restaurants and the day's recommended low-sodium menu. In this case, the prompt for the generative AI model is as follows:

[0993] User request: I want to eat Japanese food

[0994] Health Condition: High Blood Pressure

[0995] Allergies to consider: Nuts

[0996] Information required from the AI: A list of Japanese restaurants based on the user's request, along with details of their menus

[0997] This will allow senior users to use food delivery services that are tailored to their health conditions and preferences, supporting a safe and secure dietary lifestyle.

[0998] The flow of the specific process in the application example 1 will be described with reference to FIG.

[0999] Step 1:

[1000] A user uses his / her own terminal to input a question or request using voice data or text data.

[1001] Specifically, the user opens an application on a device such as a smartphone or tablet and uses the voice input function to say, "I would like to order sushi," or uses the text input function to input similar text. The input for this step is voice data or text data, and the output is text data indicating the user's request.

[1002] Step 2:

[1003] The terminal converts the voice data into text data.

[1004] Specifically, when voice input is made, the voice data is converted to text data using voice analysis software on the terminal (e.g., Google Cloud Speech-to-Text API). The input of this step is voice data, and the output is text data.

[1005] Step 3:

[1006] The server obtains the user's login information and determines that the user is a senior citizen.

[1007] Specifically, the server verifies the username and password entered by the user when logging in to the application, and obtains the user's age information from a database (e.g., MySQL). Whether the user is a senior citizen or not is determined based on the age information. The input for this step is the user's login information, and the output is the determination result as to whether the user is a senior citizen or not.

[1008] Step 4:

[1009] A generative AI on the server generates prompts to suggest dining options and menu options based on the user's questions and requests, and searches for information from a database.

[1010] Specifically, a generative AI (e.g., OpenAI's GPT model) generates a prompt based on the user's request, and uses the prompt to search a database for restaurant and menu information suitable for seniors. The input for this step is the user's request data, and the output is information about the suggested dining locations and menus.

[1011] Step 5:

[1012] The server transmits suggested dining options and menu information to the user.

[1013] Specifically, the server sends the suggested information to the user's terminal via HTTP / HTTPS protocol. The information may be provided in the form of text data or audio data. The input of this step is the suggested information, and the output is the suggested information sent to the user's terminal.

[1014] Step 6:

[1015] The terminal displays the suggested information to the user.

[1016] Specifically, the application on the terminal displays the received information on the user interface, and if voice data is available, uses voice synthesis software to provide the information by voice. The input of this step is the suggested information sent from the server, and the output is the information displayed or played back to the user.

[1017] Step 7:

[1018] The user enters any additional questions or requests and the system responds with support.

[1019] Specifically, when the user enters an additional request such as "Please tell me other low-salt menu items," the server again uses generative AI to search for appropriate information and provide it to the user. The input for this step is the additional request, and the output is additional suggested information.

[1020] In addition, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1021] The embodiment for carrying out the present invention includes the following specific contents.

[1022] 1. Incorporating an emotion engine:

[1023] The system is equipped with an emotion engine that recognizes the user's emotions, analyzes emotions from the user's voice and text data, and grasps the user's emotional state.

[1024] 2. Emotion-based personalized suggestions:

[1025] The system customizes tourist attraction and hotel suggestions based on the user's emotional state captured by the emotion engine: for example, if the user is feeling happy or excited, it will suggest vibrant tourist attractions and entertainment venues.

[1026] 3. Collect user emotional feedback:

[1027] The system encourages users to provide feedback on the suggested attractions and hotels, and their emotional feedback is used to train the emotion engine and improve its suggestions.

[1028] 4. Sending a Customized Proposal:

[1029] The system sends customized tourist spot and hotel suggestions to the user based on the sentiment. The suggestions are converted into an appropriate format (text data or voice data) and sent to the user's device.

[1030] These are some of the implementation forms of the present invention. This allows the system to recognize the user's emotions and provide customized tourist attractions and hotel suggestions based on the emotions. By collecting the user's emotional feedback, the system learns and improves the suggestions.

[1031] The process flow will be explained below.

[1032] Step 1: Run the emotion engine to recognize the user's emotions

[1033] The user inputs questions or requests into the terminal using voice data or text data.

[1034] An emotion engine on the server receives the user's voice or text data and analyzes the emotion.

[1035] The emotion engine uses voice recognition in the case of voice data, and natural language processing in the case of text data to grasp emotions.

[1036] Step 2: Sentiment-based personalized suggestions in action

[1037] The generative AI on the server receives the user's emotional state as understood from the emotion engine.

[1038] Generative AI will customize a database of tourist attractions and hotels based on emotions to generate suggestions.

[1039] The customized offers are sent from the server to the user's terminal.

[1040] Step 3: Collecting user emotion feedback

[1041] Users provide feedback on suggested attractions and hotels.

[1042] The user's emotional feedback is transmitted to the server via the terminal.

[1043] The server collects users' emotional feedback and uses it to learn the emotion engine and improve its suggestions.

[1044] Step 4: How Sending a Customized Offer Works

[1045] The server sends customized tourist spot and hotel suggestions to the user's terminal.

[1046] The suggestions are converted into an appropriate format (text or audio) and displayed in an easily accessible way to the user.

[1047] The above is a specific flow of the processing of the invention that combines an emotion engine. The emotion engine that recognizes the user's emotions analyzes the user's voice and text data to grasp the user's emotional state. The generative AI customizes suggestions of tourist spots and hotels based on the emotions and sends them to the user. The user's emotional feedback is collected and used by the server to learn the emotion engine and improve the suggestions. Finally, the customized suggestions are sent to the user's device, where the user can access and use them.

[1048] Example 2

[1049] Next, a description will be given of Example 2. In the following description, the data processing device 12 is referred to as a "server" and the robot 414 is referred to as a "terminal."

[1050] Current travel recommendation systems only provide uniform information without considering the user's age group or emotional state. As a result, appropriate information cannot be provided to senior users and users who want customized recommendations based on their emotions, resulting in lower satisfaction and limited use. In addition, the collection of user feedback and the use of learning from it have not been sufficiently carried out, and system improvements have been delayed. The purpose of this study is to solve the above problems.

[1051] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1052] In this invention, the server includes a means for a user to input a question or request by voice data or text data using the user's own terminal, a means for the server to obtain the user's login information and determine the user's age group, a means for a generative artificial intelligence on the server to suggest tourist spots and accommodations according to the user's questions and requests and the user's emotional state, a means for the server to transmit information on the tourist spots and accommodations suggested to the user, and a means for the terminal to collect user feedback and transmit it to the server. This enables customized suggestions based on the user's age group and emotional state, improving user satisfaction and enabling continuous improvement of the system using the collected feedback.

[1053] A "terminal" is an electronic device that a user uses to input voice or text data.

[1054] "Server" means a central processing unit for analyzing data received from Users and generating and sending appropriate offers.

[1055] "Generative artificial intelligence" refers to algorithms and systems that make customized suggestions based on a user's questions, desires, and emotional state.

[1056] "Emotional state" refers to the type of emotion (e.g., joy, excitement, sadness, etc.) analyzed from the user's voice data and text data.

[1057] A "tourist attraction" is a place or facility of interest that tourists are encouraged to visit.

[1058] "Accommodation facilities" refer to facilities such as hotels and inns where travelers can stay.

[1059] "Feedback" is data that expresses a user's opinions or thoughts about proposed information or services.

[1060] An "age group" is a specific group that is categorized based on a user's age.

[1061] "Medical services" refers to information about medical facilities and services that a user may require during their trip.

[1062] "Drug stores" is information about stores where medicines and medical supplies can be purchased.

[1063] A "safe means of transportation" is a highly safe means of transportation that is recommended for use by the user during the trip.

[1064] The present invention is a system that makes customization suggestions taking into account the user's emotional state and age group, and the procedure is described below.

[1065] Hardware and Software Used

[1066] The system includes a user terminal, a server, an emotion engine, and generative artificial intelligence. Specific software used includes a voice recognition engine, a text analysis engine, an emotion analysis engine, and a database management system. For example, a general voice recognition system is used for voice recognition, a general natural language processing tool is used for text analysis, and a general emotion analysis tool is used for emotion analysis.

[1067] Program Processing

[1068] The server first receives voice or text data from the user and analyzes it to understand the user's emotional state. A voice recognition engine and a text analysis engine are used for this. The emotion analysis engine evaluates the user's emotion (e.g., joy, surprise, sadness, etc.) from the analyzed data.

[1069] The server then uses generative artificial intelligence (AI) to generate recommendations for attractions and accommodations based on the user's age group and emotional state. The recommendations are customized to provide the user with the most appropriate options by pulling information from a database, such as a typical recommendation system.

[1070] The generated suggestions are sent from the server to the user's device, where the device can display or read the suggestions to the user. If the user provides feedback in response, the feedback is sent back to the server and analyzed by the emotion analysis engine. This allows the system to learn from the user's feedback based on their emotional state and use it to improve the accuracy of future suggestions.

[1071] Examples

[1072] For example, if a user verbally asks, "I want to do something fun with my friends this weekend," the system analyzes the voice data and recognizes that the user's emotional state is "excited." As a result, the system suggests lively events and entertainment venues (e.g., live concerts and amusement parks) to the user.

[1073] Examples of prompt statements

[1074] "I want to do something fun with my friends this weekend. Can you recommend some good places?"

[1075] In this way, the invention can take into account the user's age group and emotional state to provide personalized suggestions and collect user feedback for continuous improvement of the system.

[1076] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1077] Step 1:

[1078] The device receives voice or text data from the user. The user speaks into the device or types a question or request into the keyboard (example: "I want to do something fun with my friends this weekend"). This data is acquired through the device's microphone and keyboard. Input: Voice or text data containing the user's question or request. Output: Voice or text data to send to the server.

[1079] Step 2:

[1080] The terminal sends the user's voice data or text data to the server. In the case of voice data, encoding is performed, and in the case of text data, it is sent as is. Input: Voice data or text data obtained from the terminal. Output: Data sent to the server.

[1081] Step 3:

[1082] The server analyzes the data it receives and determines the user's emotional state. In the case of voice data, it is converted to text using a voice recognition engine, and emotion analysis is performed using a text analysis engine. An emotion analysis engine is used for emotion analysis. Input: User's voice data or text data. Output: User's emotional state (e.g., "excited").

[1083] Step 4:

[1084] The server obtains the user's login information and determines the age group. The login information contains basic information about the user, and the age group is analyzed based on that information. Input: User's login information. Output: User's age group (e.g., "young people").

[1085] Step 5:

[1086] The server uses generative artificial intelligence to generate suggestions for tourist attractions and accommodations based on the user's emotional state and age group. For example, amusement parks and live concerts are suggested based on the emotional state of "excitement" and the age group of "young people." Input: User's emotional state and age group. Output: Customized list of tourist attractions and accommodations.

[1087] Step 6:

[1088] The server converts the suggestions into text or audio data and sends it to the device. In the case of audio data, it uses a speech synthesis engine to convert the text to audio. Input: A list of customized suggestions. Output: Text or audio data sent to the device.

[1089] Step 7:

[1090] The terminal displays or plays audibly the suggestions received from the server to the user. The user can check the list of suggested tourist attractions and accommodations and obtain detailed information if necessary. Input: Text data or audio data sent from the server. Output: Displaying suggestions to the user or playing them audibly.

[1091] Step 8:

[1092] The user provides feedback on the proposed information. The user uses the terminal to input their thoughts and opinions on the proposed content by text or voice. Input: User feedback (voice data or text data). Output: Feedback data input to the terminal.

[1093] Step 9:

[1094] The device sends user feedback to the server. The feedback data is encoded in an easy-to-parse format. Input: User feedback data. Output: Feedback data sent to the server.

[1095] Step 10:

[1096] The server analyzes the user's feedback and determines the emotional state again. The feedback data is then analyzed by the emotion analysis engine and used to improve the quality of the next suggestions. Input: User's feedback data. Output: Emotion analysis results reflected in improvements.

[1097] (Application example 2)

[1098] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal".

[1099] Existing travel reservation systems and content distribution services are unable to make proposals that take into account the user's emotions, making it difficult to make optimal proposals that match the user's emotional state at any given time. In addition, particularly for seniors, there is a lack of support that responds to the user's emotions and special needs. This makes it difficult to improve user satisfaction and encourage repeat use.

[1100] The identification process by the identification processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means. In this invention, the server includes a means for a user to input a question or request by voice data or text data using his / her own terminal, a means for the server to acquire the user's login information and determine that the user is a senior citizen, a means for an emotion engine on the server to analyze the user's voice or text data and recognize the emotional state, a means for a generative AI to suggest tourist spots and hotels according to the user's question or request based on the emotional state recognized by the emotion engine, and a means for the server to transmit information on the suggested tourist spots and hotels to the user. This makes it possible to make suggestions optimized for the user's emotional state.

[1101] "User" means a person or entity that uses the system.

[1102] A "Terminal" is a device used by a User to access the System and enter or retrieve data.

[1103] "Voice data" refers to information input by a user through voice.

[1104] "Text data" refers to information entered by the user in the form of characters.

[1105] An "emotion engine" is a program or system that analyzes a user's voice or text data to recognize the user's emotional state.

[1106] An "emotional state" refers to the type of emotion a user is feeling (such as happiness, sadness, excitement, depression, etc.).

[1107] "Generative AI" is an artificial intelligence system that makes optimal suggestions based on the user's input information and emotional state.

[1108] "Tourist attractions" are travel destinations or places of interest that users can visit.

[1109] A "hotel" is a facility where users can stay.

[1110] "Suggestion" refers to the act of presenting options such as tourist spots and hotels to the user.

[1111] A "server" is a central computer system that receives input from users, processes data, and sends out various offers and information.

[1112] The present invention relates to a system for recommending optimal tourist spots and hotels based on the emotional state of a user. A specific embodiment for realizing this system is described below.

[1113] First, the user inputs a question or request using voice or text data on their own device. The device can be a smartphone, PC, tablet, etc. The data entered by the user is then sent to a server via the Internet.

[1114] The server acquires the user's login information and determines whether the user is a senior based on the login information by checking age information and past usage history.

[1115] Next, an "emotion engine" built on the server analyzes and recognizes the user's emotional state from the voice or text data. Examples of emotion engines include the NLP library SpaCy and the emotion analysis tool TextBlob.

[1116] Based on the emotional state recognized by the emotion engine, a generative AI on the server suggests tourist spots and hotels that correspond to the user's questions and requests. This generative AI searches for appropriate information from a database to make suggestions and generates prompt sentences. For example, it generates a prompt sentence such as "If the user is tired, recommend a hotel where they can relax."

[1117] The server sends the generated prompt sentences and information on suggested tourist spots and hotels to the user, allowing the user to receive suggestions optimized for his / her emotional state.

[1118] As a concrete example, if a user inputs "I'm a little tired," the emotion engine will recognize this and the generative AI will recommend hotels and tourist spots that have a relaxing effect. If a user asks the system, "Tell me some places where I can relax," the system will generate the prompt, "Please recommend some recommended places where I can relax based on the user's current emotional state."

[1119] By using this system, users can receive the optimal travel plan that matches their emotional state, improving the satisfaction of their travel experience. In addition, since it is specialized for seniors, it can also respond to the needs of each age group.

[1120] The flow of the specific process in the application example 2 will be described with reference to FIG.

[1121] Step 1:

[1122] A user uses their own device to input questions or requests using voice or text data. The input data is stored on the device as voice or text information. This data is then sent to a server via the internet. Input: User's voice data or text data. Output: Voice data or text data sent to the server.

[1123] Step 2:

[1124] The server receives the user's voice data or text data and also obtains the user's login information. Using the obtained login information, it is determined whether the user is a senior citizen. This determination is made by checking the user's age and past usage history. Input: User's login information. Output: Determination result of whether the user is a senior citizen.

[1125] Step 3:

[1126] An emotion engine on the server analyzes the user's voice or text data to recognize the emotional state. The emotion engine used can be an NLP library (e.g. SpaCy) or a sentiment analysis tool (e.g. TextBlob). Identifies the user's emotion (happiness, sadness, excitement, depression, etc.) through data analysis. Input: User's voice or text data. Output: Recognized emotional state.

[1127] Step 4:

[1128] A generative AI on the server suggests the most suitable tourist spots and hotels based on the recognized emotional state. The generative AI searches for appropriate information from a database and generates a prompt sentence that matches the user's emotional state. For example, it creates a prompt sentence that says, "If the user is tired, recommend a hotel where they can relax." Input: User's emotional state. Output: Generated prompt sentence and information on recommended tourist spots and hotels.

[1129] Step 5:

[1130] The server sends the generated prompt text and recommendation information to the user. The user can check this information on the terminal and select tourist spots and hotels that suit him / her. Input: The generated prompt text and recommendation information. Output: Information sent to the user's terminal.

[1131] Step 6:

[1132] The user selects the recommended tourist spot or hotel and actually visits / uses it. After that, the user again sends emotional feedback to the server, which helps improve the next suggestion. Emotional feedback is also sent from the device to the server. Input: User's emotional feedback. Output: Emotional feedback stored on the server.

[1133] This allows optimal suggestions to be made in accordance with the user's emotional state through a series of processes, thereby improving user satisfaction.

[1134] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires a voice indicating a user input for the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[1135] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by making a neural network perform deep learning. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating a voice, text data indicating a text, and image data indicating an image is input. The data generation model 58 performs inference on the input inference data according to the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1136] In the above embodiment, an example was given in which the specific process was performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the robot 414.

[1137] The emotion identification model 59 as an emotion engine may determine the emotion of the user according to a specific mapping. Specifically, the emotion identification model 59 may determine the emotion of the user according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the emotion of the robot, and the identification processing unit 290 may perform identification processing using the emotion of the robot.

[1138] FIG. 9 is a diagram showing an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive emotions are arranged. The more outside the concentric circles, the more emotions that represent states and actions that arise from a state of mind are arranged. Emotions are a concept that includes emotions and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions that occur in the brain are arranged. On the right side of the concentric circles, emotions that are generally induced by situational judgment are arranged. On the upper and lower sides of the concentric circles, emotions that are generally generated from reactions that occur in the brain and are induced by situational judgment are arranged. In addition, on the upper side of the concentric circles, emotions of "pleasure" are arranged, and on the lower side, emotions of "discomfort" are arranged. In this way, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[1139] These emotions are distributed in the 3 o'clock direction of emotion map 400 and usually fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[1140] The inside of emotion map 400 represents what is going on inside one's mind, and the outside of emotion map 400 represents behavior, so the further out you go on emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[1141] Here, human emotions are based on various balances such as posture and blood sugar level, and when these balances are far from the ideal, it indicates an unpleasant state, and when they are close to the ideal, it indicates a pleasant state. Emotions can also be created for robots, cars, motorcycles, etc., based on various balances such as posture and battery level, so that when these balances are far from the ideal, it indicates an unpleasant state, and when they are close to the ideal, it indicates a pleasant state. The emotion map may be generated, for example, based on the emotion map of Dr. Mitsuyoshi (Research on speech emotion recognition and emotion brain physiological signal analysis system, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). On the left half of the emotion map, emotions belonging to an area called "reaction" where sensation is dominant are lined up. On the right half of the emotion map, emotions belonging to an area called "situation" where situation recognition is dominant are lined up.

[1142] The emotion map defines two emotions that promote learning. The first is the negative emotion around the middle of "repentance" or "remorse" on the situation side. In other words, this is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the positive emotion around "desire" on the response side. In other words, this is when the robot has positive feelings such as "I want more" or "I want to know more."

[1143] The emotion identification model 59 inputs the user input to a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the emotion of the user. This neural network is pre-trained based on multiple learning data that are combinations of the user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in Fig. 10. Fig. 10 shows an example in which multiple emotions, "relief," "calm," and "encouraging," have similar emotion values.

[1144] Although the system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, the system according to the present disclosure is not necessarily implemented in a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program that runs on a personal computer, or an application that runs on a smartphone or the like. The method according to the present disclosure may be provided to a user in the form of SaaS (Software as a Service).

[1145] In the above embodiment, an example is given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to input data.

[1146] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable computer-readable non-transitory storage medium such as a Universal Serial Bus (USB) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[1147] In addition, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 upon request from the data processing device 12.

[1148] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[1149] As the hardware resource for executing the specific process, various processors as shown below can be used. An example of the processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing the specific process by executing software, i.e., a program. Another example of the processor is a dedicated electric circuit, which is a processor having a circuit configuration designed exclusively for executing the specific process, such as a Field-Programmable Gate Array (FPGA), a Programmable Logic Device (PLD), or an Application Specific Integrated Circuit (ASIC). Each processor has a built-in or connected memory, and each processor executes the specific process by using the memory.

[1150] The hardware resource that executes the specific process may be one of these various processors, or may be a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific process may be a single processor.

[1151] As an example of a configuration using one processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a configuration using a processor that realizes the functions of the entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[1152] Furthermore, more specifically, the hardware structure of these various processors can be an electric circuit that combines circuit elements such as semiconductor elements. The specific processes described above are merely examples. It goes without saying that unnecessary steps may be deleted, new steps may be added, or the order of processes may be changed without departing from the spirit of the invention.

[1153] The above description and illustrations are detailed descriptions of the parts related to the technology of the present disclosure, and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, function, action, and effect is an example of the configuration, function, action, and effect of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above description and illustrations, within the scope of the gist of the technology of the present disclosure. In addition, in order to avoid confusion and to facilitate understanding of the parts related to the technology of the present disclosure, the above description and illustrations omit explanations of technical common sense that do not require explanation in order to enable the implementation of the technology of the present disclosure.

[1154] All publications, patent applications, and standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or standard was specifically and individually indicated to be incorporated by reference.

[1155] The following is further disclosed regarding the above embodiment.

[1156] (Claim 1) A system for providing a travel reservation application specialized for seniors, comprising: A means for a user to input questions or requests using voice data or text data using his / her own terminal; A means for a server to acquire login information of a user and determine that the user is a senior citizen; A generative AI on the server can suggest tourist spots and hotels based on the user's questions and requests. A means for the server to transmit information on recommended tourist attractions and hotels to the user; A system including: (Claim 2) A means for the server to provide information about medical facilities, pharmacy locations, and safe transportation options; a means for the server to provide support to the user in response to further questions or requests; The system of claim 1 further comprising: (Claim 3) A means for the server to generate a prompt for suggesting tourist spots and hotels that are popular among seniors based on the login information of the user;

[1157] The generative AI on the server searches the database for information on tourist spots and hotels for seniors and makes suggestions. The system of claim 1 or claim 2, further comprising: (Claim 4) Combined with an emotion engine that recognizes the user's emotions, 2. The system of claim 1. (Claim 5) In the system according to claim 4, the emotion engine analyzes emotions from the user's voice and text data to grasp the user's emotional state. (Claim 6) The system of claim 5, wherein the emotion engine customizes attraction and hotel suggestions based on the user's emotional state. The above is an additional claim of the invention that combines an emotion engine that recognizes the user's emotions, so that the system can recognize the user's emotions and provide customized tourist spots and hotel suggestions according to the emotions.

[1158] "Example 1" (Claim 1) A means for a user to input questions or requests using voice data or text data using his / her own information device; A means for a server to acquire authentication information of a user and determine that the user is a senior citizen; A generative AI on the server can suggest tourist spots and accommodations based on users' questions and requests. A means for the server to transmit information on tourist attractions and accommodations suggested to the user; A system including: (Claim 2) A means for the server to provide information about medical facilities, pharmacy locations, and safe transportation options; a means for the server to provide support to the user in response to further questions or requests; The system of claim 1 further comprising: (Claim 3) A means for the server to generate a prompt for suggesting tourist spots and accommodations that are popular among seniors based on the authentication information of the user; The generative AI on the server searches the database for information on tourist destinations and accommodations for seniors and makes suggestions. The system of claim 1 further comprising:

[1159] "Application example 1" (Claim 1) A means for a user to input questions or requests using voice data or text data using his / her own terminal; A means for a server to acquire login information of a user and determine that the user is a senior citizen; A means for a generative AI on the server to suggest dining options and menus based on the user's questions and requests, A means for the server to transmit information on suggested dining locations and menus to the user; A system including: (Claim 2) A means for the server to provide information about medical facilities, pharmacy locations, and safe transportation options; a means for the server to provide support to the user in response to further questions or requests; The system of claim 1 further comprising: (Claim 3) A means for the server to generate a prompt for suggesting dining spots and menus that are popular among seniors based on the login information of the user; A generative AI on the server searches a database for information on dining spots and menus for seniors and makes suggestions. The system of claim 1 further comprising:

[1160] "Example 2 of combining emotion engines" (Claim 1) A means for a user to input questions or requests using voice data or text data using his / her own terminal; A means for the server to obtain user login information and determine the user's age group; A means for a generative artificial intelligence on the server to suggest tourist spots and accommodations according to the user's questions, requests, and emotional state; A means for the server to transmit information on recommended tourist spots and accommodations to the user; A means for the terminal to collect user feedback and transmit it to a server; A system including: (Claim 2) A means by which the server provides information about medical services, drug store locations, and safe transportation options; a means for the server to provide support to the user in response to further questions or requests; The system of claim 1 further comprising: (Claim 3) A means for the server to generate a prompt for suggesting popular tourist spots and accommodations based on the login information and emotional state of the user; A generative artificial intelligence on the server searches a database for information on tourist spots and accommodations based on the user's emotional state and suggests the information; The system of claim 1 further comprising:

[1161] "Application example 2 when combining emotion engines" (Claim 1) A means for a user to input questions or requests using voice data or text data using his / her own terminal; A means for a server to acquire login information of a user and determine that the user is a senior citizen; a means for an emotion engine on the server to analyze the user's voice or text data and recognize the user's emotion state; A means for generative AI to suggest tourist spots and hotels in response to user questions and requests based on the emotional state recognized by the emotion engine; A means for the server to transmit information on recommended tourist attractions and hotels to the user; A system including: (Claim 2) A means for the server to provide information about medical facilities, pharmacy locations, and safe transportation options; a means for the server to provide support to the user in response to further questions or requests; The system of claim 1 further comprising: (Claim 3) A means for the server to generate a prompt for suggesting tourist spots and hotels that are popular among seniors based on the login information and emotional state of the user; The generative AI on the server searches the database for information on tourist spots and hotels for seniors and makes suggestions. The system of claim 1 further comprising: [Explanation of symbols]

[1162] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Device 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robot< / url:> < / url:> < / url:> < / url:>

Claims

1. A means for determining whether or not the user's age is equal to or greater than a predetermined age; a means for selecting tourist-related places to be visited that are recommended for people of a predetermined age or older in accordance with the voice data or text data input by the user when the user's age is a predetermined age or older; means for transmitting the result of the selection of the places to be visited to a terminal operated by the user; A system including:

2. The means for selecting a place to visit includes: generating a prompt for selecting recommended tourism related places to visit for persons over a predetermined age; inputting the prompt to a generative AI to obtain a selection result of the places to visit output from the generative AI; The system of claim 1 .

3. The generating AI selects the places to visit by searching a database in which data on places to visit recommended for people of a certain age or older is stored in advance. The system of claim 2.

4. means for acquiring an emotional state of a user, The means for selecting a place to visit includes: generating the prompt responsive to an emotional state of the user; inputting the prompt to a generative AI to obtain a selection result of the places to visit output from the generative AI; A system according to claim 2 or claim 3.

Images