system

Abstract

We provide the system. [Solution] A means for the user to input location and desired conditions, A means for transmitting the location and desired conditions information entered by the user to the server, A means for searching a tourist destination database based on the aforementioned location and desired conditions and obtaining the corresponding tourist destination, A system including means for returning the acquired tourist destination information to the user.

Description

Technical Field

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a method for controlling a persona chatbot, which is performed by at least one processor, including steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In modern society, when people search for tourist destinations, a lot of information is scattered on the Internet, and it is not easy to find a tourist destination that meets their needs from among them. Also, due to the inaccuracy of the schedules of transportation facilities and other factors, a reliable information source is required. Furthermore, since the information on tourist destinations is scattered, there is a problem that it is difficult to make a plan based on inconsistent information.

Means for Solving the Problems

[0005] To solve the above problems, the present invention provides a system that includes means for a user to input a location and desired conditions, means for transmitting the location and desired conditions information entered by the user to a server, means for searching a tourist destination database based on the location and desired conditions and obtaining the corresponding tourist destination, and means for returning the obtained tourist destination information to the user. With the present invention, users can quickly and accurately obtain tourist destination information that matches their desired conditions and efficiently plan their trips.

[0006] A "user" is a person who attempts to obtain tourist destination information using this system.

[0007] "Location" refers to information that indicates the user's current location or place of origin.

[0008] "Desired conditions" refer to information that indicates the characteristics and conditions of the tourist destination that the user is looking for (e.g., day trip, place with abundant nature).

[0009] "Means of input" refers to the interface (e.g., web form or application) that allows users to input their location and desired conditions into the system.

[0010] A "server" is a remote computer system that receives and processes information sent by a user.

[0011] "Means of transmission" refers to the means of communication (e.g., internet connection) used to send information entered by the user to the server.

[0012] A "tourist destination database" is a collection of data that stores information about tourist destinations (e.g., location, category, name of tourist destination).

[0013] "Means of searching and retrieving" refers to algorithms and programs that allow a server to search for information within a tourist destination database and retrieve the relevant tourist destination information.

[0014] The "means for sending back" refers to the communication means for sending back the tourist destination information acquired by the server to the user's terminal.

[0015] The "visually displayed format" refers to the format (e.g., list display or card format) in which the tourist destination information is formatted so as to be easily viewed on the user's terminal.

Brief Explanation of Drawings

[0016] [Figure 1] It is a conceptual diagram showing an example of the configuration of the data processing system according to the first embodiment. [Figure 2] It is a conceptual diagram showing an example of the main functions of the data processing device and the smart device according to the first embodiment. [Figure 3] It is a conceptual diagram showing an example of the configuration of the data processing system according to the second embodiment. [Figure 4] It is a conceptual diagram showing an example of the main functions of the data processing device and the smart glasses according to the second embodiment. [Figure 5] It is a conceptual diagram showing an example of the configuration of the data processing system according to the third embodiment. [Figure 6] It is a conceptual diagram showing an example of the main functions of the data processing device and the headset-type terminal according to the third embodiment. [Figure 7] It is a conceptual diagram showing an example of the configuration of the data processing system according to the fourth embodiment. [Figure 8] It is a conceptual diagram showing an example of the main functions of the data processing device and the robot according to the fourth embodiment. [Figure 9] It shows an emotion map to which a plurality of emotions are mapped. [Figure 10] It shows an emotion map to which a plurality of emotions are mapped. [Figure 11] It is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] It is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13]It is a sequence diagram showing the processing flow of the data processing system in Embodiment 2 when combined with an emotion engine. [Figure 14] It is a sequence diagram showing the processing flow of the data processing system in Application Example 2 when combined with an emotion engine.

Modes for Carrying Out the Invention

[0017] Hereinafter, an example of an embodiment of the system according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0018] First, the terms used in the following description will be explained.

[0019] In the following embodiments, the numbered processor (hereinafter simply referred to as "processor") may be one arithmetic unit or a combination of multiple arithmetic units. Also, the processor may be one type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), and the like.

[0020] In the following embodiments, the numbered RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor.

[0021] In the following embodiments, the numbered storage is one or more non-volatile storage devices that store various programs and various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes, etc.

[0022] In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).

[0023] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0024] [First Embodiment]

[0025] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0026] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0027] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0028] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0029] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0030] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0031] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0032] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0033] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0034] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0035] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0036] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0037] This system is designed to allow users to efficiently and accurately obtain information that matches their preferences when searching for tourist destinations. Specifically, when a user enters their location and desired conditions into their terminal, that information is sent to a server, which searches the tourist destination database to retrieve relevant information and then sends it back to the user.

[0038] Key components of the system

[0039] 1. User Input Interface

[0040] Users enter their location and desired conditions via their device (e.g., smartphone, computer). The input interface is provided in a simple and easy-to-use form format. For example, "location" and "desired conditions" could be selected using text boxes or dropdown menus.

[0041] 2. Information transmission by terminals

[0042] The terminal sends the location and desired conditions entered by the user to the server. Technically, this process utilizes a structured data format such as JSON.

[0043] 3. Searching tourist destination databases via server

[0044] The server searches the tourist destination database based on the received location and desired conditions. The database holds basic information and attribute information for each tourist destination, and the server creates a list of tourist destinations that match the specified conditions.

[0045] 4. Server returns data

[0046] The server returns the tourist destination information obtained as search results to the terminal in a structured format (e.g., JSON). This information includes a list of tourist destinations that best match the user's preferences.

[0047] 5. Information display via terminal

[0048] The terminal visually displays a list of tourist destinations received from the server to the user. The display format used is one that is easy for the user to understand intuitively, such as a list view or a card format.

[0049] Explanation of the program's processing

[0050] The user enters their location and desired conditions.

[0051] The user enters their location (e.g., Tokyo) and desired conditions (e.g., day trip, nature-rich location) into the designated input fields on the device. The device collects this information.

[0052] The terminal sends input to the server.

[0053] The terminal converts the data entered by the user into a format such as JSON and sends it to the server. For example, the following data is sent:

[0054] json

[0055] {

[0056] "location": "Tokyo",

[0057] "Preferences": "Day trips, places with abundant nature"

[0058] }

[0059] The server searches the tourist destination database.

[0060] The server searches a tourist destination database based on the input data it receives. This database contains detailed information about each tourist destination, including its location and attributes. The server picks out tourist destinations that match the criteria and creates a list. For example, "Mount Takao," "Lake Kawaguchi," "Okutama," and "Nikko" might be included.

[0061] The server returns the results to the user.

[0062] The server creates a list of tourist destinations in JSON format and sends it back to the terminal. The returned data will look like this:

[0063] json

[0064] {

[0065] "recommendations": ["Mount Takao", "Lake Kawaguchi", "Okutama", "Nikko"]

[0066] }

[0067] The device displays the results to the user.

[0068] The terminal displays a list of tourist destinations received from the server in a user-friendly format. For example, it may display the following visual information:

[0069] The following tourist destinations are recommended:

[0070] Mount Takao

[0071] Lake Kawaguchi

[0072] Okutama

[0073] sunlight

[0074] Specific example

[0075] For example, if a user enters "lives in Tokyo, day trip, nature-rich location," the device sends this information to the server. The server then searches its tourist destination database for places like "Mount Takao," "Lake Kawaguchi," "Okutama," and "Nikko," and returns a list. This allows the user to quickly obtain information on tourist destinations that match their preferences and use it as a reference to decide on their next outing.

[0076] The above describes an example of an embodiment for specifically implementing the present invention. This system allows users to efficiently obtain tourist destination information and create more comprehensive travel plans.

[0077] The following describes the processing flow.

[0078] Step 1:

[0079] The user enters their location and desired conditions.

[0080] The user enters their location (e.g., Tokyo) and desired conditions (e.g., day trip, nature-rich location) into the device's interface. The device then retrieves this information.

[0081] Step 2:

[0082] The terminal sends user input to the server.

[0083] The terminal converts user input into a structured data format such as JSON and sends it to the server over the internet. At this point, the server receives the request and prepares to begin analysis.

[0084] Step 3:

[0085] The server analyzes the user's input information.

[0086] The server parses the received JSON data to obtain the user's location and desired conditions. Based on the parsed data, the server prepares to search the tourist destination database.

[0087] Step 4:

[0088] The server searches the tourist destination database.

[0089] The server searches the tourist destination database based on the user's location and desired conditions. For example, the server retrieves tourist destinations from the database that match the criteria of "Tokyo," "day trip," and "places rich in nature." In this process, it generates a list of tourist destinations that meet the conditions.

[0090] Step 5:

[0091] The server formats the search results and sends them back to the terminal.

[0092] The server formats the tourist destination information obtained as search results into a structured format such as JSON and sends it back to the terminal. The data returned from the server includes a list of the relevant tourist destinations.

[0093] Step 6:

[0094] The terminal receives data from the server.

[0095] The terminal receives the data sent back from the server and analyzes it. It verifies that the received data is in the correct format and prepares to proceed to the next step.

[0096] Step 7:

[0097] The device displays tourist destination results to the user.

[0098] The terminal visualizes the received data and displays it in a user-friendly format (e.g., list view, card view). Users can view information about tourist destinations suggested by the server through the terminal's screen.

[0099] By following these steps, users can efficiently obtain tourist destination information that suits their preferences and easily decide on their next travel destination.

[0100] (Example 1)

[0101] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0102] Modern tourist destination information systems have a problem in that it is difficult for users to efficiently and accurately find tourist destinations that meet their preferences. Furthermore, the process from information acquisition to display is often cumbersome, resulting in a poor user experience.

[0103] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0104] In this invention, the server includes means for the user to input location and desired conditions, means for transmitting the location and desired conditions information entered by the user to the server via a terminal, means for the server to search a tourist destination database based on the received location and desired conditions and obtain the corresponding tourist destination, means for returning the obtained tourist destination information to the user's terminal in a structured format, and means for the terminal to visually display the received tourist destination information to the user. This makes it possible for the user to efficiently and accurately obtain tourist destination information that matches their preferences and to visually confirm the information.

[0105] A "user" is someone who uses this system to obtain tourist destination information.

[0106] A "terminal" is a device used by a user (e.g., a smartphone or personal computer) that is used for inputting and displaying information.

[0107] A "server" is a central processing unit that receives data sent by users, searches a tourist destination database, and returns appropriate information.

[0108] "Location" refers to the user's current location and is geographical information used as a basis for searching for tourist destination information.

[0109] "Desired conditions" refer to requirements that indicate the characteristics and features of the tourist destination that the user is looking for, and include, for example, "day trip" or "a place rich in nature."

[0110] A "tourist destination database" is a database that stores information on various tourist destinations and has a structure that allows searching based on specific criteria.

[0111] "JSON format" is a data exchange format, an abbreviation for JavaScript® Object Notation, which represents structured data in text format.

[0112] An "HTTP POST request" is part of the protocol used in web communication for a client to send data to a server.

[0113] "Visual display" means presenting information to the user in a visually easy-to-understand format on a device, such as lists or card formats.

[0114] This invention provides a system that allows users to efficiently and accurately obtain information that matches their preferences when searching for tourist destinations. In this system, when a user inputs their location and desired conditions into a terminal, that information is sent to a server, which searches a tourist destination database, retrieves relevant tourist destination information, and returns it to the user.

[0115] User actions

[0116] Users utilize devices such as smartphones or personal computers. First, users enter their current location (e.g., "Tokyo") and desired conditions (e.g., "day trip, nature-rich location") into the device's input interface. This input interface is provided in a simple and user-friendly format using text boxes and dropdown menus.

[0117] Data transmission by terminal

[0118] The terminal uses an HTTP POST request to convert the location and preference information entered by the user into JSON format and send it to the server. For example, the data is sent in the following format:

[0119] json

[0120] {

[0121] "location": "Tokyo",

[0122] "Preferences": "Day trips, places with abundant nature"

[0123] }

[0124] Data processing by the server

[0125] The server receives an HTTP POST request and parses the JSON data. Based on the parsed data, it searches the tourist destination database. The database holds the locations, categories, and names of numerous tourist destinations. The server filters the tourist destinations that match the specified criteria and creates a list of the relevant destinations. Examples include "Mount Takao," "Lake Kawaguchi," "Okutama," and "Nikko."

[0126] Data return from server to terminal

[0127] The server formats the search results into JSON format and sends them back to the terminal. The returned data will be in the following format:

[0128] json

[0129] {

[0130] "recommendations": ["Mount Takao", "Lake Kawaguchi", "Okutama", "Nikko"]

[0131] }

[0132] Data display via device

[0133] The terminal analyzes the list of tourist destinations received from the server and displays it to the user in a visually easy-to-understand format. This display format could be a list view or a card view. For example, it might be displayed as follows:

[0134] The following tourist destinations are recommended:

[0135] Mount Takao

[0136] Lake Kawaguchi

[0137] Okutama

[0138] sunlight

[0139] Specific example

[0140] When a user enters "Resident of Tokyo, day trip, nature-rich location," the device sends this information to the server. The server searches a tourist destination database and compiles a list of matching tourist destinations such as "Mt. Takao," "Lake Kawaguchi," "Okutama," and "Nikko," which are then sent back to the device. The device analyzes this returned data and displays it visually to the user, allowing them to quickly obtain information about tourist destinations that match their preferences.

[0141] Furthermore, when using a generative AI model to explain the system, the following prompt statements can be used:

[0142] I live in Tokyo and am looking for a day trip to a place with abundant nature. Could you recommend some tourist spots?

[0143] This system allows users to easily create more fulfilling travel plans.

[0144] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0145] Step 1:

[0146] The user enters their location and desired conditions into the device's input interface. Specifically, they enter information such as "Tokyo" or "day trip, nature-rich location" into text boxes or dropdown menus. The entered information is temporarily stored in the device's memory.

[0147] input:

[0148] Location: Tokyo

[0149] Desired conditions: Day trip, location with abundant nature

[0150] output:

[0151] User input data stored on the device

[0152] Step 2:

[0153] The terminal converts the data entered by the user into JSON format. This conversion is performed by a program within the terminal. The converted data will look like this:

[0154] json

[0155] {

[0156] "location": "Tokyo",

[0157] "Preferences": "Day trips, places with abundant nature"

[0158] }

[0159] The converted JSON data is sent to the server using an HTTP POST request.

[0160] input:

[0161] User input data

[0162] output:

[0163] Data converted to JSON format

[0164] Step 3:

[0165] The server receives an HTTP POST request and extracts JSON data from the request body. A program on the server performs this extraction process and parses the extracted data. Specifically, it analyzes the data content and extracts "location" and "desired conditions" individually.

[0166] input:

[0167] HTTP POST request

[0168] output:

[0169] Data of analyzed location and desired conditions

[0170] Step 4:

[0171] The server searches a tourist destination database based on the analyzed data. This database stores information such as the location, category, and name of tourist destinations. A query program within the server performs a search on the database and retrieves a list of tourist destinations that match the criteria. For example, "Mount Takao," "Lake Kawaguchi," "Okutama," and "Nikko" are among the tourist destinations that match the criteria.

[0172] input:

[0173] Data of analyzed location and desired conditions

[0174] output:

[0175] List of tourist destinations that match the criteria

[0176] Step 5:

[0177] The server formats the retrieved list of tourist destinations into JSON format. This formatting process is performed by a data format conversion program within the server. The formatted data will look like this:

[0178] json

[0179] {

[0180] "recommendations": ["Mount Takao", "Lake Kawaguchi", "Okutama", "Nikko"]

[0181] }

[0182] The formatted JSON data is sent back to the terminal as an HTTP response.

[0183] input:

[0184] List of tourist destinations that match the criteria

[0185] output:

[0186] List of tourist destinations formatted in JSON format

[0187] Step 6:

[0188] The terminal parses the JSON data received from the server. A program within the terminal parses the JSON data and converts it into data for visual display. The converted data is displayed on the terminal screen in a user-friendly format. For example, it might look like this:

[0189] The following tourist destinations are recommended:

[0190] Mount Takao

[0191] Lake Kawaguchi

[0192] Okutama

[0193] sunlight

[0194] input:

[0195] JSON data received from the server

[0196] output:

[0197] A list of tourist destinations displayed visually to the user.

[0198] This allows users to efficiently and accurately obtain tourist destination information that matches their preferences.

[0199] (Application Example 1)

[0200] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0201] In current factories, managing parts and materials is cumbersome, making it difficult to quickly locate specific parts and deliver them to designated locations. This problem leads to decreased productivity and increased working hours. To solve this problem, the present invention aims to provide a system in which a robot efficiently locates parts and delivers them quickly to a designated location simply by the user inputting the part's location and desired conditions.

[0202] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0203] In this invention, the server includes means for a user to input the location of a part and desired conditions; means for transmitting the information of the part location and desired conditions entered by the user to the server; means for searching a parts database based on the part location and desired conditions and obtaining the corresponding part; means for returning the obtained part information to the user; and robot control means for delivering the obtained part to a specific location. This enables efficient searching and rapid delivery of parts.

[0204] A "user" refers to a person who operates the system and enters the location of the parts and their desired specifications.

[0205] "Part location" refers to information indicating the physical location of a specific part within a factory.

[0206] "Desired conditions" refers to information indicating the attributes or conditions that a user desires for a particular part.

[0207] A "server" refers to a computer system that receives input information from users, searches a parts database, and returns the results.

[0208] A "parts database" refers to a collection of data containing information such as the location, category, and name of a part.

[0209] A "robot" refers to an autonomous mechanical device that searches for, retrieves, and delivers specified parts to a designated location.

[0210] "Robot control means" refers to a control system that enables a robot to perform specified tasks according to the user's requests.

[0211] This invention is a system for efficiently searching for specified parts within a factory and for rapid delivery. The system includes a user input interface, information transmission means, a server, a parts database, a robot, and robot control means.

[0212] Key components of the system

[0213] 1. User Input Interface

[0214] Users enter the part location and desired specifications via a device (e.g., tablet, smartphone, work computer). The input interface is provided in an easy-to-use form format. For example, the "part location" and "desired specifications" could be selected using text boxes or dropdown menus.

[0215] 2. Information transmission by terminals

[0216] The terminal transmits information about the part's location and desired specifications entered by the user to the server. Technically, this process utilizes a structured data format such as JSON.

[0217] 3. Server-based parts database search

[0218] The server searches the parts database based on the received part location and desired conditions. The database holds basic information and attribute information for each part, and the server creates a list of parts that match the specified conditions.

[0219] 4. Server returns data

[0220] The server returns the retrieved part information as search results to the terminal in a structured format (e.g., JSON). This information includes a list of parts that best match the user's desired conditions.

[0221] 5. Information display via terminal

[0222] The terminal visually displays a list of parts received from the server to the user. The display format used is one that is easy for the user to understand intuitively, such as a list view or a card format.

[0223] 6. Robot control means

[0224] The robot searches for specified parts based on information received from the server, efficiently retrieves them, and delivers them to the designated location. The robot control system controls the robot's movements and enables it to perform its tasks.

[0225] Program processing

[0226] 1. The user enters the part location and desired specifications into the terminal's input fields. The terminal collects this information and converts it to JSON format.

[0227] 2. The terminal sends data entered by the user to the server. For example, the following data is sent:

[0228] {

[0229] "location": "Area A-3",

[0230] "preferences": "Type 1024 cover"

[0231] }

[0232] 3. The server searches the parts database based on the received input data. This database contains detailed information about each part, including its location and attributes. The server picks out parts that match the criteria and creates a list. For example, "Type 1024 Cover" and "Type 2035 Screw" might be included.

[0233] 4. The server creates a list of parts in JSON format and sends it back to the terminal. The data sent back will look like this:

[0234] {

[0235] "recommendations": ["Type 1024 cover", "Type 2035 screws"]

[0236] }

[0237] 5. The terminal displays the list of components received from the server in a user-friendly format. For example, it may display the following visual information:

[0238] The following parts were found:

[0239] Type 1024 cover

[0240] 2035 type screw

[0241] 6. The robot searches for the specified part, retrieves it, and delivers it to the user's desired location.

[0242] Specific example

[0243] For example, if a user enters "Area A-3, Type 1024 cover," the terminal sends this information to the server, which searches the parts database for parts such as "Type 1024 cover" and "Type 2035 screw," and returns a list. This allows the user to quickly obtain information on parts that match their needs, and the robot can retrieve the specified parts and deliver them to the required location.

[0244] Examples of prompts to input into a generative AI model:

[0245] Please enter the location of the part and the part you want:

[0246] "Area A-3, Type 1024 cover"

[0247] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0248] Step 1:

[0249] The user enters the part location and desired specifications into the input fields on the terminal. The user specifies the "part location" and "desired specifications" using text boxes and dropdown menus displayed on the terminal. For example, they might enter "Area A-3" and "Type 1024 Cover". This information is stored as a variable within the terminal.

[0250] Step 2:

[0251] The terminal converts the collected user input into JSON format. It converts the user-entered part locations and desired conditions into key-value pairs, generating structured JSON data. The generated JSON will look like this:

[0252] {

[0253] "location": "Area A-3",

[0254] "preferences": "Type 1024 cover"

[0255] }

[0256] Step 3:

[0257] The device sends the generated JSON data to the server. In doing so, the device uses an HTTP POST request to send the data to the server's API endpoint. The server receives this request and interprets the data.

[0258] Step 4:

[0259] The server parses the received JSON data and searches the parts database. The server queries the database using the conditions "Area A-3" and "Type 1024 Cover" and extracts the relevant parts information. The parts database includes the location, category, and name of each part.

[0260] Step 5:

[0261] The server structures the list of matching parts obtained as search results in JSON format. For example, if the search results match "Type 1024 cover" and "Type 2035 screw," it generates JSON data like the following:

[0262] {

[0263] "recommendations": ["Type 1024 cover", "Type 2035 screws"]

[0264] }

[0265] Step 6:

[0266] The server sends structured JSON data back to the device. In this process, the JSON data is sent as an HTTP response. The device receives this response and retrieves the data.

[0267] Step 7:

[0268] The terminal parses the received JSON data and displays it visually to the user. The terminal's UI provides the user with the relevant component information in list or card format. For example, the display might look like this:

[0269] The following parts were found:

[0270] Type 1024 cover

[0271] 2035 type screw

[0272] Step 8:

[0273] The robot searches for and retrieves the specified part based on the part information transmitted from the server. The robot control system autonomously moves and acquires the part based on the part's location and the name of the specified part.

[0274] Step 9:

[0275] The robot delivers the extracted parts to a specific location. Finally, the robot control system operates to deliver the parts to the designated destination and issues a notification when delivery is complete.

[0276] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0277] This system is designed to allow users to efficiently and accurately obtain information that matches their preferences when searching for tourist destinations. Furthermore, it incorporates an emotion engine to recognize the user's emotional state and recommend the most suitable tourist destinations based on that state.

[0278] Key components of the system

[0279] 1. User Input Interface

[0280] The user inputs their location and desired conditions via a terminal (e.g., smartphone, personal computer). The input interface is provided in a concise and user-friendly form. For example, a form where "location" and "desired conditions" are selected using text boxes or dropdown menus is conceivable.

[0281] 2. Information Transmission by the Terminal

[0282] The terminal converts the information input by the user into a structured data format such as JSON and transmits it to the server via the Internet.

[0283] 3. Sentiment Analysis of the User by the Server

[0284] The server incorporates a sentiment engine that analyzes the user's input content, voice data, and image data to estimate the user's sentiment state. For example, the sentiment of the text input by the user is analyzed using natural language processing technology.

[0285] 4. Server Searches the Tourism Destination Database

[0286] The server searches the tourism destination database based on the received location and desired conditions, as well as the analyzed user sentiment state. The database holds the basic information and attribute information of each tourism destination, and the server creates a list of tourism destinations that match the specified conditions.

[0287] 5. Server Formats and Returns the Search Results

[0288] The server formats the appropriate tourism destination information and returns it to the user's terminal. This information consists of a list of optimal tourism destinations based on the user's location, desired conditions, and sentiment state.

[0289] 6. Information Display by the Terminal

[0290] The terminal receives a list of tourist destinations sent back from the server and displays it visually to the user. The display format used is one that is easy for the user to understand intuitively, such as a list view or a card format.

[0291] Explanation of the program's processing

[0292] The user enters their location and desired conditions.

[0293] The user enters their location (e.g., Tokyo) and desired conditions (e.g., day trip, nature-rich location) into the terminal's input fields. The terminal then retrieves this information.

[0294] The terminal sends input to the server.

[0295] The terminal converts the user's input data into a structured data format such as JSON and sends it to the server. The server receives the request and begins parsing.

[0296] The server analyzes the user's input and emotions.

[0297] The server parses the received JSON data to obtain the user's location and desired conditions. Simultaneously, the emotion engine analyzes the user's input to estimate their emotional state. For example, it might read from the input text that the user wants to "relax" or "have an adventure."

[0298] The server searches the tourist destination database.

[0299] The server searches the tourist destination database based on the user's location, desired conditions, and analyzed emotional state. It then lists tourist destinations that match the conditions and constructs that list.

[0300] The server returns the results to the user.

[0301] The server formats the tourist destination information obtained as search results and returns it to the terminal in a structured format (e.g., JSON). The data to be returned includes a list of tourist destinations most suitable for the user's location, desired conditions, and emotional state.

[0302] The terminal receives data from the server

[0303] The terminal receives the data sent back from the server and verifies that it is in the correct format. It analyzes the data and prepares for display.

[0304] The terminal displays the results to the user

[0305] The terminal visualizes the received data and displays it in a user-friendly format (e.g., list display or card format). The user can view the tourist destination information proposed by the server through the terminal screen.

[0306] Specific example

[0307] For example, when the user inputs "Living in Tokyo, day trip, a place rich in nature", the terminal sends this information to the server. The server searches the tourist destination database and obtains "Takao Mountain", "Lake Kawaguchi", "Okutama", "Nikko", etc. as search results. At the same time, if the emotion engine estimates that the user's emotional state is "want to relax", the search results are sorted according to that emotion, and "Takao Mountain" is presented as the most recommended tourist destination.

[0308] The above is a form for specifically implementing an example of the present invention. With this system, the user can efficiently find tourist destinations that match their emotional state and desired conditions, and obtain a more fulfilling tourist experience.

[0309] The processing flow will be described below.

[0310] Step 1:

[0311] The user inputs their location and desired conditions.

[0312] The user enters their location (e.g., Tokyo) and desired conditions (e.g., day trip, nature-rich location) into the device's interface. The device then retrieves this information.

[0313] Step 2:

[0314] The terminal sends the input to the server.

[0315] The terminal converts the user's input data into a structured data format such as JSON and sends it to the server over the internet. The server receives the request and prepares to begin analysis.

[0316] Step 3:

[0317] The server recognizes the user's emotions.

[0318] An emotion engine embedded in the server analyzes user input (e.g., text), audio data, and image data to estimate the user's emotional state. For example, natural language processing techniques are used to determine what emotional state the user is in (e.g., want to relax, want to go on an adventure).

[0319] Step 4:

[0320] The server analyzes the user's input information.

[0321] The server parses the received JSON data to obtain the user's location and desired conditions. This information is then used for the next tourist destination search.

[0322] Step 5:

[0323] The server searches the tourist destination database.

[0324] The server searches a tourist destination database based on the user's location, desired conditions, and analyzed emotional state. For example, it might find tourist destinations that match the conditions "Tokyo," "day trip," "place with abundant nature," and "want to relax." The server then generates a list of tourist destinations that meet these conditions.

[0325] Step 6:

[0326] The server formats the search results and returns them to the user.

[0327] The server formats the tourist destination information obtained as search results into a structured format such as JSON and sends it back to the terminal. The returned data includes a list of tourist destinations that best suit the user's location, preferences, and emotional state.

[0328] Step 7:

[0329] The terminal receives data from the server.

[0330] The terminal receives data returned from the server and verifies that the data is in the correct format. It then parses the received data and prepares it for display.

[0331] Step 8:

[0332] The device displays tourist destination results to the user.

[0333] The device visualizes the received data and displays it in a user-friendly format (e.g., list view, card view). For example, it could display a list of tourist destinations prioritized based on the user's emotional state. The user can then view the suggested tourist destination information from the server through the device's screen.

[0334] Through the steps described above, users can efficiently obtain tourist destination information that matches their desired conditions and emotional state, and easily decide on their next travel destination.

[0335] (Example 2)

[0336] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0337] While current tourist information systems can provide tourist destination information based on the user's location and preferences, they cannot format the information to take into account the user's emotional state. Therefore, it is difficult to provide the most suitable tourist destinations that match the user's specific situation and feelings. Furthermore, the input of user preferences and the display of results can sometimes be unintuitive, leading to usability issues.

[0338] The identification processing by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for the user to input location and desired conditions, means for transmitting the location and desired conditions information entered by the user to the server, means for searching a tourist destination database based on the location and desired conditions and obtaining the corresponding tourist destination, means for returning the obtained tourist destination information to the user, means including an emotion engine that analyzes the user's input and estimates their emotional state, means for sorting the tourist destination information based on the emotional state, and means for formatting the tourist destination information in a visually displayable format. This makes it possible to suggest tourist destinations that take the user's emotional state into consideration.

[0339] "Location" refers to the user's current geographical location or place of residence.

[0340] "Desired conditions" refer to the requirements and characteristics that users look for in a tourist destination they want to visit (e.g., day trip, place with abundant nature, etc.).

[0341] A "server" refers to a computer system that receives and processes data sent by a user.

[0342] A "tourist destination database" refers to a data storage system that stores information about tourist destinations (e.g., location, category, name of the tourist destination, etc.).

[0343] An "emotion engine" refers to software or algorithms that analyze user input and estimate their emotional state.

[0344] "User input" refers to data provided by the user via their device (e.g., location, desired conditions, text, etc.).

[0345] "Emotional state" refers to the psychological state that a user expresses through their input (e.g., wanting to relax, wanting to go on an adventure, etc.).

[0346] "Formatting" refers to the process of converting data into a visually easy-to-understand format (e.g., list display, card format, etc.).

[0347] This invention is a system designed to allow users to efficiently and accurately obtain information that matches their preferences when searching for tourist destinations. Furthermore, it incorporates an emotion engine to recognize the user's emotional state and recommend the most suitable tourist destinations based on that state.

[0348] The specific components and procedures for implementing this system are as follows:

[0349] User input interface

[0350] Users enter their location and desired conditions via their device (e.g., smartphone, computer). The input interface is provided in a simple and user-friendly form format. For example, "location" and "desired conditions" could be selected using text boxes or dropdown menus.

[0351] Information transmission by terminal

[0352] The terminal converts the information entered by the user into a structured data format such as JSON and sends it to the server via the internet.

[0353] Server-based user sentiment analysis

[0354] The server has an emotion engine built in that analyzes user input, voice data, and image data to estimate the user's emotional state. For example, it analyzes the emotion of text entered by the user using natural language processing (NLP) tools.

[0355] The server searches the tourist destination database.

[0356] The server searches the tourist destination database based on the received location and desired conditions, as well as the analyzed user's emotional state. The database contains basic and attribute information for each tourist destination, and the server creates a list of tourist destinations that match the specified conditions.

[0357] The server formats the search results and returns them.

[0358] The server formats appropriate tourist destination information and sends it back to the user's terminal. This information consists of a list of optimal tourist destinations based on the user's location, preferences, and emotional state.

[0359] Information display via terminal

[0360] The terminal receives a list of tourist destinations sent back from the server and displays it visually to the user. The display format used is one that is easy for the user to understand intuitively, such as a list view or a card format.

[0361] For example, if a user enters "Tokyo resident, day trip, nature-rich location" into their smartphone, the device sends this information to the server. The server searches a tourist destination database and retrieves results such as "Mount Takao," "Lake Kawaguchi," "Okutama," and "Nikko." Simultaneously, if the emotion engine estimates the user's emotional state as "wanting to relax," it rearranges the search results to match that emotion and presents "Mount Takao" as the most recommended tourist destination. In this way, the system efficiently suggests tourist destinations that are best suited to the user's emotions and desired conditions.

[0362] Example of a prompt

[0363] Examples of prompts for a generative AI model are as follows:

[0364] "A user enters 'Resident of Tokyo, day trip, nature-rich location,' and the emotion engine analyzes this as 'Want to relax.' Please describe in detail the processing steps of the system that suggests the most suitable tourist destination to the user based on this."

[0365] This system allows users to efficiently find tourist destinations that match their emotional state and desired conditions, resulting in a more fulfilling travel experience.

[0366] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0367] Step 1: The user enters the data.

[0368] The user enters their location (e.g., Tokyo) and desired conditions (e.g., day trip, nature-rich location) into the terminal's input fields. Text boxes or dropdown menus are used for input. The terminal receives the user's input and stores it internally. The input in this step is the user's location and desired conditions, and the output is the location and desired conditions data stored within the terminal.

[0369] Step 2: The terminal sends the input data.

[0370] The terminal converts the location and desired conditions entered by the user into JSON format. Next, it sends this JSON data to the server via the internet. An example of the converted JSON data is as follows:

[0371] json

[0372] {

[0373] "location": "Tokyo",

[0374] "preferences": ["day trip", "place with abundant nature"]

[0375] }

[0376] The input for this step is the stored location and desired conditions data, and the output is JSON format data that will be sent to the server.

[0377] Step 3: The server analyzes the data.

[0378] The server parses the received JSON data and extracts the user's location (e.g., Tokyo) and desired conditions (e.g., day trip, nature-rich location). Simultaneously, the emotion engine analyzes the user's input and estimates their emotional state. For example, if the text "I want to relax" is entered, an NLP tool is used to analyze it and extract this emotional state. The input for this step is the JSON data sent to the server, and the output is the extracted location, desired conditions, and emotional state data.

[0379] Step 4: The server searches the database.

[0380] The server searches a tourist destination database based on the extracted location (e.g., Tokyo), desired conditions (e.g., day trip, nature-rich location), and emotional state (e.g., "I want to relax"). The database contains basic and attribute information about tourist destinations. The server lists tourist destinations that match the conditions and creates a list. The input for this step is the extracted location, desired conditions, and emotional state data, and the output is the list of tourist destinations obtained as a search result.

[0381] Step 5: The server formats the results and sends them back.

[0382] The server uses the acquired tourist destination information to create a list sorted based on emotional states. Next, it reconstructs this list into JSON format and sends it back to the terminal. An example of the formatted JSON data is as follows:

[0383] json

[0384] {

[0385] "recommendations": [

[0386] {"place": "Mount Takao", "description": "A nature-rich place where you can enjoy mountain climbing"},

[0387] {"place": "Kawaguchiko", "description": "A relaxing lakeside view"}

[0388] {"place": "Okutama", "description": "A place rich in nature where you can enjoy hiking"}

[0389] ]

[0390] }

[0391] The input for this step is a list of tourist destinations obtained as search results, and the output is formatted tourist destination information in JSON format.

[0392] Step 6: The device receives and displays the data.

[0393] The terminal receives the JSON data returned from the server and verifies that its format is correct. Next, it parses the data and displays it in a user-friendly format (e.g., list view or card view). The input for this step is the formatted tourist destination information JSON data returned from the server, and the output is a visual list of tourist destinations displayed to the user.

[0394] Through the above processing steps, users can efficiently find tourist destinations that best suit their emotional state and desired conditions.

[0395] (Application Example 2)

[0396] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".

[0397] Conventional tourist destination information systems provide tourist destination information selected based solely on the location and desired conditions entered by the user. Therefore, they may not adequately suggest the most suitable tourist destinations based on the user's emotional state. For this reason, there is a need to provide customized tourist destination information that reflects the user's current mood and emotions.

[0398] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0399] In this invention, the server includes means for the user to input location and desired conditions, means for analyzing the user's emotional state, means for searching a tourist destination database based on the location, desired conditions, and emotional state, and obtaining the relevant tourist destinations, and means for prioritizing the obtained tourist destination information and returning it to the user. This makes it possible to provide optimal tourist destination information according to the user's emotional state.

[0400] "Location" refers to information indicating the user's current location or the places they wish to visit.

[0401] "Desired conditions" refer to the specific conditions or requirements that users seek when selecting a tourist destination.

[0402] A "server" is a part of a computer system that receives and processes data sent by a user.

[0403] A "tourist destination database" is a database that stores various information about tourist destinations.

[0404] "Emotional state" refers to information that indicates the user's current mood and emotional state.

[0405] "Prioritization" is the process of determining the display order of acquired tourist destination information based on the user's emotional state and preferences.

[0406] A "terminal" is a device used by users to input their location and desired conditions, and to exchange information with the server.

[0407] This invention provides a system for tourist guides primarily used in physical stores. Users can obtain tourist information via their smartphones and find tourist destinations that best suit their emotional state.

[0408] First, the user enters their location and desired conditions into their smartphone. This information is converted to JSON format and sent to the server. The smartphone then configures the user interface using common input forms and dropdown menus.

[0409] The server analyzes the received user data and uses an emotion engine to estimate the user's emotional state. For example, it analyzes the text and emojis entered by the user and uses natural language processing techniques to read their emotions. The emotion engine can utilize external emotion recognition libraries. We will explain this using a library called EmotionEngine as an example.

[0410] Next, the server searches a tourist destination database. This database contains information such as location, category, and tourist destination name. The database search is performed based on the user's location and preferences, as well as their estimated emotional state. This retrieves tourist destination information that is best suited to the user's emotional state.

[0411] Once the target tourist destination information is retrieved, the server organizes it and creates a prioritized list. This list is then sorted considering the user's emotional state. For example, if the user's emotional state is estimated to be "wanting to relax," tourist destinations that promote relaxation will be displayed preferentially.

[0412] Finally, the server sends the organized tourist information back to the smartphone. The smartphone visually displays the received data and provides it to the user. The display format uses an intuitive and easy-to-understand format, such as a list view or a card format.

[0413] Hardware and software to be used

[0414] Hardware: Smartphone

[0415] Software: EmotionEngine (emotion recognition library), TouristSpotDatabase (tourist destination database), Flask (web framework)

[0416] Specific example

[0417] For example, consider a scenario where a user uses an application in a store in Tokyo and enters "I live in Tokyo, and I'm looking for a relaxing day trip destination." The user then enters the emoji "😊 (relaxed)." Based on this information, the server suggests tourist destinations such as Mount Takao, Lake Kawaguchi, and Okutama.

[0418] Prompt text to input to the generative AI model

[0419] "I live in Tokyo and am looking for a day trip. Please recommend a relaxing place with lots of nature. My desired emotion is '😊 (relaxed)'."

[0420] Thus, the present invention provides customized tourist destination information according to the user's emotional state, supporting a more fulfilling travel experience.

[0421] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0422] Step 1:

[0423] The user enters their location and desired conditions on their smartphone. The user enters their location (e.g., Tokyo) and desired travel conditions (e.g., day trip, nature-rich location) into the input fields, and also enters text or emojis to express their feelings. The entered data (location, desired conditions, feelings) is then imported into the device.

[0424] Step 2:

[0425] The terminal converts the data entered by the user into JSON format and sends it to the server. The terminal's processing includes converting the user's input data into the correct format and sending it to the server via an HTTP request.

[0426] Step 3:

[0427] The server analyzes the data received from the terminal. Since the received data is in JSON format, the server analyzes it to extract location, desired conditions, and emotional information. Formatted data (location, desired conditions, emotional state) is obtained.

[0428] Step 4:

[0429] The server's emotion engine analyzes the user's emotional state. The server passes the received emotional information to the EmotionEngine library for analysis. The emotion engine uses natural language processing techniques to estimate the user's emotion, such as "I want to relax." The emotional state is obtained as a result of the analysis.

[0430] Step 5:

[0431] The server searches the tourist destination database based on location, desired conditions, and analyzed sentiment state. The tourist destination database contains various tourist destination information, and the server executes database queries to extract tourist destinations that match the conditions. The extracted data includes location, category, and tourist destination name.

[0432] Step 6:

[0433] The server prioritizes tourist destination information based on search results, taking into account the user's emotional state. The server applies an algorithm tailored to the emotional state, rearranging the retrieved tourist destinations in an order that best suits the user's emotions. A prioritized list of tourist destinations is then generated.

[0434] Step 7:

[0435] The server formats the prioritized tourist destination information into JSON format and sends it back to the terminal. The formatting process performed by the server includes the function of formatting the tourist destination information in an appropriate format and sending it back to the terminal as an HTTP response.

[0436] Step 8:

[0437] The terminal receives data sent back from the server and displays it visually. The terminal analyzes the received data and displays tourist destination information to the user in an intuitively understandable list or card format. This allows the user to find tourist destination information that best suits their emotional state.

[0438] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0439] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0440] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0441] [Second Embodiment]

[0442] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0443] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0444] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0445] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0446] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0447] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0448] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0449] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0450] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0451] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0452] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0453] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0454] This system is designed to allow users to efficiently and accurately obtain information that matches their preferences when searching for tourist destinations. Specifically, when a user enters their location and desired conditions into their terminal, that information is sent to a server, which searches the tourist destination database to retrieve relevant information and then sends it back to the user.

[0455] Key components of the system

[0456] 1. User Input Interface

[0457] Users enter their location and desired conditions via their device (e.g., smartphone, computer). The input interface is provided in a simple and easy-to-use form format. For example, "location" and "desired conditions" could be selected using text boxes or dropdown menus.

[0458] 2. Information transmission by terminals

[0459] The terminal sends the location and desired conditions entered by the user to the server. Technically, this process utilizes a structured data format such as JSON.

[0460] 3. Searching tourist destination databases via server

[0461] The server searches the tourist destination database based on the received location and desired conditions. The database holds basic information and attribute information for each tourist destination, and the server creates a list of tourist destinations that match the specified conditions.

[0462] 4. Data return by the server

[0463] The server returns the tourist destination information obtained as search results to the terminal in a structured format (e.g., JSON). This information includes a list of tourist destinations that best match the user's preferences.

[0464] 5. Information display via terminal

[0465] The terminal visually displays a list of tourist destinations received from the server to the user. The display format used is one that is easy for the user to understand intuitively, such as a list view or a card format.

[0466] Explanation of the program's processing

[0467] The user enters their location and desired conditions.

[0468] The user enters their location (e.g., Tokyo) and desired conditions (e.g., day trip, nature-rich location) into the designated input fields on the device. The device collects this information.

[0469] The terminal sends input to the server.

[0470] The terminal converts the data entered by the user into a format such as JSON and sends it to the server. For example, the following data is sent:

[0471] json

[0472] {

[0473] "location": "Tokyo",

[0474] "Preferences": "Day trips, places with abundant nature"

[0475] }

[0476] The server searches the tourist destination database.

[0477] The server searches a tourist destination database based on the input data it receives. This database contains detailed information about each tourist destination, including its location and attributes. The server picks out tourist destinations that match the criteria and creates a list. For example, "Mount Takao," "Lake Kawaguchi," "Okutama," and "Nikko" might be included.

[0478] The server returns the results to the user.

[0479] The server creates a list of tourist destinations in JSON format and sends it back to the terminal. The returned data will look like this:

[0480] json

[0481] {

[0482] "recommendations": ["Mount Takao", "Lake Kawaguchi", "Okutama", "Nikko"]

[0483] }

[0484] The device displays the results to the user.

[0485] The terminal displays a list of tourist destinations received from the server in a user-friendly format. For example, it may display the following visual information:

[0486] The following tourist destinations are recommended:

[0487] Mount Takao

[0488] Lake Kawaguchi

[0489] Okutama

[0490] sunlight

[0491] Specific example

[0492] For example, if a user enters "lives in Tokyo, day trip, nature-rich location," the device sends this information to the server. The server then searches its tourist destination database for places like "Mount Takao," "Lake Kawaguchi," "Okutama," and "Nikko," and returns a list. This allows the user to quickly obtain information on tourist destinations that match their preferences and use it as a reference to decide on their next outing.

[0493] The above describes an example of an embodiment for specifically implementing the present invention. This system allows users to efficiently obtain tourist destination information and create more comprehensive travel plans.

[0494] The following describes the processing flow.

[0495] Step 1:

[0496] The user enters their location and desired conditions.

[0497] The user enters their location (e.g., Tokyo) and desired conditions (e.g., day trip, nature-rich location) into the device's interface. The device then retrieves this information.

[0498] Step 2:

[0499] The terminal sends user input to the server.

[0500] The terminal converts user input into a structured data format such as JSON and sends it to the server over the internet. At this point, the server receives the request and prepares to begin analysis.

[0501] Step 3:

[0502] The server analyzes the user's input information.

[0503] The server parses the received JSON data to obtain the user's location and desired conditions. Based on the parsed data, the server prepares to search the tourist destination database.

[0504] Step 4:

[0505] The server searches the tourist destination database.

[0506] The server searches the tourist destination database based on the user's location and desired conditions. For example, the server retrieves tourist destinations from the database that match the criteria of "Tokyo," "day trip," and "places rich in nature." In this process, it generates a list of tourist destinations that meet the conditions.

[0507] Step 5:

[0508] The server formats the search results and sends them back to the terminal.

[0509] The server formats the tourist destination information obtained as search results into a structured format such as JSON and sends it back to the terminal. The data returned from the server includes a list of the relevant tourist destinations.

[0510] Step 6:

[0511] The terminal receives data from the server.

[0512] The terminal receives the data sent back from the server and analyzes it. It verifies that the received data is in the correct format and prepares to proceed to the next processing step.

[0513] Step 7:

[0514] The device displays tourist destination results to the user.

[0515] The terminal visualizes the received data and displays it in a user-friendly format (e.g., list view, card view). Users can view information about suggested tourist destinations from the server through the terminal's screen.

[0516] By following these steps, users can efficiently obtain tourist destination information that suits their preferences and easily decide on their next travel destination.

[0517] (Example 1)

[0518] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0519] Modern tourist destination information systems have a problem in that it is difficult for users to efficiently and accurately find tourist destinations that meet their preferences. Furthermore, the process from information acquisition to display is often cumbersome, resulting in a poor user experience.

[0520] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0521] In this invention, the server includes means for the user to input location and desired conditions, means for transmitting the location and desired conditions information entered by the user to the server via a terminal, means for the server to search a tourist destination database based on the received location and desired conditions and obtain the corresponding tourist destination, means for returning the obtained tourist destination information to the user's terminal in a structured format, and means for the terminal to visually display the received tourist destination information to the user. This makes it possible for the user to efficiently and accurately obtain tourist destination information that matches their preferences and to visually confirm the information.

[0522] A "user" is someone who uses this system to obtain tourist destination information.

[0523] A "terminal" is a device used by a user (e.g., a smartphone or personal computer) that is used for inputting and displaying information.

[0524] A "server" is a central processing unit that receives data sent by users, searches a tourist destination database, and returns appropriate information.

[0525] "Location" refers to the user's current location and is geographical information used as a basis for searching for tourist destination information.

[0526] "Desired conditions" refer to requirements that indicate the characteristics and features of the tourist destination that the user is looking for, and include, for example, "day trip" or "a place rich in nature."

[0527] A "tourist destination database" is a database that stores information on various tourist destinations and has a structure that allows searching based on specific criteria.

[0528] "JSON format" is a data exchange format, an abbreviation for JavaScript Object Notation, which represents structured data in text format.

[0529] An "HTTP POST request" is part of the protocol used in web communication for a client to send data to a server.

[0530] "Visual display" means presenting information to the user in a visually easy-to-understand format on a device, such as lists or card formats.

[0531] This invention provides a system that allows users to efficiently and accurately obtain information that matches their preferences when searching for tourist destinations. In this system, when a user inputs their location and desired conditions into a terminal, that information is sent to a server, which searches a tourist destination database, retrieves relevant tourist destination information, and returns it to the user.

[0532] User actions

[0533] Users utilize devices such as smartphones or personal computers. First, users enter their current location (e.g., "Tokyo") and desired conditions (e.g., "day trip, nature-rich location") into the device's input interface. This input interface is provided in a simple and user-friendly format using text boxes and dropdown menus.

[0534] Data transmission by terminal

[0535] The terminal uses an HTTP POST request to convert the location and preference information entered by the user into JSON format and send it to the server. For example, the data is sent in the following format:

[0536] json

[0537] {

[0538] "location": "Tokyo",

[0539] "Preferences": "Day trips, places with abundant nature"

[0540] }

[0541] Data processing by the server

[0542] The server receives an HTTP POST request and parses the JSON data. Based on the parsed data, it searches the tourist destination database. The database holds the locations, categories, and names of numerous tourist destinations. The server filters the tourist destinations that match the specified criteria and creates a list of the relevant destinations. Examples include "Mount Takao," "Lake Kawaguchi," "Okutama," and "Nikko."

[0543] Data return from server to terminal

[0544] The server formats the search results into JSON format and sends them back to the terminal. The returned data will be in the following format:

[0545] json

[0546] {

[0547] "recommendations": ["Mount Takao", "Lake Kawaguchi", "Okutama", "Nikko"]

[0548] }

[0549] Data display via device

[0550] The terminal analyzes the list of tourist destinations received from the server and displays it to the user in a visually easy-to-understand format. This display format could be a list view or a card view. For example, it might be displayed as follows:

[0551] The following tourist destinations are recommended:

[0552] Mount Takao

[0553] Lake Kawaguchi

[0554] Okutama

[0555] sunlight

[0556] Specific example

[0557] When a user enters "Resident of Tokyo, day trip, nature-rich location," the device sends this information to the server. The server searches a tourist destination database and compiles a list of matching tourist destinations such as "Mt. Takao," "Lake Kawaguchi," "Okutama," and "Nikko," which are then sent back to the device. The device analyzes this returned data and displays it visually to the user, allowing them to quickly obtain information about tourist destinations that match their preferences.

[0558] Furthermore, when using a generative AI model to explain the system, the following prompt statements can be used:

[0559] I live in Tokyo and am looking for a day trip to a place with abundant nature. Could you recommend some tourist spots?

[0560] This system allows users to easily create more fulfilling travel plans.

[0561] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0562] Step 1:

[0563] The user enters their location and desired conditions into the device's input interface. Specifically, they enter information such as "Tokyo" or "day trip, nature-rich location" into text boxes or dropdown menus. The entered information is temporarily stored in the device's memory.

[0564] input:

[0565] Location: Tokyo

[0566] Desired conditions: Day trip, location with abundant nature

[0567] output:

[0568] User input data stored on the device

[0569] Step 2:

[0570] The terminal converts the data entered by the user into JSON format. This conversion is performed by a program within the terminal. The converted data will look like this:

[0571] json

[0572] {

[0573] "location": "Tokyo",

[0574] "Preferences": "Day trips, places with abundant nature"

[0575] }

[0576] The converted JSON data is sent to the server using an HTTP POST request.

[0577] input:

[0578] User input data

[0579] output:

[0580] Data converted to JSON format

[0581] Step 3:

[0582] The server receives an HTTP POST request and extracts JSON data from the request body. A program on the server performs this extraction process and parses the extracted data. Specifically, it analyzes the data content and extracts "location" and "desired conditions" individually.

[0583] input:

[0584] HTTP POST request

[0585] output:

[0586] Data of analyzed location and desired conditions

[0587] Step 4:

[0588] The server searches a tourist destination database based on the analyzed data. This database stores information such as the location, category, and name of tourist destinations. A query program within the server performs a search on the database and retrieves a list of tourist destinations that match the criteria. For example, "Mount Takao," "Lake Kawaguchi," "Okutama," and "Nikko" are among the tourist destinations that match the criteria.

[0589] input:

[0590] Data of analyzed location and desired conditions

[0591] output:

[0592] List of tourist destinations that match the criteria

[0593] Step 5:

[0594] The server formats the retrieved list of tourist destinations into JSON format. This formatting process is performed by a data format conversion program within the server. The formatted data will look like this:

[0595] json

[0596] {

[0597] "recommendations": ["Mount Takao", "Lake Kawaguchi", "Okutama", "Nikko"]

[0598] }

[0599] The formatted JSON data is sent back to the terminal as an HTTP response.

[0600] input:

[0601] List of tourist destinations that match the criteria

[0602] output:

[0603] List of tourist destinations formatted in JSON format

[0604] Step 6:

[0605] The terminal parses the JSON data received from the server. A program within the terminal parses the JSON data and converts it into data for visual display. The converted data is displayed on the terminal screen in a user-friendly format. For example, it might look like this:

[0606] The following tourist destinations are recommended:

[0607] Mount Takao

[0608] Lake Kawaguchi

[0609] Okutama

[0610] sunlight

[0611] input:

[0612] JSON data received from the server

[0613] output:

[0614] A list of tourist destinations displayed visually to the user.

[0615] This allows users to efficiently and accurately obtain tourist destination information that matches their preferences.

[0616] (Application Example 1)

[0617] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0618] In current factories, managing parts and materials is cumbersome, making it difficult to quickly locate specific parts and deliver them to designated locations. This problem leads to decreased productivity and increased working hours. To solve this problem, the present invention aims to provide a system in which a robot efficiently locates parts and delivers them quickly to a designated location simply by the user inputting the part's location and desired conditions.

[0619] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0620] In this invention, the server includes means for a user to input the location of a part and desired conditions; means for transmitting the information of the part location and desired conditions entered by the user to the server; means for searching a parts database based on the part location and desired conditions and obtaining the corresponding part; means for returning the obtained part information to the user; and robot control means for delivering the obtained part to a specific location. This enables efficient searching and rapid delivery of parts.

[0621] A "user" refers to a person who operates the system and enters the location of the parts and their desired specifications.

[0622] "Part location" refers to information indicating the physical location of a specific part within a factory.

[0623] "Desired conditions" refers to information indicating the attributes or conditions that a user desires for a particular part.

[0624] A "server" refers to a computer system that receives input information from users, searches a parts database, and returns the results.

[0625] A "parts database" refers to a collection of data containing information such as the location, category, and name of a part.

[0626] A "robot" refers to an autonomous mechanical device that searches for, retrieves, and delivers specified parts to a designated location.

[0627] "Robot control means" refers to a control system that enables a robot to perform specified tasks according to the user's requests.

[0628] This invention is a system for efficiently searching for specified parts within a factory and for rapid delivery. The system includes a user input interface, information transmission means, a server, a parts database, a robot, and robot control means.

[0629] Key components of the system

[0630] 1. User Input Interface

[0631] Users enter the part location and desired specifications via a device (e.g., tablet, smartphone, work computer). The input interface is provided in an easy-to-use form format. For example, the "part location" and "desired specifications" could be selected using text boxes or dropdown menus.

[0632] 2. Information transmission by terminals

[0633] The terminal transmits information about the part's location and desired specifications entered by the user to the server. Technically, this process utilizes a structured data format such as JSON.

[0634] 3. Server-based parts database search

[0635] The server searches the parts database based on the received part location and desired conditions. The database holds basic information and attribute information for each part, and the server creates a list of parts that match the specified conditions.

[0636] 4. Data return by the server

[0637] The server returns the retrieved part information as search results to the terminal in a structured format (e.g., JSON). This information includes a list of parts that best match the user's desired conditions.

[0638] 5. Information display via terminal

[0639] The terminal visually displays a list of components received from the server to the user. The display format used is one that is easy for the user to understand intuitively, such as a list view or a card format.

[0640] 6. Robot control means

[0641] The robot searches for specified parts based on information received from the server, efficiently retrieves them, and delivers them to the designated location. The robot control system controls the robot's movements and enables it to perform its tasks.

[0642] Program processing

[0643] 1. The user enters the part location and desired specifications into the terminal's input fields. The terminal collects this information and converts it to JSON format.

[0644] 2. The terminal sends data entered by the user to the server. For example, the following data is sent:

[0645] {

[0646] "location": "Area A-3",

[0647] "preferences": "Type 1024 cover"

[0648] }

[0649] 3. The server searches the parts database based on the received input data. This database contains detailed information about each part, including its location and attributes. The server picks out parts that match the criteria and creates a list. For example, "Type 1024 Cover" and "Type 2035 Screw" might be included.

[0650] 4. The server creates a list of parts in JSON format and sends it back to the terminal. The data sent back will look like this:

[0651] {

[0652] "recommendations": ["Type 1024 cover", "Type 2035 screws"]

[0653] }

[0654] 5. The terminal displays the list of components received from the server in a user-friendly format. For example, it may display the following visual information:

[0655] The following parts were found:

[0656] Type 1024 cover

[0657] 2035 type screw

[0658] 6. The robot searches for the specified part, retrieves it, and delivers it to the user's desired location.

[0659] Specific example

[0660] For example, if a user enters "Area A-3, Type 1024 cover," the terminal sends this information to the server, which searches the parts database for parts such as "Type 1024 cover" and "Type 2035 screw," and returns a list. This allows the user to quickly obtain information on parts that match their needs, and the robot can retrieve the specified parts and deliver them to the required location.

[0661] Examples of prompts to input into a generative AI model:

[0662] Please enter the location of the part and the part you want:

[0663] "Area A-3, Type 1024 cover"

[0664] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0665] Step 1:

[0666] The user enters the part location and desired specifications into the input fields on the terminal. The user specifies the "part location" and "desired specifications" using text boxes and dropdown menus displayed on the terminal. For example, they might enter "Area A-3" and "Type 1024 Cover". This information is stored as a variable within the terminal.

[0667] Step 2:

[0668] The terminal converts the collected user input into JSON format. It converts the user-entered part locations and desired conditions into key-value pairs, generating structured JSON data. The generated JSON will look like this:

[0669] {

[0670] "location": "Area A-3",

[0671] "preferences": "Type 1024 cover"

[0672] }

[0673] Step 3:

[0674] The device sends the generated JSON data to the server. In doing so, the device uses an HTTP POST request to send the data to the server's API endpoint. The server receives this request and interprets the data.

[0675] Step 4:

[0676] The server parses the received JSON data and searches the parts database. The server queries the database using the conditions "Area A-3" and "Type 1024 Cover" and extracts the relevant parts information. The parts database includes the location, category, and name of each part.

[0677] Step 5:

[0678] The server structures the list of matching parts obtained as search results in JSON format. For example, if the search results match "Type 1024 cover" and "Type 2035 screw," it generates JSON data like the following:

[0679] {

[0680] "recommendations": ["Type 1024 cover", "Type 2035 screws"]

[0681] }

[0682] Step 6:

[0683] The server sends structured JSON data back to the device. In this process, the JSON data is sent as an HTTP response. The device receives this response and retrieves the data.

[0684] Step 7:

[0685] The terminal parses the received JSON data and displays it visually to the user. The terminal's UI provides the user with the relevant component information in list or card format. For example, the display might look like this:

[0686] The following parts were found:

[0687] Type 1024 cover

[0688] 2035 type screw

[0689] Step 8:

[0690] The robot searches for and retrieves the specified part based on the part information transmitted from the server. The robot control system autonomously moves and acquires the part based on the part's location and the name of the specified part.

[0691] Step 9:

[0692] The robot delivers the extracted parts to a specific location. Finally, the robot control system operates to deliver the parts to the designated destination and issues a notification when delivery is complete.

[0693] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0694] This system is designed to allow users to efficiently and accurately obtain information that matches their preferences when searching for tourist destinations. Furthermore, it incorporates an emotion engine to recognize the user's emotional state and recommend the most suitable tourist destinations based on that state.

[0695] Key components of the system

[0696] 1. User Input Interface

[0697] Users enter their location and desired conditions via their device (e.g., smartphone, computer). The input interface is provided in a simple and user-friendly form format. For example, "location" and "desired conditions" could be selected using text boxes or dropdown menus.

[0698] 2. Information transmission by terminals

[0699] The terminal converts the information entered by the user into a structured data format such as JSON and sends it to the server via the internet.

[0700] 3. Server-based analysis of user sentiment

[0701] The server has an emotion engine built in that analyzes user input, voice data, and image data to estimate the user's emotional state. For example, it analyzes the emotion of text entered by the user using natural language processing technology.

[0702] 4. The server searches the tourist destination database.

[0703] The server searches the tourist destination database based on the received location and desired conditions, as well as the analyzed user's emotional state. The database holds basic information and attribute information for each tourist destination, and the server creates a list of tourist destinations that match the specified conditions.

[0704] 5. The server formats the search results and returns them.

[0705] The server formats appropriate tourist destination information and sends it back to the user's terminal. This information consists of a list of optimal tourist destinations based on the user's location, preferences, and emotional state.

[0706] 6. Information display via terminal

[0707] The terminal receives a list of tourist destinations sent back from the server and displays it visually to the user. The display format used is one that is easy for the user to understand intuitively, such as a list view or a card format.

[0708] Explanation of the program's processing

[0709] The user enters their location and desired conditions.

[0710] The user enters their location (e.g., Tokyo) and desired conditions (e.g., day trip, nature-rich location) into the terminal's input fields. The terminal then retrieves this information.

[0711] The terminal sends input to the server.

[0712] The terminal converts the user's input data into a structured data format such as JSON and sends it to the server. The server receives the request and begins parsing.

[0713] The server analyzes the user's input and emotions.

[0714] The server parses the received JSON data to obtain the user's location and desired conditions. Simultaneously, the emotion engine analyzes the user's input to estimate their emotional state. For example, it might read from the input text that the user wants to "relax" or "have an adventure."

[0715] The server searches the tourist destination database.

[0716] The server searches the tourist destination database based on the user's location, desired conditions, and analyzed emotional state. It then lists tourist destinations that match the conditions and constructs that list.

[0717] The server returns the results to the user.

[0718] The server formats the tourist destination information obtained as search results and returns it to the terminal in a structured format (e.g., JSON). The returned data includes a list of tourist destinations that best suit the user's location, preferences, and emotional state.

[0719] The terminal receives data from the server.

[0720] The terminal receives the data returned from the server and verifies that it is in the correct format. It then parses the data and prepares it for display.

[0721] The device displays the results to the user.

[0722] The terminal visualizes the received data and displays it in a user-friendly format (e.g., list view or card view). Users can then view suggested tourist destination information from the server through the terminal's screen.

[0723] Specific example

[0724] For example, if a user enters "lives in Tokyo, day trip, nature-rich location," the device sends this information to the server. The server searches a tourist destination database and retrieves results such as "Mount Takao," "Lake Kawaguchi," "Okutama," and "Nikko." At the same time, if the emotion engine estimates the user's emotional state as "wanting to relax," it rearranges the search results to match that emotion and presents "Mount Takao" as the most recommended tourist destination.

[0725] The above describes an example of a specific embodiment of the present invention. This system allows users to efficiently find tourist destinations that match their emotional state and desired conditions, thereby enabling them to have a more fulfilling travel experience.

[0726] The following describes the processing flow.

[0727] Step 1:

[0728] The user enters their location and desired conditions.

[0729] The user enters their location (e.g., Tokyo) and desired conditions (e.g., day trip, nature-rich location) into the device's interface. The device then retrieves this information.

[0730] Step 2:

[0731] The terminal sends the input to the server.

[0732] The terminal converts the user's input data into a structured data format such as JSON and sends it to the server over the internet. The server receives the request and prepares to begin analysis.

[0733] Step 3:

[0734] The server recognizes the user's emotions.

[0735] An emotion engine embedded in the server analyzes user input (e.g., text), audio data, and image data to estimate the user's emotional state. For example, natural language processing techniques are used to determine what emotional state the user is in (e.g., want to relax, want to go on an adventure).

[0736] Step 4:

[0737] The server analyzes the user's input information.

[0738] The server parses the received JSON data to obtain the user's location and desired conditions. This information is then used for the next tourist destination search.

[0739] Step 5:

[0740] The server searches the tourist destination database.

[0741] The server searches a tourist destination database based on the user's location, desired conditions, and analyzed emotional state. For example, it might find tourist destinations that match the conditions "Tokyo," "day trip," "place with abundant nature," and "want to relax." The server then generates a list of tourist destinations that meet these conditions.

[0742] Step 6:

[0743] The server formats the search results and returns them to the user.

[0744] The server formats the tourist destination information obtained as search results into a structured format such as JSON and sends it back to the terminal. The returned data includes a list of tourist destinations that best suit the user's location, preferences, and emotional state.

[0745] Step 7:

[0746] The terminal receives data from the server.

[0747] The terminal receives data returned from the server and verifies that the data is in the correct format. It then parses the received data and prepares it for display.

[0748] Step 8:

[0749] The device displays tourist destination results to the user.

[0750] The device visualizes the received data and displays it in a user-friendly format (e.g., list view, card view). For example, it could display a list of tourist destinations prioritized based on the user's emotional state. The user can then view the suggested tourist destination information from the server through the device's screen.

[0751] Through the steps described above, users can efficiently obtain tourist destination information that matches their desired conditions and emotional state, and easily decide on their next travel destination.

[0752] (Example 2)

[0753] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0754] While current tourist information systems can provide tourist destination information based on the user's location and preferences, they cannot format the information to take into account the user's emotional state. Therefore, it is difficult to provide the most suitable tourist destinations that match the user's specific situation and feelings. Furthermore, the input of user preferences and the display of results can sometimes be unintuitive, leading to usability issues.

[0755] The identification processing by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for the user to input location and desired conditions, means for transmitting the location and desired conditions information entered by the user to the server, means for searching a tourist destination database based on the location and desired conditions and obtaining the corresponding tourist destination, means for returning the obtained tourist destination information to the user, means including an emotion engine that analyzes the user's input and estimates their emotional state, means for sorting the tourist destination information based on the emotional state, and means for formatting the tourist destination information in a visually displayable format. This makes it possible to suggest tourist destinations that take the user's emotional state into consideration.

[0756] "Location" refers to the user's current geographical location or place of residence.

[0757] "Desired conditions" refer to the requirements and characteristics that users look for in a tourist destination they want to visit (e.g., day trip, place with abundant nature, etc.).

[0758] A "server" refers to a computer system that receives and processes data sent by a user.

[0759] A "tourist destination database" refers to a data storage system that stores information about tourist destinations (e.g., location, category, name of the tourist destination, etc.).

[0760] An "emotion engine" refers to software or algorithms that analyze user input and estimate their emotional state.

[0761] "User input" refers to data provided by the user via their device (e.g., location, desired conditions, text, etc.).

[0762] "Emotional state" refers to the psychological state that a user expresses through their input (e.g., wanting to relax, wanting to go on an adventure, etc.).

[0763] "Formatting" refers to the process of converting data into a visually easy-to-understand format (e.g., list display, card format, etc.).

[0764] This invention is a system designed to allow users to efficiently and accurately obtain information that matches their preferences when searching for tourist destinations. Furthermore, it incorporates an emotion engine to recognize the user's emotional state and recommend the most suitable tourist destinations based on that state.

[0765] The specific components and procedures for implementing this system are as follows:

[0766] User input interface

[0767] Users enter their location and desired conditions via their device (e.g., smartphone, computer). The input interface is provided in a simple and user-friendly form format. For example, "location" and "desired conditions" could be selected using text boxes or dropdown menus.

[0768] Information transmission by terminal

[0769] The terminal converts the information entered by the user into a structured data format such as JSON and sends it to the server via the internet.

[0770] Server-based user sentiment analysis

[0771] The server has an emotion engine built in that analyzes user input, voice data, and image data to estimate the user's emotional state. For example, it analyzes the emotion of text entered by the user using natural language processing (NLP) tools.

[0772] The server searches the tourist destination database.

[0773] The server searches the tourist destination database based on the received location and desired conditions, as well as the analyzed user's emotional state. The database contains basic information and attribute information for each tourist destination, and the server creates a list of tourist destinations that match the specified conditions.

[0774] The server formats the search results and returns them.

[0775] The server formats appropriate tourist destination information and sends it back to the user's terminal. This information consists of a list of optimal tourist destinations based on the user's location, preferences, and emotional state.

[0776] Information display via terminal

[0777] The terminal receives a list of tourist destinations sent back from the server and displays it visually to the user. The display format used is one that is easy for the user to understand intuitively, such as a list view or a card format.

[0778] For example, if a user enters "Tokyo resident, day trip, nature-rich location" into their smartphone, the device sends this information to the server. The server searches a tourist destination database and retrieves results such as "Mount Takao," "Lake Kawaguchi," "Okutama," and "Nikko." Simultaneously, if the emotion engine estimates the user's emotional state as "wanting to relax," it rearranges the search results to match that emotion and presents "Mount Takao" as the most recommended tourist destination. In this way, the system efficiently suggests tourist destinations that are best suited to the user's emotions and desired conditions.

[0779] Example of a prompt

[0780] Examples of prompts for a generative AI model are as follows:

[0781] "A user enters 'Resident of Tokyo, day trip, nature-rich location,' and the emotion engine analyzes this as 'Want to relax.' Please describe in detail the processing steps of the system that suggests the most suitable tourist destination to the user based on this information."

[0782] This system allows users to efficiently find tourist destinations that match their emotional state and desired conditions, resulting in a more fulfilling travel experience.

[0783] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0784] Step 1: The user enters the data.

[0785] The user enters their location (e.g., Tokyo) and desired conditions (e.g., day trip, nature-rich location) into the terminal's input fields. Text boxes or dropdown menus are used for input. The terminal receives the user's input and stores it internally. The input in this step is the user's location and desired conditions, and the output is the location and desired conditions data stored within the terminal.

[0786] Step 2: The terminal sends the input data.

[0787] The terminal converts the location and desired conditions entered by the user into JSON format. Next, it sends this JSON data to the server via the internet. An example of the converted JSON data is as follows:

[0788] json

[0789] {

[0790] "location": "Tokyo",

[0791] "preferences": ["day trip", "place with abundant nature"]

[0792] }

[0793] The input for this step is the stored location and desired conditions data, and the output is JSON format data that will be sent to the server.

[0794] Step 3: The server analyzes the data.

[0795] The server parses the received JSON data and extracts the user's location (e.g., Tokyo) and desired conditions (e.g., day trip, nature-rich location). Simultaneously, the emotion engine analyzes the user's input and estimates their emotional state. For example, if the text "I want to relax" is entered, an NLP tool is used to analyze it and extract this emotional state. The input for this step is the JSON data sent to the server, and the output is the extracted location, desired conditions, and emotional state data.

[0796] Step 4: The server searches the database.

[0797] The server searches a tourist destination database based on the extracted location (e.g., Tokyo), desired conditions (e.g., day trip, nature-rich location), and emotional state (e.g., "I want to relax"). The database contains basic and attribute information about tourist destinations. The server lists tourist destinations that match the conditions and creates a list. The input for this step is the extracted location, desired conditions, and emotional state data, and the output is the list of tourist destinations obtained as a search result.

[0798] Step 5: The server formats the results and sends them back.

[0799] The server uses the acquired tourist destination information to create a list sorted based on emotional states. Next, it reconstructs this list into JSON format and sends it back to the terminal. An example of the formatted JSON data is as follows:

[0800] json

[0801] {

[0802] "recommendations": [

[0803] {"place": "Mount Takao", "description": "A nature-rich place where you can enjoy mountain climbing"},

[0804] {"place": "Kawaguchiko", "description": "A relaxing lakeside view"}

[0805] {"place": "Okutama", "description": "A place rich in nature where you can enjoy hiking"}

[0806] ]

[0807] }

[0808] The input for this step is a list of tourist destinations obtained as search results, and the output is formatted tourist destination information in JSON format.

[0809] Step 6: The device receives and displays the data.

[0810] The terminal receives the JSON data returned from the server and verifies that its format is correct. Next, it parses the data and displays it in a user-friendly format (e.g., list view or card view). The input for this step is the formatted tourist destination information JSON data returned from the server, and the output is a visual list of tourist destinations displayed to the user.

[0811] Through the above processing steps, users can efficiently find tourist destinations that best suit their emotional state and desired conditions.

[0812] (Application Example 2)

[0813] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0814] Conventional tourist destination information systems provide tourist destination information selected based solely on the location and desired conditions entered by the user. Therefore, they may not adequately suggest the most suitable tourist destinations based on the user's emotional state. For this reason, there is a need to provide customized tourist destination information that reflects the user's current mood and emotions.

[0815] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0816] In this invention, the server includes means for the user to input location and desired conditions, means for analyzing the user's emotional state, means for searching a tourist destination database based on the location, desired conditions, and emotional state, and obtaining the relevant tourist destinations, and means for prioritizing the obtained tourist destination information and returning it to the user. This makes it possible to provide optimal tourist destination information according to the user's emotional state.

[0817] "Location" refers to information indicating the user's current location or the places they wish to visit.

[0818] "Desired conditions" refer to the specific conditions or requirements that users seek when selecting a tourist destination.

[0819] A "server" is a part of a computer system that receives and processes data sent by a user.

[0820] A "tourist destination database" is a database that stores various information about tourist destinations.

[0821] "Emotional state" refers to information that indicates the user's current mood and emotional state.

[0822] "Prioritization" is the process of determining the display order of acquired tourist destination information based on the user's emotional state and preferences.

[0823] A "terminal" is a device used by users to input their location and desired conditions, and to exchange information with the server.

[0824] This invention provides a system for tourist guides primarily used in physical stores. Users can obtain tourist information via their smartphones and find tourist destinations that best suit their emotional state.

[0825] First, the user enters their location and desired conditions into their smartphone. This information is converted to JSON format and sent to the server. The smartphone then configures the user interface using common input forms and dropdown menus.

[0826] The server analyzes the received user data and uses an emotion engine to estimate the user's emotional state. For example, it analyzes the text and emojis entered by the user and uses natural language processing techniques to read their emotions. The emotion engine can utilize external emotion recognition libraries. We will explain this using a library called EmotionEngine as an example.

[0827] Next, the server searches a tourist destination database. This database contains information such as location, category, and tourist destination name. The database search is performed based on the user's location and preferences, as well as their estimated emotional state. This retrieves tourist destination information that is best suited to the user's emotional state.

[0828] Once the target tourist destination information is retrieved, the server organizes it and creates a prioritized list. This list is then sorted considering the user's emotional state. For example, if the user's emotional state is estimated to be "wanting to relax," tourist destinations that promote relaxation will be displayed preferentially.

[0829] Finally, the server sends the organized tourist information back to the smartphone. The smartphone visually displays the received data and provides it to the user. The display format uses an intuitive and easy-to-understand format, such as a list view or a card view.

[0830] Hardware and software to be used

[0831] Hardware: Smartphone

[0832] Software: EmotionEngine (emotion recognition library), TouristSpotDatabase (tourist destination database), Flask (web framework)

[0833] Specific example

[0834] For example, consider a scenario where a user uses an application in a store in Tokyo and enters "I live in Tokyo, and I'm looking for a relaxing day trip destination." The user then enters the emoji "😊 (relaxed)." Based on this information, the server suggests tourist destinations such as Mount Takao, Lake Kawaguchi, and Okutama.

[0835] Prompt text to input to the generative AI model

[0836] "I live in Tokyo and am looking for a day trip. Please recommend a relaxing place surrounded by nature. My desired emotion is '😊 (relaxed)'."

[0837] Thus, the present invention provides customized tourist destination information according to the user's emotional state, supporting a more fulfilling travel experience.

[0838] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0839] Step 1:

[0840] The user enters their location and desired conditions on their smartphone. The user enters their location (e.g., Tokyo) and desired sightseeing conditions (e.g., day trip, nature-rich location) into the input fields, and also enters text or emojis to express their feelings. The entered data (location, desired conditions, feelings) is then imported into the device.

[0841] Step 2:

[0842] The terminal converts the data entered by the user into JSON format and sends it to the server. The terminal's processing includes converting the user's input data into the correct format and sending it to the server via an HTTP request.

[0843] Step 3:

[0844] The server analyzes the data received from the terminal. Since the received data is in JSON format, the server analyzes it to extract location, desired conditions, and emotional information. Formatted data (location, desired conditions, emotional state) is obtained.

[0845] Step 4:

[0846] The server's emotion engine analyzes the user's emotional state. The server passes the received emotional information to the EmotionEngine library for analysis. The emotion engine uses natural language processing techniques to estimate the user's emotion, such as "I want to relax." The emotional state is obtained as a result of the analysis.

[0847] Step 5:

[0848] The server searches the tourist destination database based on location, desired conditions, and analyzed sentiment state. The tourist destination database contains various tourist destination information, and the server executes database queries to extract tourist destinations that match the conditions. The extracted data includes location, category, and tourist destination name.

[0849] Step 6:

[0850] The server prioritizes tourist destination information based on search results, taking into account the user's emotional state. The server applies an algorithm tailored to the emotional state, rearranging the retrieved tourist destinations in an order that best suits the user's emotions. A prioritized list of tourist destinations is then generated.

[0851] Step 7:

[0852] The server formats the prioritized tourist destination information into JSON format and sends it back to the terminal. The formatting process performed by the server includes the function of formatting the tourist destination information in an appropriate format and sending it back to the terminal as an HTTP response.

[0853] Step 8:

[0854] The terminal receives data sent back from the server and displays it visually. The terminal analyzes the received data and displays tourist destination information to the user in an intuitively understandable list or card format. This allows the user to find tourist destination information that best suits their emotional state.

[0855] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0856] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0857] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[0858] [Third Embodiment]

[0859] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[0860] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0861] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0862] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[0863] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0864] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0865] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0866] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0867] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0868] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0869] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0870] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[0871] This system is designed to allow users to efficiently and accurately obtain information that matches their preferences when searching for tourist destinations. Specifically, when a user enters their location and desired conditions into their terminal, that information is sent to a server, which searches the tourist destination database to retrieve relevant information and then sends it back to the user.

[0872] Key components of the system

[0873] 1. User Input Interface

[0874] Users enter their location and desired conditions via their device (e.g., smartphone, computer). The input interface is provided in a simple and easy-to-use form format. For example, "location" and "desired conditions" could be selected using text boxes or dropdown menus.

[0875] 2. Information transmission by terminals

[0876] The terminal sends the location and desired conditions entered by the user to the server. Technically, this process utilizes a structured data format such as JSON.

[0877] 3. Searching tourist destination databases via server

[0878] The server searches the tourist destination database based on the received location and desired conditions. The database holds basic information and attribute information for each tourist destination, and the server creates a list of tourist destinations that match the specified conditions.

[0879] 4. Data return by the server

[0880] The server returns the tourist destination information obtained as search results to the terminal in a structured format (e.g., JSON). This information includes a list of tourist destinations that best match the user's preferences.

[0881] 5. Information display via terminal

[0882] The terminal visually displays a list of tourist destinations received from the server to the user. The display format used is one that is easy for the user to understand intuitively, such as a list view or a card format.

[0883] Explanation of the program's processing

[0884] The user enters their location and desired conditions.

[0885] The user enters their location (e.g., Tokyo) and desired conditions (e.g., day trip, nature-rich location) into the designated input fields on the device. The device collects this information.

[0886] The terminal sends input to the server.

[0887] The terminal converts the data entered by the user into a format such as JSON and sends it to the server. For example, the following data is sent:

[0888] json

[0889] {

[0890] "location": "Tokyo",

[0891] "Preferences": "Day trips, places with abundant nature"

[0892] }

[0893] The server searches the tourist destination database.

[0894] The server searches a tourist destination database based on the input data it receives. This database contains detailed information about each tourist destination, including its location and attributes. The server picks out tourist destinations that match the criteria and creates a list. For example, "Mount Takao," "Lake Kawaguchi," "Okutama," and "Nikko" might be included.

[0895] The server returns the results to the user.

[0896] The server creates a list of tourist destinations in JSON format and sends it back to the terminal. The returned data will look like this:

[0897] json

[0898] {

[0899] "recommendations": ["Mount Takao", "Lake Kawaguchi", "Okutama", "Nikko"]

[0900] }

[0901] The device displays the results to the user.

[0902] The terminal displays a list of tourist destinations received from the server in a user-friendly format. For example, it may display the following visual information:

[0903] The following tourist destinations are recommended:

[0904] Mount Takao

[0905] Lake Kawaguchi

[0906] Okutama

[0907] sunlight

[0908] Specific example

[0909] For example, if a user enters "lives in Tokyo, day trip, nature-rich location," the device sends this information to the server. The server then searches its tourist destination database for places like "Mount Takao," "Lake Kawaguchi," "Okutama," and "Nikko," and returns a list. This allows the user to quickly obtain information on tourist destinations that match their preferences and use it as a reference to decide on their next outing.

[0910] The above describes an example of an embodiment for specifically implementing the present invention. This system allows users to efficiently obtain tourist destination information and create more comprehensive travel plans.

[0911] The following describes the processing flow.

[0912] Step 1:

[0913] The user enters their location and desired conditions.

[0914] The user enters their location (e.g., Tokyo) and desired conditions (e.g., day trip, nature-rich location) into the device's interface. The device then retrieves this information.

[0915] Step 2:

[0916] The terminal sends user input to the server.

[0917] The terminal converts user input into a structured data format such as JSON and sends it to the server over the internet. At this point, the server receives the request and prepares to begin analysis.

[0918] Step 3:

[0919] The server analyzes the user's input information.

[0920] The server parses the received JSON data to obtain the user's location and desired conditions. Based on the parsed data, the server prepares to search the tourist destination database.

[0921] Step 4:

[0922] The server searches the tourist destination database.

[0923] The server searches the tourist destination database based on the user's location and desired conditions. For example, the server retrieves tourist destinations from the database that match the criteria of "Tokyo," "day trip," and "places rich in nature." In this process, it generates a list of tourist destinations that meet the conditions.

[0924] Step 5:

[0925] The server formats the search results and sends them back to the terminal.

[0926] The server formats the tourist destination information obtained as search results into a structured format such as JSON and sends it back to the terminal. The data returned from the server includes a list of the relevant tourist destinations.

[0927] Step 6:

[0928] The terminal receives data from the server.

[0929] The terminal receives the data sent back from the server and analyzes it. It verifies that the received data is in the correct format and prepares to proceed to the next processing step.

[0930] Step 7:

[0931] The device displays tourist destination results to the user.

[0932] The terminal visualizes the received data and displays it in a user-friendly format (e.g., list view, card view). Users can view information about suggested tourist destinations from the server through the terminal's screen.

[0933] By following these steps, users can efficiently obtain tourist destination information that suits their preferences and easily decide on their next travel destination.

[0934] (Example 1)

[0935] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0936] Modern tourist destination information systems have a problem in that it is difficult for users to efficiently and accurately find tourist destinations that meet their preferences. Furthermore, the process from information acquisition to display is often cumbersome, resulting in a poor user experience.

[0937] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0938] In this invention, the server includes means for the user to input location and desired conditions, means for transmitting the location and desired conditions information entered by the user to the server via a terminal, means for the server to search a tourist destination database based on the received location and desired conditions and obtain the corresponding tourist destination, means for returning the obtained tourist destination information to the user's terminal in a structured format, and means for the terminal to visually display the received tourist destination information to the user. This makes it possible for the user to efficiently and accurately obtain tourist destination information that matches their preferences and to visually confirm the information.

[0939] A "user" is someone who uses this system to obtain tourist destination information.

[0940] A "terminal" is a device used by a user (e.g., a smartphone or personal computer) that is used for inputting and displaying information.

[0941] A "server" is a central processing unit that receives data sent by users, searches a tourist destination database, and returns appropriate information.

[0942] "Location" refers to the user's current location and is geographical information used as a basis for searching for tourist destination information.

[0943] "Desired conditions" refer to requirements that indicate the characteristics and features of the tourist destination that the user is looking for, and include, for example, "day trip" or "a place rich in nature."

[0944] A "tourist destination database" is a database that stores information on various tourist destinations and has a structure that allows searching based on specific criteria.

[0945] "JSON format" is a data exchange format, an abbreviation for JavaScript Object Notation, which represents structured data in text format.

[0946] An "HTTP POST request" is part of the protocol used in web communication for a client to send data to a server.

[0947] "Visual display" means presenting information to the user in a visually easy-to-understand format on a device, such as lists or card formats.

[0948] This invention provides a system that allows users to efficiently and accurately obtain information that matches their preferences when searching for tourist destinations. In this system, when a user inputs their location and desired conditions into a terminal, that information is sent to a server, which searches a tourist destination database, retrieves relevant tourist destination information, and returns it to the user.

[0949] User actions

[0950] Users utilize devices such as smartphones or personal computers. First, users enter their current location (e.g., "Tokyo") and desired conditions (e.g., "day trip, nature-rich location") into the device's input interface. This input interface is provided in a simple and user-friendly format using text boxes and dropdown menus.

[0951] Data transmission by terminal

[0952] The terminal uses an HTTP POST request to convert the location and preference information entered by the user into JSON format and send it to the server. For example, the data is sent in the following format:

[0953] json

[0954] {

[0955] "location": "Tokyo",

[0956] "Preferences": "Day trips, places with abundant nature"

[0957] }

[0958] Data processing by the server

[0959] The server receives an HTTP POST request and parses the JSON data. Based on the parsed data, it searches the tourist destination database. The database holds the locations, categories, and names of numerous tourist destinations. The server filters the tourist destinations that match the specified criteria and creates a list of the relevant destinations. Examples include "Mount Takao," "Lake Kawaguchi," "Okutama," and "Nikko."

[0960] Data return from server to terminal

[0961] The server formats the search results into JSON format and sends them back to the terminal. The returned data will be in the following format:

[0962] json

[0963] {

[0964] "recommendations": ["Mount Takao", "Lake Kawaguchi", "Okutama", "Nikko"]

[0965] }

[0966] Data display via device

[0967] The terminal analyzes the list of tourist destinations received from the server and displays it to the user in a visually easy-to-understand format. This display format could be a list view or a card view. For example, it might be displayed as follows:

[0968] The following tourist destinations are recommended:

[0969] Mount Takao

[0970] Lake Kawaguchi

[0971] Okutama

[0972] sunlight

[0973] Specific example

[0974] When a user enters "Resident of Tokyo, day trip, nature-rich location," the device sends this information to the server. The server searches a tourist destination database and compiles a list of matching tourist destinations such as "Mt. Takao," "Lake Kawaguchi," "Okutama," and "Nikko," which are then sent back to the device. The device analyzes this returned data and displays it visually to the user, allowing them to quickly obtain information about tourist destinations that match their preferences.

[0975] Furthermore, when using a generative AI model to explain the system, the following prompt statements can be used:

[0976] I live in Tokyo and am looking for a day trip to a place with abundant nature. Could you recommend some tourist spots?

[0977] This system allows users to easily create more fulfilling travel plans.

[0978] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0979] Step 1:

[0980] The user enters their location and desired conditions into the device's input interface. Specifically, they enter information such as "Tokyo" or "day trip, nature-rich location" into text boxes or dropdown menus. The entered information is temporarily stored in the device's memory.

[0981] input:

[0982] Location: Tokyo

[0983] Desired conditions: Day trip, location with abundant nature

[0984] output:

[0985] User input data stored on the device

[0986] Step 2:

[0987] The terminal converts the data entered by the user into JSON format. This conversion is performed by a program within the terminal. The converted data will look like this:

[0988] json

[0989] {

[0990] "location": "Tokyo",

[0991] "Preferences": "Day trips, places with abundant nature"

[0992] }

[0993] The converted JSON data is sent to the server using an HTTP POST request.

[0994] input:

[0995] User input data

[0996] output:

[0997] Data converted to JSON format

[0998] Step 3:

[0999] The server receives an HTTP POST request and extracts JSON data from the request body. A program on the server performs this extraction process and parses the extracted data. Specifically, it analyzes the data content and extracts "location" and "desired conditions" individually.

[1000] input:

[1001] HTTP POST request

[1002] output:

[1003] Data of analyzed location and desired conditions

[1004] Step 4:

[1005] The server searches a tourist destination database based on the analyzed data. This database stores information such as the location, category, and name of tourist destinations. A query program within the server performs a search on the database and retrieves a list of tourist destinations that match the criteria. For example, "Mount Takao," "Lake Kawaguchi," "Okutama," and "Nikko" are among the tourist destinations that match the criteria.

[1006] input:

[1007] Data of analyzed location and desired conditions

[1008] output:

[1009] List of tourist destinations that match the criteria

[1010] Step 5:

[1011] The server formats the retrieved list of tourist destinations into JSON format. This formatting process is performed by a data format conversion program within the server. The formatted data will look like this:

[1012] json

[1013] {

[1014] "recommendations": ["Mount Takao", "Lake Kawaguchi", "Okutama", "Nikko"]

[1015] }

[1016] The formatted JSON data is sent back to the terminal as an HTTP response.

[1017] input:

[1018] List of tourist destinations that match the criteria

[1019] output:

[1020] List of tourist destinations formatted in JSON format

[1021] Step 6:

[1022] The terminal parses the JSON data received from the server. A program within the terminal parses the JSON data and converts it into data for visual display. The converted data is displayed on the terminal screen in a user-friendly format. For example, it might look like this:

[1023] The following tourist destinations are recommended:

[1024] Mount Takao

[1025] Lake Kawaguchi

[1026] Okutama

[1027] sunlight

[1028] input:

[1029] JSON data received from the server

[1030] output:

[1031] A list of tourist destinations displayed visually to the user.

[1032] This allows users to efficiently and accurately obtain tourist destination information that matches their preferences.

[1033] (Application Example 1)

[1034] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1035] In current factories, managing parts and materials is cumbersome, making it difficult to quickly locate specific parts and deliver them to designated locations. This problem leads to decreased productivity and increased working hours. To solve this problem, the present invention aims to provide a system in which a robot efficiently locates parts and delivers them quickly to a designated location simply by the user inputting the part's location and desired conditions.

[1036] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[1037] In this invention, the server includes means for a user to input the location of a part and desired conditions; means for transmitting the information of the part location and desired conditions entered by the user to the server; means for searching a parts database based on the part location and desired conditions and obtaining the corresponding part; means for returning the obtained part information to the user; and robot control means for delivering the obtained part to a specific location. This enables efficient searching and rapid delivery of parts.

[1038] A "user" refers to a person who operates the system and enters the location of the parts and their desired specifications.

[1039] "Part location" refers to information indicating the physical location of a specific part within a factory.

[1040] "Desired conditions" refers to information indicating the attributes or conditions that a user desires for a particular part.

[1041] A "server" refers to a computer system that receives input information from users, searches a parts database, and returns the results.

[1042] A "parts database" refers to a collection of data containing information such as the location, category, and name of a part.

[1043] A "robot" refers to an autonomous mechanical device that searches for, retrieves, and delivers specified parts to a designated location.

[1044] "Robot control means" refers to a control system that enables a robot to perform specified tasks according to the user's requests.

[1045] This invention is a system for efficiently searching for specified parts within a factory and for rapid delivery. The system includes a user input interface, information transmission means, a server, a parts database, a robot, and robot control means.

[1046] Key components of the system

[1047] 1. User Input Interface

[1048] Users enter the part location and desired specifications via a device (e.g., tablet, smartphone, work computer). The input interface is provided in an easy-to-use form format. For example, the "part location" and "desired specifications" could be selected using text boxes or dropdown menus.

[1049] 2. Information transmission by terminals

[1050] The terminal transmits information about the part's location and desired specifications entered by the user to the server. Technically, this process utilizes a structured data format such as JSON.

[1051] 3. Server-based parts database search

[1052] The server searches the parts database based on the received part location and desired conditions. The database holds basic information and attribute information for each part, and the server creates a list of parts that match the specified conditions.

[1053] 4. Data return by the server

[1054] The server returns the retrieved part information as search results to the terminal in a structured format (e.g., JSON). This information includes a list of parts that best match the user's desired conditions.

[1055] 5. Information display via terminal

[1056] The terminal visually displays a list of components received from the server to the user. The display format used is one that is easy for the user to understand intuitively, such as a list view or a card format.

[1057] 6. Robot control means

[1058] The robot searches for specified parts based on information received from the server, efficiently retrieves them, and delivers them to the designated location. The robot control system controls the robot's movements and enables it to perform its tasks.

[1059] Program processing

[1060] 1. The user enters the part location and desired specifications into the terminal's input fields. The terminal collects this information and converts it to JSON format.

[1061] 2. The terminal sends data entered by the user to the server. For example, the following data is sent:

[1062] {

[1063] "location": "Area A-3",

[1064] "preferences": "Type 1024 cover"

[1065] }

[1066] 3. The server searches the parts database based on the received input data. This database contains detailed information about each part, including its location and attributes. The server picks out parts that match the criteria and creates a list. For example, "Type 1024 Cover" and "Type 2035 Screw" might be included.

[1067] 4. The server creates a list of parts in JSON format and sends it back to the terminal. The data sent back will look like this:

[1068] {

[1069] "recommendations": ["Type 1024 cover", "Type 2035 screws"]

[1070] }

[1071] 5. The terminal displays the list of components received from the server in a user-friendly format. For example, it may display the following visual information:

[1072] The following parts were found:

[1073] Type 1024 cover

[1074] 2035 type screw

[1075] 6. The robot searches for the specified part, retrieves it, and delivers it to the user's desired location.

[1076] Specific example

[1077] For example, if a user enters "Area A-3, Type 1024 cover," the terminal sends this information to the server, which searches the parts database for parts such as "Type 1024 cover" and "Type 2035 screw," and returns a list. This allows the user to quickly obtain information on parts that match their needs, and the robot can retrieve the specified parts and deliver them to the required location.

[1078] Examples of prompts to input into a generative AI model:

[1079] Please enter the location of the part and the part you want:

[1080] "Area A-3, Type 1024 cover"

[1081] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[1082] Step 1:

[1083] The user enters the part location and desired specifications into the input fields on the terminal. The user specifies the "part location" and "desired specifications" using text boxes and dropdown menus displayed on the terminal. For example, they might enter "Area A-3" and "Type 1024 Cover". This information is stored as a variable within the terminal.

[1084] Step 2:

[1085] The terminal converts the collected user input into JSON format. It converts the user-entered part locations and desired conditions into key-value pairs, generating structured JSON data. The generated JSON will look like this:

[1086] {

[1087] "location": "Area A-3",

[1088] "preferences": "Type 1024 cover"

[1089] }

[1090] Step 3:

[1091] The device sends the generated JSON data to the server. In doing so, the device uses an HTTP POST request to send the data to the server's API endpoint. The server receives this request and interprets the data.

[1092] Step 4:

[1093] The server parses the received JSON data and searches the parts database. The server queries the database using the conditions "Area A-3" and "Type 1024 Cover" and extracts the relevant parts information. The parts database includes the location, category, and name of each part.

[1094] Step 5:

[1095] The server structures the list of matching parts obtained as search results in JSON format. For example, if the search results match "Type 1024 cover" and "Type 2035 screw," it generates JSON data like the following:

[1096] {

[1097] "recommendations": ["Type 1024 cover", "Type 2035 screws"]

[1098] }

[1099] Step 6:

[1100] The server sends structured JSON data back to the device. In this process, the JSON data is sent as an HTTP response. The device receives this response and retrieves the data.

[1101] Step 7:

[1102] The terminal parses the received JSON data and displays it visually to the user. The terminal's UI provides the user with the relevant component information in list or card format. For example, the display might look like this:

[1103] The following parts were found:

[1104] Type 1024 cover

[1105] 2035 type screw

[1106] Step 8:

[1107] The robot searches for and retrieves the specified part based on the part information transmitted from the server. The robot control system autonomously moves and acquires the part based on the part's location and the name of the specified part.

[1108] Step 9:

[1109] The robot delivers the extracted parts to a specific location. Finally, the robot control system operates to deliver the parts to the designated destination and issues a notification when delivery is complete.

[1110] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[1111] This system is designed to allow users to efficiently and accurately obtain information that matches their preferences when searching for tourist destinations. Furthermore, it incorporates an emotion engine to recognize the user's emotional state and recommend the most suitable tourist destinations based on that state.

[1112] Key components of the system

[1113] 1. User Input Interface

[1114] Users enter their location and desired conditions via their device (e.g., smartphone, computer). The input interface is provided in a simple and user-friendly form format. For example, "location" and "desired conditions" could be selected using text boxes or dropdown menus.

[1115] 2. Information transmission by terminals

[1116] The terminal converts the information entered by the user into a structured data format such as JSON and sends it to the server via the internet.

[1117] 3. Server-based analysis of user sentiment

[1118] The server has an emotion engine built in that analyzes user input, voice data, and image data to estimate the user's emotional state. For example, it analyzes the emotion of text entered by the user using natural language processing technology.

[1119] 4. The server searches the tourist destination database.

[1120] The server searches the tourist destination database based on the received location and desired conditions, as well as the analyzed user's emotional state. The database holds basic information and attribute information for each tourist destination, and the server creates a list of tourist destinations that match the specified conditions.

[1121] 5. The server formats the search results and returns them.

[1122] The server formats appropriate tourist destination information and sends it back to the user's terminal. This information consists of a list of optimal tourist destinations based on the user's location, preferences, and emotional state.

[1123] 6. Information display via terminal

[1124] The terminal receives a list of tourist destinations sent back from the server and displays it visually to the user. The display format used is one that is easy for the user to understand intuitively, such as a list view or a card format.

[1125] Explanation of the program's processing

[1126] The user enters their location and desired conditions.

[1127] The user enters their location (e.g., Tokyo) and desired conditions (e.g., day trip, nature-rich location) into the terminal's input fields. The terminal then retrieves this information.

[1128] The terminal sends input to the server.

[1129] The terminal converts the user's input data into a structured data format such as JSON and sends it to the server. The server receives the request and begins parsing.

[1130] The server analyzes the user's input and emotions.

[1131] The server parses the received JSON data to obtain the user's location and desired conditions. Simultaneously, the emotion engine analyzes the user's input to estimate their emotional state. For example, it might read from the input text that the user wants to "relax" or "have an adventure."

[1132] The server searches the tourist destination database.

[1133] The server searches the tourist destination database based on the user's location, desired conditions, and analyzed emotional state. It then lists tourist destinations that match the conditions and constructs that list.

[1134] The server returns the results to the user.

[1135] The server formats the tourist destination information obtained as search results and returns it to the terminal in a structured format (e.g., JSON). The returned data includes a list of tourist destinations that best suit the user's location, preferences, and emotional state.

[1136] The terminal receives data from the server.

[1137] The terminal receives the data returned from the server and verifies that it is in the correct format. It then parses the data and prepares it for display.

[1138] The device displays the results to the user.

[1139] The terminal visualizes the received data and displays it in a user-friendly format (e.g., list view or card view). Users can then view suggested tourist destination information from the server through the terminal's screen.

[1140] Specific example

[1141] For example, if a user enters "lives in Tokyo, day trip, nature-rich location," the device sends this information to the server. The server searches a tourist destination database and retrieves results such as "Mount Takao," "Lake Kawaguchi," "Okutama," and "Nikko." At the same time, if the emotion engine estimates the user's emotional state as "wanting to relax," it rearranges the search results to match that emotion and presents "Mount Takao" as the most recommended tourist destination.

[1142] The above describes an example of a specific embodiment of the present invention. This system allows users to efficiently find tourist destinations that match their emotional state and desired conditions, thereby enabling them to have a more fulfilling travel experience.

[1143] The following describes the processing flow.

[1144] Step 1:

[1145] The user enters their location and desired conditions.

[1146] The user enters their location (e.g., Tokyo) and desired conditions (e.g., day trip, nature-rich location) into the device's interface. The device then retrieves this information.

[1147] Step 2:

[1148] The terminal sends the input to the server.

[1149] The terminal converts the user's input data into a structured data format such as JSON and sends it to the server over the internet. The server receives the request and prepares to begin analysis.

[1150] Step 3:

[1151] The server recognizes the user's emotions.

[1152] An emotion engine embedded in the server analyzes user input (e.g., text), audio data, and image data to estimate the user's emotional state. For example, natural language processing techniques are used to determine what emotional state the user is in (e.g., want to relax, want to go on an adventure).

[1153] Step 4:

[1154] The server analyzes the user's input information.

[1155] The server parses the received JSON data to obtain the user's location and desired conditions. This information is then used for the next tourist destination search.

[1156] Step 5:

[1157] The server searches the tourist destination database.

[1158] The server searches a tourist destination database based on the user's location, desired conditions, and analyzed emotional state. For example, it might find tourist destinations that match the conditions "Tokyo," "day trip," "place with abundant nature," and "want to relax." The server then generates a list of tourist destinations that meet these conditions.

[1159] Step 6:

[1160] The server formats the search results and returns them to the user.

[1161] The server formats the tourist destination information obtained as search results into a structured format such as JSON and sends it back to the terminal. The returned data includes a list of tourist destinations that best suit the user's location, preferences, and emotional state.

[1162] Step 7:

[1163] The terminal receives data from the server.

[1164] The terminal receives data returned from the server and verifies that the data is in the correct format. It then parses the received data and prepares it for display.

[1165] Step 8:

[1166] The device displays tourist destination results to the user.

[1167] The device visualizes the received data and displays it in a user-friendly format (e.g., list view, card view). For example, it could display a list of tourist destinations prioritized based on the user's emotional state. The user can then view the suggested tourist destination information from the server through the device's screen.

[1168] Through the steps described above, users can efficiently obtain tourist destination information that matches their desired conditions and emotional state, and easily decide on their next travel destination.

[1169] (Example 2)

[1170] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1171] While current tourist information systems can provide tourist destination information based on the user's location and preferences, they cannot format the information to take into account the user's emotional state. Therefore, it is difficult to provide the most suitable tourist destinations that match the user's specific situation and feelings. Furthermore, the input of user preferences and the display of results can sometimes be unintuitive, leading to usability issues.

[1172] The identification processing by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for the user to input location and desired conditions, means for transmitting the location and desired conditions information entered by the user to the server, means for searching a tourist destination database based on the location and desired conditions and obtaining the corresponding tourist destination, means for returning the obtained tourist destination information to the user, means including an emotion engine that analyzes the user's input and estimates their emotional state, means for sorting the tourist destination information based on the emotional state, and means for formatting the tourist destination information in a visually displayable format. This makes it possible to suggest tourist destinations that take the user's emotional state into consideration.

[1173] "Location" refers to the user's current geographical location or place of residence.

[1174] "Desired conditions" refer to the requirements and characteristics that users look for in a tourist destination they want to visit (e.g., day trip, place with abundant nature, etc.).

[1175] A "server" refers to a computer system that receives and processes data sent by a user.

[1176] A "tourist destination database" refers to a data storage system that stores information about tourist destinations (e.g., location, category, name of the tourist destination, etc.).

[1177] An "emotion engine" refers to software or algorithms that analyze user input and estimate their emotional state.

[1178] "User input" refers to data provided by the user via their device (e.g., location, desired conditions, text, etc.).

[1179] "Emotional state" refers to the psychological state that a user expresses through their input (e.g., wanting to relax, wanting to go on an adventure, etc.).

[1180] "Formatting" refers to the process of converting data into a visually easy-to-understand format (e.g., list display, card format, etc.).

[1181] This invention is a system designed to allow users to efficiently and accurately obtain information that matches their preferences when searching for tourist destinations. Furthermore, it incorporates an emotion engine to recognize the user's emotional state and recommend the most suitable tourist destinations based on that state.

[1182] The specific components and procedures for implementing this system are as follows:

[1183] User input interface

[1184] Users enter their location and desired conditions via their device (e.g., smartphone, computer). The input interface is provided in a simple and user-friendly form format. For example, "location" and "desired conditions" could be selected using text boxes or dropdown menus.

[1185] Information transmission by terminal

[1186] The terminal converts the information entered by the user into a structured data format such as JSON and sends it to the server via the internet.

[1187] Server-based user sentiment analysis

[1188] The server has an emotion engine built in that analyzes user input, voice data, and image data to estimate the user's emotional state. For example, it analyzes the emotion of text entered by the user using natural language processing (NLP) tools.

[1189] The server searches the tourist destination database.

[1190] The server searches the tourist destination database based on the received location and desired conditions, as well as the analyzed user's emotional state. The database contains basic information and attribute information for each tourist destination, and the server creates a list of tourist destinations that match the specified conditions.

[1191] The server formats the search results and returns them.

[1192] The server formats appropriate tourist destination information and sends it back to the user's terminal. This information consists of a list of optimal tourist destinations based on the user's location, preferences, and emotional state.

[1193] Information display via terminal

[1194] The terminal receives a list of tourist destinations sent back from the server and displays it visually to the user. The display format used is one that is easy for the user to understand intuitively, such as a list view or a card format.

[1195] For example, if a user enters "Tokyo resident, day trip, nature-rich location" into their smartphone, the device sends this information to the server. The server searches a tourist destination database and retrieves results such as "Mount Takao," "Lake Kawaguchi," "Okutama," and "Nikko." Simultaneously, if the emotion engine estimates the user's emotional state as "wanting to relax," it rearranges the search results to match that emotion and presents "Mount Takao" as the most recommended tourist destination. In this way, the system efficiently suggests tourist destinations that are best suited to the user's emotions and desired conditions.

[1196] Example of a prompt

[1197] Examples of prompts for a generative AI model are as follows:

[1198] "A user enters 'Resident of Tokyo, day trip, nature-rich location,' and the emotion engine analyzes this as 'Want to relax.' Please describe in detail the processing steps of the system that suggests the most suitable tourist destination to the user based on this information."

[1199] This system allows users to efficiently find tourist destinations that match their emotional state and desired conditions, resulting in a more fulfilling travel experience.

[1200] The flow of the specific processing in Example 2 will be explained using Figure 13.

[1201] Step 1: The user enters the data.

[1202] The user enters their location (e.g., Tokyo) and desired conditions (e.g., day trip, nature-rich location) into the terminal's input fields. Text boxes or dropdown menus are used for input. The terminal receives the user's input and stores it internally. The input in this step is the user's location and desired conditions, and the output is the location and desired conditions data stored within the terminal.

[1203] Step 2: The terminal sends the input data.

[1204] The terminal converts the location and desired conditions entered by the user into JSON format. Next, it sends this JSON data to the server via the internet. An example of the converted JSON data is as follows:

[1205] json

[1206] {

[1207] "location": "Tokyo",

[1208] "preferences": ["day trip", "place with abundant nature"]

[1209] }

[1210] The input for this step is the stored location and desired conditions data, and the output is JSON format data that will be sent to the server.

[1211] Step 3: The server analyzes the data.

[1212] The server parses the received JSON data and extracts the user's location (e.g., Tokyo) and desired conditions (e.g., day trip, nature-rich location). Simultaneously, the emotion engine analyzes the user's input and estimates their emotional state. For example, if the text "I want to relax" is entered, an NLP tool is used to analyze it and extract this emotional state. The input for this step is the JSON data sent to the server, and the output is the extracted location, desired conditions, and emotional state data.

[1213] Step 4: The server searches the database.

[1214] The server searches a tourist destination database based on the extracted location (e.g., Tokyo), desired conditions (e.g., day trip, nature-rich location), and emotional state (e.g., "I want to relax"). The database contains basic and attribute information about tourist destinations. The server lists tourist destinations that match the conditions and creates a list. The input for this step is the extracted location, desired conditions, and emotional state data, and the output is the list of tourist destinations obtained as a search result.

[1215] Step 5: The server formats the results and sends them back.

[1216] The server uses the acquired tourist destination information to create a list sorted based on emotional states. Next, it reconstructs this list into JSON format and sends it back to the terminal. An example of the formatted JSON data is as follows:

[1217] json

[1218] {

[1219] "recommendations": [

[1220] {"place": "Mount Takao", "description": "A nature-rich place where you can enjoy mountain climbing"},

[1221] {"place": "Kawaguchiko", "description": "A relaxing lakeside view"}

[1222] {"place": "Okutama", "description": "A place rich in nature where you can enjoy hiking"}

[1223] ]

[1224] }

[1225] The input for this step is a list of tourist destinations obtained as search results, and the output is formatted tourist destination information in JSON format.

[1226] Step 6: The device receives and displays the data.

[1227] The terminal receives the JSON data returned from the server and verifies that its format is correct. Next, it parses the data and displays it in a user-friendly format (e.g., list view or card view). The input for this step is the formatted tourist destination information JSON data returned from the server, and the output is a visual list of tourist destinations displayed to the user.

[1228] Through the above processing steps, users can efficiently find tourist destinations that best suit their emotional state and desired conditions.

[1229] (Application Example 2)

[1230] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1231] Conventional tourist destination information systems provide tourist destination information selected based solely on the location and desired conditions entered by the user. Therefore, they may not adequately suggest the most suitable tourist destinations based on the user's emotional state. For this reason, there is a need to provide customized tourist destination information that reflects the user's current mood and emotions.

[1232] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[1233] In this invention, the server includes means for the user to input location and desired conditions, means for analyzing the user's emotional state, means for searching a tourist destination database based on the location, desired conditions, and emotional state, and obtaining the relevant tourist destinations, and means for prioritizing the obtained tourist destination information and returning it to the user. This makes it possible to provide optimal tourist destination information according to the user's emotional state.

[1234] "Location" refers to information indicating the user's current location or the places they wish to visit.

[1235] "Desired conditions" refer to the specific conditions or requirements that users seek when selecting a tourist destination.

[1236] A "server" is a part of a computer system that receives and processes data sent by a user.

[1237] A "tourist destination database" is a database that stores various information about tourist destinations.

[1238] "Emotional state" refers to information that indicates the user's current mood and emotional state.

[1239] "Prioritization" is the process of determining the display order of acquired tourist destination information based on the user's emotional state and preferences.

[1240] A "terminal" is a device used by users to input their location and desired conditions, and to exchange information with the server.

[1241] This invention provides a system for tourist guides primarily used in physical stores. Users can obtain tourist information via their smartphones and find tourist destinations that best suit their emotional state.

[1242] First, the user enters their location and desired conditions into their smartphone. This information is converted to JSON format and sent to the server. The smartphone then configures the user interface using common input forms and dropdown menus.

[1243] The server analyzes the received user data and uses an emotion engine to estimate the user's emotional state. For example, it analyzes the text and emojis entered by the user and uses natural language processing techniques to read their emotions. The emotion engine can utilize external emotion recognition libraries. We will explain this using a library called EmotionEngine as an example.

[1244] Next, the server searches a tourist destination database. This database contains information such as location, category, and tourist destination name. The database search is performed based on the user's location and preferences, as well as their estimated emotional state. This retrieves tourist destination information that is best suited to the user's emotional state.

[1245] Once the target tourist destination information is retrieved, the server organizes it and creates a prioritized list. This list is then sorted considering the user's emotional state. For example, if the user's emotional state is estimated to be "wanting to relax," tourist destinations that promote relaxation will be displayed preferentially.

[1246] Finally, the server sends the organized tourist information back to the smartphone. The smartphone visually displays the received data and provides it to the user. The display format uses an intuitive and easy-to-understand format, such as a list view or a card view.

[1247] Hardware and software to be used

[1248] Hardware: Smartphone

[1249] Software: EmotionEngine (emotion recognition library), TouristSpotDatabase (tourist destination database), Flask (web framework)

[1250] Specific example

[1251] For example, consider a scenario where a user uses an application in a store in Tokyo and enters "I live in Tokyo, and I'm looking for a relaxing day trip destination." The user then enters the emoji "😊 (relaxed)." Based on this information, the server suggests tourist destinations such as Mount Takao, Lake Kawaguchi, and Okutama.

[1252] Prompt text to input to the generative AI model

[1253] "I live in Tokyo and am looking for a day trip. Please recommend a relaxing place surrounded by nature. My desired emotion is '😊 (relaxed)'."

[1254] Thus, the present invention provides customized tourist destination information according to the user's emotional state, supporting a more fulfilling travel experience.

[1255] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[1256] Step 1:

[1257] The user enters their location and desired conditions on their smartphone. The user enters their location (e.g., Tokyo) and desired sightseeing conditions (e.g., day trip, nature-rich location) into the input fields, and also enters text or emojis to express their feelings. The entered data (location, desired conditions, feelings) is then imported into the device.

[1258] Step 2:

[1259] The terminal converts the data entered by the user into JSON format and sends it to the server. The terminal's processing includes converting the user's input data into the correct format and sending it to the server via an HTTP request.

[1260] Step 3:

[1261] The server analyzes the data received from the terminal. Since the received data is in JSON format, the server analyzes it to extract location, desired conditions, and emotional information. Formatted data (location, desired conditions, emotional state) is obtained.

[1262] Step 4:

[1263] The server's emotion engine analyzes the user's emotional state. The server passes the received emotional information to the EmotionEngine library for analysis. The emotion engine uses natural language processing techniques to estimate the user's emotion, such as "I want to relax." The emotional state is obtained as a result of the analysis.

[1264] Step 5:

[1265] The server searches the tourist destination database based on location, desired conditions, and analyzed sentiment state. The tourist destination database contains various tourist destination information, and the server executes database queries to extract tourist destinations that match the conditions. The extracted data includes location, category, and tourist destination name.

[1266] Step 6:

[1267] The server prioritizes tourist destination information based on search results, taking into account the user's emotional state. The server applies an algorithm tailored to the emotional state, rearranging the retrieved tourist destinations in an order that best suits the user's emotions. A prioritized list of tourist destinations is then generated.

[1268] Step 7:

[1269] The server formats the prioritized tourist destination information into JSON format and sends it back to the terminal. The formatting process performed by the server includes the function of formatting the tourist destination information in an appropriate format and sending it back to the terminal as an HTTP response.

[1270] Step 8:

[1271] The terminal receives data sent back from the server and displays it visually. The terminal analyzes the received data and displays tourist destination information to the user in an intuitively understandable list or card format. This allows the user to find tourist destination information that best suits their emotional state.

[1272] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[1273] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1274] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[1275] [Fourth Embodiment]

[1276] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[1277] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1278] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1279] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[1280] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[1281] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[1282] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[1283] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[1284] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[1285] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1286] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1287] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[1288] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1289] This system is designed to allow users to efficiently and accurately obtain information that matches their preferences when searching for tourist destinations. Specifically, when a user enters their location and desired conditions into their terminal, that information is sent to a server, which searches the tourist destination database to retrieve relevant information and then sends it back to the user.

[1290] Key components of the system

[1291] 1. User Input Interface

[1292] Users enter their location and desired conditions via their device (e.g., smartphone, computer). The input interface is provided in a simple and easy-to-use form format. For example, "location" and "desired conditions" could be selected using text boxes or dropdown menus.

[1293] 2. Information transmission by terminals

[1294] The terminal sends the location and desired conditions entered by the user to the server. Technically, this process utilizes a structured data format such as JSON.

[1295] 3. Searching tourist destination databases via server

[1296] The server searches the tourist destination database based on the received location and desired conditions. The database holds basic information and attribute information for each tourist destination, and the server creates a list of tourist destinations that match the specified conditions.

[1297] 4. Data return by the server

[1298] The server returns the tourist destination information obtained as search results to the terminal in a structured format (e.g., JSON). This information includes a list of tourist destinations that best match the user's preferences.

[1299] 5. Information display via terminal

[1300] The terminal visually displays a list of tourist destinations received from the server to the user. The display format used is one that is easy for the user to understand intuitively, such as a list view or a card format.

[1301] Explanation of the program's processing

[1302] The user enters their location and desired conditions.

[1303] The user enters their location (e.g., Tokyo) and desired conditions (e.g., day trip, nature-rich location) into the designated input fields on the device. The device collects this information.

[1304] The terminal sends input to the server.

[1305] The terminal converts the data entered by the user into a format such as JSON and sends it to the server. For example, the following data is sent:

[1306] json

[1307] {

[1308] "location": "Tokyo",

[1309] "Preferences": "Day trips, places with abundant nature"

[1310] }

[1311] The server searches the tourist destination database.

[1312] The server searches a tourist destination database based on the input data it receives. This database contains detailed information about each tourist destination, including its location and attributes. The server picks out tourist destinations that match the criteria and creates a list. For example, "Mount Takao," "Lake Kawaguchi," "Okutama," and "Nikko" might be included.

[1313] The server returns the results to the user.

[1314] The server creates a list of tourist destinations in JSON format and sends it back to the terminal. The returned data will look like this:

[1315] json

[1316] {

[1317] "recommendations": ["Mount Takao", "Lake Kawaguchi", "Okutama", "Nikko"]

[1318] }

[1319] The device displays the results to the user.

[1320] The terminal displays a list of tourist destinations received from the server in a user-friendly format. For example, it may display the following visual information:

[1321] The following tourist destinations are recommended:

[1322] Mount Takao

[1323] Lake Kawaguchi

[1324] Okutama

[1325] sunlight

[1326] Specific example

[1327] For example, if a user enters "lives in Tokyo, day trip, nature-rich location," the device sends this information to the server. The server then searches its tourist destination database for places like "Mount Takao," "Lake Kawaguchi," "Okutama," and "Nikko," and returns a list. This allows the user to quickly obtain information on tourist destinations that match their preferences and use it as a reference to decide on their next outing.

[1328] The above describes an example of an embodiment for specifically implementing the present invention. This system allows users to efficiently obtain tourist destination information and create more comprehensive travel plans.

[1329] The following describes the processing flow.

[1330] Step 1:

[1331] The user enters their location and desired conditions.

[1332] The user enters their location (e.g., Tokyo) and desired conditions (e.g., day trip, nature-rich location) into the device's interface. The device then retrieves this information.

[1333] Step 2:

[1334] The terminal sends user input to the server.

[1335] The terminal converts user input into a structured data format such as JSON and sends it to the server over the internet. At this point, the server receives the request and prepares to begin analysis.

[1336] Step 3:

[1337] The server analyzes the user's input information.

[1338] The server parses the received JSON data to obtain the user's location and desired conditions. Based on the parsed data, the server prepares to search the tourist destination database.

[1339] Step 4:

[1340] The server searches the tourist destination database.

[1341] The server searches the tourist destination database based on the user's location and desired conditions. For example, the server retrieves tourist destinations from the database that match the criteria of "Tokyo," "day trip," and "places rich in nature." In this process, it generates a list of tourist destinations that meet the conditions.

[1342] Step 5:

[1343] The server formats the search results and sends them back to the terminal.

[1344] The server formats the tourist destination information obtained as search results into a structured format such as JSON and sends it back to the terminal. The data returned from the server includes a list of the relevant tourist destinations.

[1345] Step 6:

[1346] The terminal receives data from the server.

[1347] The terminal receives the data sent back from the server and analyzes it. It verifies that the received data is in the correct format and prepares to proceed to the next processing step.

[1348] Step 7:

[1349] The device displays tourist destination results to the user.

[1350] The terminal visualizes the received data and displays it in a user-friendly format (e.g., list view, card view). Users can view information about suggested tourist destinations from the server through the terminal's screen.

[1351] By following these steps, users can efficiently obtain tourist destination information that suits their preferences and easily decide on their next travel destination.

[1352] (Example 1)

[1353] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1354] Modern tourist destination information systems have a problem in that it is difficult for users to efficiently and accurately find tourist destinations that meet their preferences. Furthermore, the process from information acquisition to display is often cumbersome, resulting in a poor user experience.

[1355] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[1356] In this invention, the server includes means for the user to input location and desired conditions, means for transmitting the location and desired conditions information entered by the user to the server via a terminal, means for the server to search a tourist destination database based on the received location and desired conditions and obtain the corresponding tourist destination, means for returning the obtained tourist destination information to the user's terminal in a structured format, and means for the terminal to visually display the received tourist destination information to the user. This makes it possible for the user to efficiently and accurately obtain tourist destination information that matches their preferences and to visually confirm the information.

[1357] A "user" is someone who uses this system to obtain tourist destination information.

[1358] A "terminal" is a device used by a user (e.g., a smartphone or personal computer) that is used for inputting and displaying information.

[1359] A "server" is a central processing unit that receives data sent by users, searches a tourist destination database, and returns appropriate information.

[1360] "Location" refers to the user's current location and is geographical information used as a basis for searching for tourist destination information.

[1361] "Desired conditions" refer to requirements that indicate the characteristics and features of the tourist destination that the user is looking for, and include, for example, "day trip" or "a place rich in nature."

[1362] A "tourist destination database" is a database that stores information on various tourist destinations and has a structure that allows searching based on specific criteria.

[1363] "JSON format" is a data exchange format, an abbreviation for JavaScript Object Notation, which represents structured data in text format.

[1364] An "HTTP POST request" is part of the protocol used in web communication for a client to send data to a server.

[1365] "Visual display" means presenting information to the user in a visually easy-to-understand format on a device, such as lists or card formats.

[1366] This invention provides a system that allows users to efficiently and accurately obtain information that matches their preferences when searching for tourist destinations. In this system, when a user inputs their location and desired conditions into a terminal, that information is sent to a server, which searches a tourist destination database, retrieves relevant tourist destination information, and returns it to the user.

[1367] User actions

[1368] Users utilize devices such as smartphones or personal computers. First, users enter their current location (e.g., "Tokyo") and desired conditions (e.g., "day trip, nature-rich location") into the device's input interface. This input interface is provided in a simple and user-friendly format using text boxes and dropdown menus.

[1369] Data transmission by terminal

[1370] The terminal uses an HTTP POST request to convert the location and preference information entered by the user into JSON format and send it to the server. For example, the data is sent in the following format:

[1371] json

[1372] {

[1373] "location": "Tokyo",

[1374] "Preferences": "Day trips, places with abundant nature"

[1375] }

[1376] Data processing by the server

[1377] The server receives an HTTP POST request and parses the JSON data. Based on the parsed data, it searches the tourist destination database. The database holds the locations, categories, and names of numerous tourist destinations. The server filters the tourist destinations that match the specified criteria and creates a list of the relevant destinations. Examples include "Mount Takao," "Lake Kawaguchi," "Okutama," and "Nikko."

[1378] Data return from server to terminal

[1379] The server formats the search results into JSON format and sends them back to the terminal. The returned data will be in the following format:

[1380] json

[1381] {

[1382] "recommendations": ["Mount Takao", "Lake Kawaguchi", "Okutama", "Nikko"]

[1383] }

[1384] Data display via device

[1385] The terminal analyzes the list of tourist destinations received from the server and displays it to the user in a visually easy-to-understand format. This display format could be a list view or a card view. For example, it might be displayed as follows:

[1386] The following tourist destinations are recommended:

[1387] Mount Takao

[1388] Lake Kawaguchi

[1389] Okutama

[1390] sunlight

[1391] Specific example

[1392] When a user enters "Resident of Tokyo, day trip, nature-rich location," the device sends this information to the server. The server searches a tourist destination database and compiles a list of matching tourist destinations such as "Mt. Takao," "Lake Kawaguchi," "Okutama," and "Nikko," which are then sent back to the device. The device analyzes this returned data and displays it visually to the user, allowing them to quickly obtain information about tourist destinations that match their preferences.

[1393] Furthermore, when using a generative AI model to explain the system, the following prompt statements can be used:

[1394] I live in Tokyo and am looking for a day trip to a place with abundant nature. Could you recommend some tourist spots?

[1395] This system allows users to easily create more fulfilling travel plans.

[1396] The flow of the specific processing in Example 1 will be explained using Figure 11.

[1397] Step 1:

[1398] The user enters their location and desired conditions into the device's input interface. Specifically, they enter information such as "Tokyo" or "day trip, nature-rich location" into text boxes or dropdown menus. The entered information is temporarily stored in the device's memory.

[1399] input:

[1400] Location: Tokyo

[1401] Desired conditions: Day trip, location with abundant nature

[1402] output:

[1403] User input data stored on the device

[1404] Step 2:

[1405] The terminal converts the data entered by the user into JSON format. This conversion is performed by a program within the terminal. The converted data will look like this:

[1406] json

[1407] {

[1408] "location": "Tokyo",

[1409] "Preferences": "Day trips, places with abundant nature"

[1410] }

[1411] The converted JSON data is sent to the server using an HTTP POST request.

[1412] input:

[1413] User input data

[1414] output:

[1415] Data converted to JSON format

[1416] Step 3:

[1417] The server receives an HTTP POST request and extracts JSON data from the request body. A program on the server performs this extraction process and parses the extracted data. Specifically, it analyzes the data content and extracts "location" and "desired conditions" individually.

[1418] input:

[1419] HTTP POST request

[1420] output:

[1421] Data of analyzed location and desired conditions

[1422] Step 4:

[1423] The server searches a tourist destination database based on the analyzed data. This database stores information such as the location, category, and name of tourist destinations. A query program within the server performs a search on the database and retrieves a list of tourist destinations that match the criteria. For example, "Mount Takao," "Lake Kawaguchi," "Okutama," and "Nikko" are among the tourist destinations that match the criteria.

[1424] input:

[1425] Data of analyzed location and desired conditions

[1426] output:

[1427] List of tourist destinations that match the criteria

[1428] Step 5:

[1429] The server formats the retrieved list of tourist destinations into JSON format. This formatting process is performed by a data format conversion program within the server. The formatted data will look like this:

[1430] json

[1431] {

[1432] "recommendations": ["Mount Takao", "Lake Kawaguchi", "Okutama", "Nikko"]

[1433] }

[1434] The formatted JSON data is sent back to the terminal as an HTTP response.

[1435] input:

[1436] List of tourist destinations that match the criteria

[1437] output:

[1438] List of tourist destinations formatted in JSON format

[1439] Step 6:

[1440] The terminal parses the JSON data received from the server. A program within the terminal parses the JSON data and converts it into data for visual display. The converted data is displayed on the terminal screen in a user-friendly format. For example, it might look like this:

[1441] The following tourist destinations are recommended:

[1442] Mount Takao

[1443] Lake Kawaguchi

[1444] Okutama

[1445] sunlight

[1446] input:

[1447] JSON data received from the server

[1448] output:

[1449] A list of tourist destinations displayed visually to the user.

[1450] This allows users to efficiently and accurately obtain tourist destination information that matches their preferences.

[1451] (Application Example 1)

[1452] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1453] In current factories, managing parts and materials is cumbersome, making it difficult to quickly locate specific parts and deliver them to designated locations. This problem leads to decreased productivity and increased working hours. To solve this problem, the present invention aims to provide a system in which a robot efficiently locates parts and delivers them quickly to a designated location simply by the user inputting the part's location and desired conditions.

[1454] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[1455] In this invention, the server includes means for a user to input the location of a part and desired conditions; means for transmitting the information of the part location and desired conditions entered by the user to the server; means for searching a parts database based on the part location and desired conditions and obtaining the corresponding part; means for returning the obtained part information to the user; and robot control means for delivering the obtained part to a specific location. This enables efficient searching and rapid delivery of parts.

[1456] A "user" refers to a person who operates the system and enters the location of the parts and their desired specifications.

[1457] "Part location" refers to information indicating the physical location of a specific part within a factory.

[1458] "Desired conditions" refers to information indicating the attributes or conditions that a user desires for a particular part.

[1459] A "server" refers to a computer system that receives input information from users, searches a parts database, and returns the results.

[1460] A "parts database" refers to a collection of data containing information such as the location, category, and name of a part.

[1461] A "robot" refers to an autonomous mechanical device that searches for, retrieves, and delivers specified parts to a designated location.

[1462] "Robot control means" refers to a control system that enables a robot to perform specified tasks according to the user's requests.

[1463] This invention is a system for efficiently searching for specified parts within a factory and for rapid delivery. The system includes a user input interface, information transmission means, a server, a parts database, a robot, and robot control means.

[1464] Key components of the system

[1465] 1. User Input Interface

[1466] Users enter the part location and desired specifications via a device (e.g., tablet, smartphone, work computer). The input interface is provided in an easy-to-use form format. For example, the "part location" and "desired specifications" could be selected using text boxes or dropdown menus.

[1467] 2. Information transmission by terminals

[1468] The terminal transmits information about the part's location and desired specifications entered by the user to the server. Technically, this process utilizes a structured data format such as JSON.

[1469] 3. Server-based parts database search

[1470] The server searches the parts database based on the received part location and desired conditions. The database holds basic information and attribute information for each part, and the server creates a list of parts that match the specified conditions.

[1471] 4. Data return by the server

[1472] The server returns the retrieved part information as search results to the terminal in a structured format (e.g., JSON). This information includes a list of parts that best match the user's desired conditions.

[1473] 5. Information display via terminal

[1474] The terminal visually displays a list of components received from the server to the user. The display format used is one that is easy for the user to understand intuitively, such as a list view or a card format.

[1475] 6. Robot control means

[1476] The robot searches for specified parts based on information received from the server, efficiently retrieves them, and delivers them to the designated location. The robot control system controls the robot's movements and enables it to perform its tasks.

[1477] Program processing

[1478] 1. The user enters the part location and desired specifications into the terminal's input fields. The terminal collects this information and converts it to JSON format.

[1479] 2. The terminal sends data entered by the user to the server. For example, the following data is sent:

[1480] {

[1481] "location": "Area A-3",

[1482] "preferences": "Type 1024 cover"

[1483] }

[1484] 3. The server searches the parts database based on the received input data. This database contains detailed information about each part, including its location and attributes. The server picks out parts that match the criteria and creates a list. For example, "Type 1024 Cover" and "Type 2035 Screw" might be included.

[1485] 4. The server creates a list of parts in JSON format and sends it back to the terminal. The data sent back will look like this:

[1486] {

[1487] "recommendations": ["Type 1024 cover", "Type 2035 screws"]

[1488] }

[1489] 5. The terminal displays the list of components received from the server in a user-friendly format. For example, it may display the following visual information:

[1490] The following parts were found:

[1491] Type 1024 cover

[1492] 2035 type screw

[1493] 6. The robot searches for the specified part, retrieves it, and delivers it to the user's desired location.

[1494] Specific example

[1495] For example, if a user enters "Area A-3, Type 1024 cover," the terminal sends this information to the server, which searches the parts database for parts such as "Type 1024 cover" and "Type 2035 screw," and returns a list. This allows the user to quickly obtain information on parts that match their needs, and the robot can retrieve the specified parts and deliver them to the required location.

[1496] Examples of prompts to input into a generative AI model:

[1497] Please enter the location of the part and the part you want:

[1498] "Area A-3, Type 1024 cover"

[1499] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[1500] Step 1:

[1501] The user enters the part location and desired specifications into the input fields on the terminal. The user specifies the "part location" and "desired specifications" using text boxes and dropdown menus displayed on the terminal. For example, they might enter "Area A-3" and "Type 1024 Cover". This information is stored as a variable within the terminal.

[1502] Step 2:

[1503] The terminal converts the collected user input into JSON format. It converts the user-entered part locations and desired conditions into key-value pairs, generating structured JSON data. The generated JSON will look like this:

[1504] {

[1505] "location": "Area A-3",

[1506] "preferences": "Type 1024 cover"

[1507] }

[1508] Step 3:

[1509] The device sends the generated JSON data to the server. In doing so, the device uses an HTTP POST request to send the data to the server's API endpoint. The server receives this request and interprets the data.

[1510] Step 4:

[1511] The server parses the received JSON data and searches the parts database. The server queries the database using the conditions "Area A-3" and "Type 1024 Cover" and extracts the relevant parts information. The parts database includes the location, category, and name of each part.

[1512] Step 5:

[1513] The server structures the list of matching parts obtained as search results in JSON format. For example, if the search results match "Type 1024 cover" and "Type 2035 screw," it generates JSON data like the following:

[1514] {

[1515] "recommendations": ["Type 1024 cover", "Type 2035 screws"]

[1516] }

[1517] Step 6:

[1518] The server sends structured JSON data back to the device. In this process, the JSON data is sent as an HTTP response. The device receives this response and retrieves the data.

[1519] Step 7:

[1520] The terminal parses the received JSON data and displays it visually to the user. The terminal's UI provides the user with the relevant component information in list or card format. For example, the display might look like this:

[1521] The following parts were found:

[1522] Type 1024 cover

[1523] 2035 type screw

[1524] Step 8:

[1525] The robot searches for and retrieves the specified part based on the part information transmitted from the server. The robot control system autonomously moves and acquires the part based on the part's location and the name of the specified part.

[1526] Step 9:

[1527] The robot delivers the extracted parts to a specific location. Finally, the robot control system operates to deliver the parts to the designated destination and issues a notification when delivery is complete.

[1528] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[1529] This system is designed to allow users to efficiently and accurately obtain information that matches their preferences when searching for tourist destinations. Furthermore, it incorporates an emotion engine to recognize the user's emotional state and recommend the most suitable tourist destinations based on that state.

[1530] Key components of the system

[1531] 1. User Input Interface

[1532] Users enter their location and desired conditions via their device (e.g., smartphone, computer). The input interface is provided in a simple and user-friendly form format. For example, "location" and "desired conditions" could be selected using text boxes or dropdown menus.

[1533] 2. Information transmission by terminals

[1534] The terminal converts the information entered by the user into a structured data format such as JSON and sends it to the server via the internet.

[1535] 3. Server-based analysis of user sentiment

[1536] The server has an emotion engine built in that analyzes user input, voice data, and image data to estimate the user's emotional state. For example, it analyzes the emotion of text entered by the user using natural language processing technology.

[1537] 4. The server searches the tourist destination database.

[1538] The server searches the tourist destination database based on the received location and desired conditions, as well as the analyzed user's emotional state. The database holds basic information and attribute information for each tourist destination, and the server creates a list of tourist destinations that match the specified conditions.

[1539] 5. The server formats the search results and returns them.

[1540] The server formats appropriate tourist destination information and sends it back to the user's terminal. This information consists of a list of optimal tourist destinations based on the user's location, preferences, and emotional state.

[1541] 6. Information display via terminal

[1542] The terminal receives a list of tourist destinations sent back from the server and displays it visually to the user. The display format used is one that is easy for the user to understand intuitively, such as a list view or a card format.

[1543] Explanation of the program's processing

[1544] The user enters their location and desired conditions.

[1545] The user enters their location (e.g., Tokyo) and desired conditions (e.g., day trip, nature-rich location) into the terminal's input fields. The terminal then retrieves this information.

[1546] The terminal sends input to the server.

[1547] The terminal converts the user's input data into a structured data format such as JSON and sends it to the server. The server receives the request and begins parsing.

[1548] The server analyzes the user's input and emotions.

[1549] The server parses the received JSON data to obtain the user's location and desired conditions. Simultaneously, the emotion engine analyzes the user's input to estimate their emotional state. For example, it might read from the input text that the user wants to "relax" or "have an adventure."

[1550] The server searches the tourist destination database.

[1551] The server searches the tourist destination database based on the user's location, desired conditions, and analyzed emotional state. It then lists tourist destinations that match the conditions and constructs that list.

[1552] The server returns the results to the user.

[1553] The server formats the tourist destination information obtained as search results and returns it to the terminal in a structured format (e.g., JSON). The returned data includes a list of tourist destinations that best suit the user's location, preferences, and emotional state.

[1554] The terminal receives data from the server.

[1555] The terminal receives the data returned from the server and verifies that it is in the correct format. It then parses the data and prepares it for display.

[1556] The device displays the results to the user.

[1557] The terminal visualizes the received data and displays it in a user-friendly format (e.g., list view or card view). Users can then view suggested tourist destination information from the server through the terminal's screen.

[1558] Specific example

[1559] For example, if a user enters "lives in Tokyo, day trip, nature-rich location," the device sends this information to the server. The server searches a tourist destination database and retrieves results such as "Mount Takao," "Lake Kawaguchi," "Okutama," and "Nikko." At the same time, if the emotion engine estimates the user's emotional state as "wanting to relax," it rearranges the search results to match that emotion and presents "Mount Takao" as the most recommended tourist destination.

[1560] The above describes an example of a specific embodiment of the present invention. This system allows users to efficiently find tourist destinations that match their emotional state and desired conditions, thereby enabling them to have a more fulfilling travel experience.

[1561] The following describes the processing flow.

[1562] Step 1:

[1563] The user enters their location and desired conditions.

[1564] The user enters their location (e.g., Tokyo) and desired conditions (e.g., day trip, nature-rich location) into the device's interface. The device then retrieves this information.

[1565] Step 2:

[1566] The terminal sends the input to the server.

[1567] The terminal converts the user's input data into a structured data format such as JSON and sends it to the server over the internet. The server receives the request and prepares to begin analysis.

[1568] Step 3:

[1569] The server recognizes the user's emotions.

[1570] An emotion engine embedded in the server analyzes user input (e.g., text), audio data, and image data to estimate the user's emotional state. For example, natural language processing techniques are used to determine what emotional state the user is in (e.g., want to relax, want to go on an adventure).

[1571] Step 4:

[1572] The server analyzes the user's input information.

[1573] The server parses the received JSON data to obtain the user's location and desired conditions. This information is then used for the next tourist destination search.

[1574] Step 5:

[1575] The server searches the tourist destination database.

[1576] The server searches a tourist destination database based on the user's location, desired conditions, and analyzed emotional state. For example, it might find tourist destinations that match the conditions "Tokyo," "day trip," "place with abundant nature," and "want to relax." The server then generates a list of tourist destinations that meet these conditions.

[1577] Step 6:

[1578] The server formats the search results and returns them to the user.

[1579] The server formats the tourist destination information obtained as search results into a structured format such as JSON and sends it back to the terminal. The returned data includes a list of tourist destinations that best suit the user's location, preferences, and emotional state.

[1580] Step 7:

[1581] The terminal receives data from the server.

[1582] The terminal receives data returned from the server and verifies that the data is in the correct format. It then parses the received data and prepares it for display.

[1583] Step 8:

[1584] The device displays tourist destination results to the user.

[1585] The device visualizes the received data and displays it in a user-friendly format (e.g., list view, card view). For example, it could display a list of tourist destinations prioritized based on the user's emotional state. The user can then view the suggested tourist destination information from the server through the device's screen.

[1586] Through the steps described above, users can efficiently obtain tourist destination information that matches their desired conditions and emotional state, and easily decide on their next travel destination.

[1587] (Example 2)

[1588] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1589] While current tourist information systems can provide tourist destination information based on the user's location and preferences, they cannot format the information to take into account the user's emotional state. Therefore, it is difficult to provide the most suitable tourist destinations that match the user's specific situation and feelings. Furthermore, the input of user preferences and the display of results can sometimes be unintuitive, leading to usability issues.

[1590] The identification processing by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for the user to input location and desired conditions, means for transmitting the location and desired conditions information entered by the user to the server, means for searching a tourist destination database based on the location and desired conditions and obtaining the corresponding tourist destination, means for returning the obtained tourist destination information to the user, means including an emotion engine that analyzes the user's input and estimates their emotional state, means for sorting the tourist destination information based on the emotional state, and means for formatting the tourist destination information in a visually displayable format. This makes it possible to suggest tourist destinations that take the user's emotional state into consideration.

[1591] "Location" refers to the user's current geographical location or place of residence.

[1592] "Desired conditions" refer to the requirements and characteristics that users look for in a tourist destination they want to visit (e.g., day trip, place with abundant nature, etc.).

[1593] A "server" refers to a computer system that receives and processes data sent by a user.

[1594] A "tourist destination database" refers to a data storage system that stores information about tourist destinations (e.g., location, category, name of the tourist destination, etc.).

[1595] An "emotion engine" refers to software or algorithms that analyze user input and estimate their emotional state.

[1596] "User input" refers to data provided by the user via their device (e.g., location, desired conditions, text, etc.).

[1597] "Emotional state" refers to the psychological state that a user expresses through their input (e.g., wanting to relax, wanting to go on an adventure, etc.).

[1598] "Formatting" refers to the process of converting data into a visually easy-to-understand format (e.g., list display, card format, etc.).

[1599] This invention is a system designed to allow users to efficiently and accurately obtain information that matches their preferences when searching for tourist destinations. Furthermore, it incorporates an emotion engine to recognize the user's emotional state and recommend the most suitable tourist destinations based on that state.

[1600] The specific components and procedures for implementing this system are as follows:

[1601] User input interface

[1602] Users enter their location and desired conditions via their device (e.g., smartphone, computer). The input interface is provided in a simple and user-friendly form format. For example, "location" and "desired conditions" could be selected using text boxes or dropdown menus.

[1603] Information transmission by terminal

[1604] The terminal converts the information entered by the user into a structured data format such as JSON and sends it to the server via the internet.

[1605] Server-based user sentiment analysis

[1606] The server has an emotion engine built in that analyzes user input, voice data, and image data to estimate the user's emotional state. For example, it analyzes the emotion of text entered by the user using natural language processing (NLP) tools.

[1607] The server searches the tourist destination database.

[1608] The server searches the tourist destination database based on the received location and desired conditions, as well as the analyzed user's emotional state. The database contains basic information and attribute information for each tourist destination, and the server creates a list of tourist destinations that match the specified conditions.

[1609] The server formats the search results and returns them.

[1610] The server formats appropriate tourist destination information and sends it back to the user's terminal. This information consists of a list of optimal tourist destinations based on the user's location, preferences, and emotional state.

[1611] Information display via terminal

[1612] The terminal receives a list of tourist destinations sent back from the server and displays it visually to the user. The display format used is one that is easy for the user to understand intuitively, such as a list view or a card format.

[1613] For example, if a user enters "Tokyo resident, day trip, nature-rich location" into their smartphone, the device sends this information to the server. The server searches a tourist destination database and retrieves results such as "Mount Takao," "Lake Kawaguchi," "Okutama," and "Nikko." Simultaneously, if the emotion engine estimates the user's emotional state as "wanting to relax," it rearranges the search results to match that emotion and presents "Mount Takao" as the most recommended tourist destination. In this way, the system efficiently suggests tourist destinations that are best suited to the user's emotions and desired conditions.

[1614] Example of a prompt

[1615] Examples of prompts for a generative AI model are as follows:

[1616] "A user enters 'Resident of Tokyo, day trip, nature-rich location,' and the emotion engine analyzes this as 'Want to relax.' Please describe in detail the processing steps of the system that suggests the most suitable tourist destination to the user based on this information."

[1617] This system allows users to efficiently find tourist destinations that match their emotional state and desired conditions, resulting in a more fulfilling travel experience.

[1618] The flow of the specific processing in Example 2 will be explained using Figure 13.

[1619] Step 1: The user enters the data.

[1620] The user enters their location (e.g., Tokyo) and desired conditions (e.g., day trip, nature-rich location) into the terminal's input fields. Text boxes or dropdown menus are used for input. The terminal receives the user's input and stores it internally. The input in this step is the user's location and desired conditions, and the output is the location and desired conditions data stored within the terminal.

[1621] Step 2: The terminal sends the input data.

[1622] The terminal converts the location and desired conditions entered by the user into JSON format. Next, it sends this JSON data to the server via the internet. An example of the converted JSON data is as follows:

[1623] json

[1624] {

[1625] "location": "Tokyo",

[1626] "preferences": ["day trip", "place with abundant nature"]

[1627] }

[1628] The input for this step is the stored location and desired conditions data, and the output is JSON format data that will be sent to the server.

[1629] Step 3: The server analyzes the data.

[1630] The server parses the received JSON data and extracts the user's location (e.g., Tokyo) and desired conditions (e.g., day trip, nature-rich location). Simultaneously, the emotion engine analyzes the user's input and estimates their emotional state. For example, if the text "I want to relax" is entered, an NLP tool is used to analyze it and extract this emotional state. The input for this step is the JSON data sent to the server, and the output is the extracted location, desired conditions, and emotional state data.

[1631] Step 4: The server searches the database.

[1632] The server searches a tourist destination database based on the extracted location (e.g., Tokyo), desired conditions (e.g., day trip, nature-rich location), and emotional state (e.g., "I want to relax"). The database contains basic and attribute information about tourist destinations. The server lists tourist destinations that match the conditions and creates a list. The input for this step is the extracted location, desired conditions, and emotional state data, and the output is the list of tourist destinations obtained as a search result.

[1633] Step 5: The server formats the results and sends them back.

[1634] The server uses the acquired tourist destination information to create a list sorted based on emotional states. Next, it reconstructs this list into JSON format and sends it back to the terminal. An example of the formatted JSON data is as follows:

[1635] json

[1636] {

[1637] "recommendations": [

[1638] {"place": "Mount Takao", "description": "A nature-rich place where you can enjoy mountain climbing"},

[1639] {"place": "Kawaguchiko", "description": "A relaxing lakeside view"}

[1640] {"place": "Okutama", "description": "A place rich in nature where you can enjoy hiking"}

[1641] ]

[1642] }

[1643] The input for this step is a list of tourist destinations obtained as search results, and the output is formatted tourist destination information in JSON format.

[1644] Step 6: The device receives and displays the data.

[1645] The terminal receives the JSON data returned from the server and verifies that its format is correct. Next, it parses the data and displays it in a user-friendly format (e.g., list view or card view). The input for this step is the formatted tourist destination information JSON data returned from the server, and the output is a visual list of tourist destinations displayed to the user.

[1646] Through the above processing steps, users can efficiently find tourist destinations that best suit their emotional state and desired conditions.

[1647] (Application Example 2)

[1648] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1649] Conventional tourist destination information systems provide tourist destination information selected based solely on the location and desired conditions entered by the user. Therefore, they may not adequately suggest the most suitable tourist destinations based on the user's emotional state. For this reason, there is a need to provide customized tourist destination information that reflects the user's current mood and emotions.

[1650] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[1651] In this invention, the server includes means for the user to input location and desired conditions, means for analyzing the user's emotional state, means for searching a tourist destination database based on the location, desired conditions, and emotional state, and obtaining the relevant tourist destinations, and means for prioritizing the obtained tourist destination information and returning it to the user. This makes it possible to provide optimal tourist destination information according to the user's emotional state.

[1652] "Location" refers to information indicating the user's current location or the places they wish to visit.

[1653] "Desired conditions" refer to the specific conditions or requirements that users seek when selecting a tourist destination.

[1654] A "server" is a part of a computer system that receives and processes data sent by a user.

[1655] A "tourist destination database" is a database that stores various information about tourist destinations.

[1656] "Emotional state" refers to information that indicates the user's current mood and emotional state.

[1657] "Prioritization" is the process of determining the display order of acquired tourist destination information based on the user's emotional state and preferences.

[1658] A "terminal" is a device used by users to input their location and desired conditions, and to exchange information with the server.

[1659] This invention provides a system for tourist guides primarily used in physical stores. Users can obtain tourist information via their smartphones and find tourist destinations that best suit their emotional state.

[1660] First, the user enters their location and desired conditions into their smartphone. This information is converted to JSON format and sent to the server. The smartphone then configures the user interface using common input forms and dropdown menus.

[1661] The server analyzes the received user data and uses an emotion engine to estimate the user's emotional state. For example, it analyzes the text and emojis entered by the user and uses natural language processing techniques to read their emotions. The emotion engine can utilize external emotion recognition libraries. We will explain this using a library called EmotionEngine as an example.

[1662] Next, the server searches a tourist destination database. This database contains information such as location, category, and tourist destination name. The database search is performed based on the user's location and preferences, as well as their estimated emotional state. This retrieves tourist destination information that is best suited to the user's emotional state.

[1663] Once the target tourist destination information is retrieved, the server organizes it and creates a prioritized list. This list is then sorted considering the user's emotional state. For example, if the user's emotional state is estimated to be "wanting to relax," tourist destinations that promote relaxation will be displayed preferentially.

[1664] Finally, the server sends the organized tourist information back to the smartphone. The smartphone visually displays the received data and provides it to the user. The display format uses an intuitive and easy-to-understand format, such as a list view or a card view.

[1665] Hardware and software to be used

[1666] Hardware: Smartphone

[1667] Software: EmotionEngine (emotion recognition library), TouristSpotDatabase (tourist destination database), Flask (web framework)

[1668] Specific example

[1669] For example, consider a scenario where a user uses an application in a store in Tokyo and enters "I live in Tokyo, and I'm looking for a relaxing day trip destination." The user then enters the emoji "😊 (relaxed)." Based on this information, the server suggests tourist destinations such as Mount Takao, Lake Kawaguchi, and Okutama.

[1670] Prompt text to input to the generative AI model

[1671] "I live in Tokyo and am looking for a day trip. Please recommend a relaxing place surrounded by nature. My desired emotion is '😊 (relaxed)'."

[1672] Thus, the present invention provides customized tourist destination information according to the user's emotional state, supporting a more fulfilling travel experience.

[1673] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[1674] Step 1:

[1675] The user enters their location and desired conditions on their smartphone. The user enters their location (e.g., Tokyo) and desired sightseeing conditions (e.g., day trip, nature-rich location) into the input fields, and also enters text or emojis to express their feelings. The entered data (location, desired conditions, feelings) is then imported into the device.

[1676] Step 2:

[1677] The terminal converts the data entered by the user into JSON format and sends it to the server. The terminal's processing includes converting the user's input data into the correct format and sending it to the server via an HTTP request.

[1678] Step 3:

[1679] The server analyzes the data received from the terminal. Since the received data is in JSON format, the server analyzes it to extract location, desired conditions, and emotional information. Formatted data (location, desired conditions, emotional state) is obtained.

[1680] Step 4:

[1681] The server's emotion engine analyzes the user's emotional state. The server passes the received emotional information to the EmotionEngine library for analysis. The emotion engine uses natural language processing techniques to estimate the user's emotion, such as "I want to relax." The emotional state is obtained as a result of the analysis.

[1682] Step 5:

[1683] The server searches the tourist destination database based on location, desired conditions, and analyzed sentiment state. The tourist destination database contains various tourist destination information, and the server executes database queries to extract tourist destinations that match the conditions. The extracted data includes location, category, and tourist destination name.

[1684] Step 6:

[1685] The server prioritizes tourist destination information based on search results, taking into account the user's emotional state. The server applies an algorithm tailored to the emotional state, rearranging the retrieved tourist destinations in an order that best suits the user's emotions. A prioritized list of tourist destinations is then generated.

[1686] Step 7:

[1687] The server formats the prioritized tourist destination information into JSON format and sends it back to the terminal. The formatting process performed by the server includes the function of formatting the tourist destination information in an appropriate format and sending it back to the terminal as an HTTP response.

[1688] Step 8:

[1689] The terminal receives data sent back from the server and displays it visually. The terminal analyzes the received data and displays tourist destination information to the user in an intuitively understandable list or card format. This allows the user to find tourist destination information that best suits their emotional state.

[1690] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[1691] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1692] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.

[1693] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1694] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.

[1695] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.

[1696] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.

[1697] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.

[1698] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."

[1699] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.

[1700] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.

[1701] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.

[1702] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[1703] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[1704] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[1705] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[1706] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[1707] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[1708] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[1709] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[1710] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted to be incorporated by reference.

[1711] The following is further disclosed regarding the embodiments described above.

[1712] (Claim 1)

[1713] A means for the user to input location and desired conditions,

[1714] A means for transmitting the location and desired conditions information entered by the user to the server,

[1715] A means for searching a tourist destination database based on the aforementioned location and desired conditions and obtaining the corresponding tourist destination,

[1716] A system including means for returning the acquired tourist destination information to the user.

[1717] (Claim 2)

[1718] The system according to claim 1, characterized in that the tourist destination database has a data structure that includes at least location, category, and tourist destination name.

[1719] (Claim 3)

[1720] The system according to claim 1, characterized in that the tourist destination information is formatted in a way that can be visually displayed on the user's terminal.

[1721] "Example 1"

[1722] (Claim 1)

[1723] A means for the user to input location and desired conditions,

[1724] A means for transmitting the location and desired conditions information entered by the user to a server via a terminal,

[1725] The server searches a tourist destination database based on the location and desired conditions received, and obtains the corresponding tourist destination.

[1726] A means for returning the acquired tourist destination information to the user's terminal in a structured format,

[1727] Means for visually displaying tourist destination information received by the terminal to the user.

[1728] A system that includes this.

[1729] (Claim 2)

[1730] The system according to claim 1, characterized in that the tourist destination database has a data structure that includes at least location, category, and tourist destination name.

[1731] (Claim 3)

[1732] The system according to claim 1, characterized in that the tourist destination information is formatted in a way that can be visually displayed on the user's terminal.

[1733] "Application Example 1"

[1734] (Claim 1)

[1735] A means for the user to input the location of the parts and desired conditions,

[1736] A means for transmitting the information of the part location and desired conditions entered by the user to the server,

[1737] A means for searching a parts database based on the aforementioned parts location and desired conditions, and obtaining the corresponding parts,

[1738] A means for returning the acquired parts information to the user,

[1739] A system including robot control means for delivering the acquired parts to a specific location.

[1740] (Claim 2)

[1741] The system according to claim 1, characterized in that the parts database has a data structure that includes at least location, category, and part name.

[1742] (Claim 3)

[1743] The system according to claim 1, characterized in that the component information is formatted in a way that can be visually displayed on the user's terminal.

[1744] "Example 2 of combining an emotion engine"

[1745] (Claim 1)

[1746] A means for the user to input location and desired conditions,

[1747] A means for transmitting the location and desired conditions information entered by the user to the server,

[1748] A means for searching a tourist destination database based on the aforementioned location and desired conditions and obtaining the corresponding tourist destination,

[1749] A means for returning the acquired tourist destination information to the user,

[1750] Means including an emotion engine that analyzes the user's input and estimates their emotional state,

[1751] A means for sorting tourist destination information based on the emotional state,

[1752] A system including means for formatting the aforementioned tourist destination information in a visually displayable format.

[1753] (Claim 2)

[1754] The system according to claim 1, characterized in that the tourist destination database has a data structure that includes at least location, category, and tourist destination name.

[1755] (Claim 3)

[1756] The system according to claim 1, characterized in that the tourist destination information is formatted in a way that can be visually displayed on the user's terminal.

[1757] "Application example 2 of combining emotional engines"

[1758] (Claim 1)

[1759] A means for the user to input location and desired conditions,

[1760] A means for transmitting the location and desired conditions information entered by the user to the server,

[1761] A means for searching a tourist destination database based on the aforementioned location and desired conditions and obtaining the corresponding tourist destination,

[1762] A means of analyzing the user's emotional state,

[1763] A means for prioritizing tourist destination information obtained based on the aforementioned emotional state,

[1764] A system including means for returning the acquired tourist destination information to the user.

[1765] (Claim 2)

[1766] The system according to claim 1, characterized in that the tourist destination database has a data structure that includes at least location, category, and tourist destination name.

[1767] (Claim 3)

[1768] The system according to claim 1, characterized in that the tourist destination information is formatted in a way that can be visually displayed on the user's terminal. [Explanation of symbols]

[1769] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>

Claims

1. A means for the user to input location and desired conditions, A means for transmitting the location and desired conditions information entered by the user to the server, A means for searching a tourist destination database based on the aforementioned location and desired conditions and obtaining the corresponding tourist destination, A system including means for returning the acquired tourist destination information to the user.

2. The system according to claim 1, characterized in that the tourist destination database has a data structure that includes at least location, category, and tourist destination name.

3. The system according to claim 1, characterized in that the tourist destination information is formatted in a way that can be visually displayed on the user's terminal.

Images