system

Abstract

We provide the system. [Solution] A generation method for generating customized tourist routes based on user attribute information, A display means that displays a tourist route generated by the generation means on a user terminal, A means of acquiring information displayed using augmented reality technology in a tourist destination, An update means for updating the user's visit history based on the information obtained by the acquisition means, A system including a means for providing new experience information based on the aforementioned update means.

Description

Technical Field

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a persona chatbot control method performed by at least one processor, including steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In a conventional tourism guidance system, it is difficult to provide an individual tourism experience that fully considers the individual interests and preferences of tourists, and there is also a problem that the willingness to revisit a tourist destination once visited decreases. In particular, existing tours and stamp rally events lose their freshness once experienced, which has been a cause for reducing the willingness of users to revisit. The purpose of this invention is to solve these problems and provide users with a fresh and individualized tourism experience every time.

Means for Solving the Problems

[0005] This invention includes a generation means for generating customized sightseeing routes based on user attribute information, and a display means for displaying the generated sightseeing route on the user's terminal. Furthermore, by providing an acquisition means for acquiring the displayed information using augmented reality technology at the tourist destination, updating the user's visit history, and providing a provision means for providing new experience information based on that update history, it is possible to provide the user with a fresh and personalized sightseeing experience. In addition, by utilizing a feedback means to collect feedback information from the user and reflect it in the generation of subsequent sightseeing routes, continuous improvement of the user experience is achieved.

[0006] "User attribute information" refers to individual data about users of the tourist information system, such as their interests, preferences, age, and past visit history.

[0007] A "generation method" is a component that has the function of creating personalized tourist routes based on the user's attribute information.

[0008] "Display means" refers to an interface for visually providing the generated tourist route to the user's terminal.

[0009] "Acquisition means" refers to a component that has the function of collecting information displayed using augmented reality technology in a tourist destination.

[0010] An "update method" is a function that processes data to overwrite a user's visit history with new information based on the acquired data.

[0011] "Means of provision" refers to a function that provides users with new experience information based on their updated visit history.

[0012] A "feedback mechanism" is a function that collects opinions and evaluations from users regarding their experience and uses them to improve the experience in the future.

[0013] "Control means" refers to a function that manages the information presented using augmented reality technology so that it changes based on the user's visit count. [Brief explanation of the drawing]

[0014] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] This is a conceptual diagram showing an example of the essential functions of a data processing device and a smart device according to the first embodiment. [Figure 3] This is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] This is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] This is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] This is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] This is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] This is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] This shows an emotion map where multiple emotions are mapped. [Figure 10] This shows an emotion map where multiple emotions are mapped. [Figure 11] This is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] This is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] This is a sequence diagram showing the processing flow of the data processing system in Example 2, which incorporates an emotion engine. [Figure 14]It is a sequence diagram showing the processing flow of a data processing system in Application Example 2 when a sentiment engine is combined.

Embodiments for Carrying Out the Invention

[0015] Hereinafter, an example of an embodiment of a system according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0016] First, the terms used in the following description will be explained.

[0017] In the following embodiments, a numbered processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Also, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), and the like.

[0018] In the following embodiments, a numbered RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor.

[0019] In the following embodiments, a numbered storage is one or more non-volatile storage devices that store various programs and various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes, etc.

[0020] In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).

[0021] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0022] [First Embodiment]

[0023] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0024] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0025] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0026] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0027] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0028] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0029] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0030] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0031] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0032] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0033] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0034] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0035] This invention is a tourist information system that personalizes the tourist experience based on the individual attribute information of the user. This system is implemented using a terminal owned by the user and a program that runs on the server side.

[0036] First, the server receives user attribute information and generates a user profile. This profile includes information about the user's interests and previously visited tourist destinations. Next, the server uses a generation method to generate a tourist route based on the user profile. The generated route is customized to the user's hobbies and preferences and includes suggestions for tourist destinations and information on special events.

[0037] The generated sightseeing route is then displayed on the device. The user visits the tourist destinations following this route. At the tourist destinations, the device uses augmented reality technology to retrieve character portraits and other display information. This allows the user to experience additional information and missions at the location.

[0038] The collected information is sent to the server and updated in the database as the user's visit history. This ensures that when a user revisits the same tourist destination, they will be provided with new information and experiences.

[0039] The system also receives user feedback and analyzes it on the server side. This feedback information is used to generate future sightseeing routes, providing an even more satisfying user experience.

[0040] As an example, consider a scenario where a user selects a tour themed around "historical buildings." Based on the user's profile, the server selects historical sites and displays special guide information and quizzes about local history on the user's device. After the visit, the user's feedback is used to provide new quizzes and in-depth information during their next visit.

[0041] Thus, the present invention aims to provide users with a fresh and personalized tourism experience and encourage them to revisit tourist destinations.

[0042] The following describes the processing flow.

[0043] Step 1:

[0044] Users log in to the system using their device and select their preferred travel themes and desired destinations. The device then sends this information to the server.

[0045] Step 2:

[0046] The server verifies the user profile based on the user's attribute information and selected theme, and generates a personalized sightseeing route using a generation method. The generated route includes recommended sightseeing spots and related events.

[0047] Step 3:

[0048] The server sends the generated tourist route information to the terminal. The terminal displays the received route to the user, allowing them to view the details.

[0049] Step 4:

[0050] The user begins sightseeing by following the route displayed on their device. At the tourist destinations they visit, the device uses augmented reality technology to scan installed character illustrations and AR content.

[0051] Step 5:

[0052] The device sends the acquired AR information to the server. The server records the user's visit history in a database and generates new experiences and missions based on that information.

[0053] Step 6:

[0054] The server sends newly generated experience information to the terminal, which then displays it to the user. The user then experiences the presented new missions and information.

[0055] Step 7:

[0056] After the tour ends, the user enters feedback about the experience on their device. The device then sends the feedback to the server.

[0057] Step 8:

[0058] The server analyzes the received feedback and stores it in a database. This feedback is then used to generate future sightseeing routes, improving the system to provide a more enriching experience.

[0059] (Example 1)

[0060] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0061] A challenge in tourist destinations is that user experiences do not adequately cater to individual interests and preferences, resulting in a lack of motivation for visitors to revisit destinations they have already visited. Furthermore, conventional systems do not fully utilize user feedback, making it difficult to provide personalized experiences.

[0062] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0063] In this invention, the server includes an information processing device that generates a customized sightseeing route based on the user's attribute information, means for generating a sightseeing route based on the user profile using a generation AI model and processing using prompt statements, and an information gathering device that collects user feedback information and reflects it in the generation of the sightseeing route. As a result, users are provided with experiences that match their interests and preferences, which increases their motivation to revisit.

[0064] "User attribute information" refers to information linked to an individual, such as a user's interests, preferences, and past browsing history.

[0065] A "tourist route" refers to information that suggests the order and path of visiting tourist destinations based on the user's attribute information.

[0066] An "information processing device" is a device that processes data based on user attribute information and has the function of generating customized tourist routes.

[0067] A "display device" is a device that visually presents tourist routes generated by an information processing device to the user.

[0068] A "data acquisition device" is a device that has the function of acquiring local information using virtual reality technology in tourist destinations.

[0069] An "update device" is a device that has the function of updating the user's visit history in a database based on acquired information.

[0070] A "providing device" is a device that has the function of providing users with new experience information based on their latest visit history.

[0071] An "information gathering device" is a device that receives feedback information from users and uses it to improve future service provision.

[0072] A "control device" is a device that dynamically adjusts the content of information provided through virtual reality technology according to the number of times a user visits.

[0073] A "generative AI model" is an artificial intelligence system that includes algorithms for suggesting optimal tourist routes based on user profiles.

[0074] A "prompt message" is a text-based instruction that gives a generative AI model a command to initiate the generation of specific information.

[0075] This invention is a tourist information system designed to customize the tourist experience based on the user's individual interests and preferences, thereby encouraging repeat visits. The system is implemented using a server and a terminal held by the user.

[0076] The server first receives attribute information sent from the user's device. This information includes the user's interests and past visit history. Next, the server uses a generative AI model to generate the optimal sightseeing route based on the received data. At this stage, prompts such as "If the user is interested in historical buildings, please generate a sightseeing route based on their interests" are used.

[0077] The generated sightseeing route is displayed on the user's device, and the user visits the tourist destinations according to it. Upon arrival at a tourist destination, the device uses augmented reality technology to present local information. This is achieved by using the device's camera and GPS functions to provide the user with special guide information and interactive quizzes.

[0078] After a user visits a location, the terminal sends information acquired from that location to the server, updating the user's visit history. This history data forms the basis for providing new experience information during future visits.

[0079] Furthermore, users can input feedback on their devices after their sightseeing experience. The server collects and analyzes this feedback and uses it to generate future sightseeing routes.

[0080] For example, if a user chooses castle touring as their theme and has previously visited several castles, the server will use that information to suggest a route that includes new castles and provide detailed historical background information about those specific castles. Through this process, users can deepen their interest and gain opportunities for further learning.

[0081] Thus, the system has the capability to continuously provide personalized tourism experiences that users desire.

[0082] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0083] Step 1:

[0084] The server receives attribute information transmitted from the user's terminal. This attribute information includes the user's interests, preferences, and past browsing history. The server analyzes this data and generates a user profile. This profile is output as a summarized version of the data indicating the user's specific areas of interest.

[0085] Step 2:

[0086] The server uses a generative AI model to generate sightseeing routes based on the user profile. This process takes prompts such as "If the user is interested in historical buildings, generate a sightseeing route based on their interests" as input. Based on these prompts, the AI ​​model selects the most suitable tourist destinations and outputs a customized route plan.

[0087] Step 3:

[0088] The user's device displays a sightseeing route received from the server. The device's input is the generated sightseeing route, and the output includes a map, a visit order, and detailed information about each sightseeing spot. This output allows the user to plan their trip according to the suggested route.

[0089] Step 4:

[0090] When a user visits a tourist destination, the device uses augmented reality technology to present information. The device receives GPS and camera data as input and displays virtual information about the local culture and history as output. This output includes visual and interactive elements to complement the user's experience.

[0091] Step 5:

[0092] After the user finishes sightseeing, the device sends the acquired information to the server. The input is data collected during the visit, and the server uses this data to update the user's visit history. This process outputs information that will provide a new experience on the next visit.

[0093] Step 6:

[0094] Users input feedback about their sightseeing experience on their device. The device sends this feedback to a server, which analyzes it. The analysis results are then used to generate future sightseeing routes, resulting in more customized routes. The output includes suggestions that better match the user's preferences.

[0095] (Application Example 1)

[0096] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0097] Modern consumers seek personalized shopping experiences that cater to diverse tastes and needs. However, traditional brick-and-mortar stores offer a uniform product display, making it difficult to provide flexible product guidance and purchasing experiences tailored to individual consumer preferences. Furthermore, the lack of mechanisms to immediately provide detailed product information within stores hinders the rapid progress of consumer purchasing decisions.

[0098] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0099] In this invention, the server includes a generation means for generating a customized product route based on user attribute information, a display means for displaying the product route generated by the generation means on a user terminal, and an acquisition means for acquiring information presented in a physical store using augmented reality technology. This enables product guidance tailored to the user's individual preferences and the provision of real-time product information within the store.

[0100] "User attribute information" refers to individual users' interests, purchase history, preferences, and related personal data.

[0101] A "product route" refers to an effective in-store product search path that is personalized based on a specific user profile.

[0102] "Generation means" refers to a system or process for customizing specific routes or information based on user attribute information.

[0103] "Display means" refers to digital or physical display devices or interfaces used to present information or routes generated on a user terminal.

[0104] "Acquisition means" refers to technologies and devices that use augmented reality technology to collect information presented within a physical store and provide it to the user's terminal.

[0105] "Update means" refers to the process or system used to keep a user's shopping history up-to-date based on information obtained through acquisition means.

[0106] "Means of delivery" refers to methods and devices for presenting new product information and experiences to users based on updated user data.

[0107] To implement this invention, it is necessary to build a system that generates product routes based on the user's individual attribute information and presents them to the terminal. This system is designed to allow users to enjoy a customized shopping experience within the store.

[0108] The server receives user attribute information and generates a user profile based on that information. Based on this user profile, the server generates a product route. The generated product route includes products tailored to the user's preferences and special offers. The product information is displayed on the smartphone device using React Native.

[0109] Within the store, users can use augmented reality technology via their devices to obtain detailed product information. This utilizes the device's camera function and employs ARKit (iOS) or ARCore (Android®). This allows users to intuitively view product ingredient information and promotional details.

[0110] The acquired information is sent to the server and recorded in the database as the user's shopping history. This data is used to provide the user with more precise product recommendations on their next visit. Furthermore, the recommended products are updated regularly based on user feedback.

[0111] For example, if a user is interested in "organic food," the system will guide them to the relevant product section in the store and present information about how the products are grown and their nutritional content using augmented reality.

[0112] Examples of prompts to input into a generative AI model:

[0113] Create a program that takes user attribute information as input and generates personalized shopping routes and AR information. Include features to highlight eco-friendly products in physical stores and improve recommendations based on user feedback.

[0114] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0115] Step 1:

[0116] The server receives user attribute information, including the user's interests, past purchase history, and preferences. Based on this received data, a user profile is generated. This profile is a detailed record of the user's preferences and is used in the next step.

[0117] Step 2:

[0118] The server generates product routes based on the generated user profile. Using an AI algorithm, it calculates the optimal products and routes for the user from the data in the profile. The output is a specially customized product route, which is sent to the user's smartphone.

[0119] Step 3:

[0120] The device receives the product route sent from the server and displays it as a user interface using React Native. The user then follows the displayed product route to explore the store. This allows the user to obtain location information for products that match their interests.

[0121] Step 4:

[0122] Users scan specific products using their device's camera within a physical store. This operation is performed using augmented reality technology, with product information visually displayed via ARKit (iOS) or ARCore (Android). The input is the scanned product information, and the output is detailed information about that product.

[0123] Step 5:

[0124] The device sends the acquired product information to the server. The server uses this information to update the user's shopping history. This data processing makes it possible to provide a personalized experience for future purchases.

[0125] Step 6:

[0126] Users input feedback on product routes and suggestions into a terminal. This feedback is collected by the server and used to improve future product suggestions and route generation. The input is user feedback, and the output is improved product routes and suggestions.

[0127] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0128] This invention is a tourist information system that provides a customized tourist experience based on user attribute information, and also incorporates an emotion engine that recognizes the user's emotions. This system is operated through the cooperation of a user terminal and a server.

[0129] First, the server receives the user's basic attribute information, desired visiting area, and theme. Based on this information, the server designs and generates a specially customized sightseeing route using a generation method. The generated route reflects the user's interests and past visit history, and includes sightseeing spots and special events.

[0130] The generated sightseeing route is sent to the user's device, allowing the user to begin sightseeing according to that route. At the tourist destinations visited, the device scans AR content displayed using augmented reality technology to obtain various information.

[0131] This system also incorporates an emotion engine, which analyzes the user's emotions in real time from their facial expressions, voice tone, and input data. The analyzed emotion data is sent to a server, which then provides new information and missions tailored to the user's mood. For example, if the system detects that the user is enjoying themselves, it can suggest additional events or spots that might be of particular interest to them.

[0132] Furthermore, after the tour ends, user feedback is collected via the device and sent to the server. The feedback data and sentiment data are then used through the feedback system to improve individual experiences and are reflected in the design of future routes.

[0133] As a concrete example, consider a case where a user requests a trip themed around "nature." Based on the user's emotional data, the server provides additional information and missions related to the areas where the user felt moved or soothed during their visit. The goal of this process is to provide an optimal travel experience tailored to each individual user and to increase their desire to revisit the tourist destination.

[0134] The following describes the processing flow.

[0135] Step 1:

[0136] Users log in to the system using their device and select their preferred travel themes and regions they wish to visit. The device then sends this information to the server.

[0137] Step 2:

[0138] The server uses a generation mechanism to generate the optimal sightseeing route based on the received user information and attribute information including past visit data. The generated route includes sightseeing spots and event information tailored to the user's interests.

[0139] Step 3:

[0140] The server sends the generated sightseeing route to the device. The device displays this information to the user and prompts them to follow the suggested route.

[0141] Step 4:

[0142] When a user visits a tourist destination, they use a device to scan character panels and local AR content using augmented reality technology. The device then sends the acquired information to a server.

[0143] Step 5:

[0144] The server updates the user's visit history based on the acquired data. Furthermore, the emotion engine analyzes the user's emotions and sends them to the server.

[0145] Step 6:

[0146] The server considers emotional data and visit history to generate new experience information and missions, and delivers content to the device that matches the user's emotional state.

[0147] Step 7:

[0148] Users deepen their experience at tourist destinations based on the new information provided. After completing their sightseeing, they use their device to input feedback about their experience.

[0149] Step 8:

[0150] The device sends feedback to the server, which analyzes the received feedback and stores it in a database. This information is used to generate future sightseeing routes and further improve the user experience.

[0151] (Example 2)

[0152] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0153] Traditional tourist information systems have struggled to provide tourist experiences that fully reflect the individual interests and feelings of users. Furthermore, they lacked mechanisms to utilize user feedback and opinions after an experience for future experiences. As a result, there were limitations in increasing user satisfaction and the desire to return.

[0154] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0155] In this invention, the server includes a generation means for generating customized routes based on the user's personal information, an acquisition means for acquiring information presented using augmented reality technology in a specific area, and a suggestion means for analyzing the user's emotions and dynamically suggesting information based on the analysis results. This enables the provision of a tourism experience tailored to each individual user and real-time suggestions based on emotions.

[0156] "Personal information" refers to information that identifies a user and includes attribute data used to customize tourist routes.

[0157] The "generation method" is a system for creating customized tourist routes based on the user's personal information.

[0158] "Display means" refers to devices or technologies for visually outputting the generated tourist route to the user's communication device.

[0159] "Means of acquisition" refers to the function of collecting information presented using augmented reality technology in a specific area.

[0160] "Update methods" refer to the process of keeping a user's visit history up-to-date based on the acquired information.

[0161] "Means of provision" refers to methods for supplying users with new experience information based on updated visit history.

[0162] "Emotional analysis" is a technology that analyzes users' emotions and dynamically makes suggestions based on the results.

[0163] The "suggestion method" is a function that recommends the most suitable events and information during sightseeing based on the results of the user's sentiment analysis.

[0164] A "feedback method" is a technique for accumulating user evaluation information and using it to generate future tourist routes.

[0165] The "control mechanism" is a system that adjusts the information presented using augmented reality technology according to the number of times a user has visited the site.

[0166] The present invention's tourist information system is designed to provide a customized tourist experience that reflects the user's individual interests and feelings. This system operates primarily through communication between a server and a terminal, both of which play important roles.

[0167] First, the user inputs basic personal information, desired visiting areas, and themes through their device. The device then sends this data to the server. The server receives this data and uses a generative AI model to generate a personalized sightseeing route for each user. In this process, the server retrieves past visit history and related information from a large database and inputs prompts into the generative AI model. One example of such a prompt is, "Generate a customized sightseeing route based on the user's attribute information. The theme should be nature, and information related to the desired visiting area should be considered."

[0168] The generated route information is sent from the server to the terminal and displayed. The user then begins sightseeing according to this information, and at each destination, they can use the camera and microphone on the terminal to obtain diverse information in real time using content provided by augmented reality technology.

[0169] The device also features an emotion engine that analyzes the user's facial expressions and voice, and sends the resulting emotion data to a server. The server uses this data to dynamically suggest information and missions in order to provide the optimal sightseeing experience tailored to the user's emotions.

[0170] After completing their tour, users send feedback from their device to the server. This feedback is used to improve future experiences. Overall, the system aims to engage with users' emotions and provide an engaging experience in real time.

[0171] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0172] Step 1:

[0173] The user uses a device to enter personal information, desired visit area, and theme. The device then formats this information appropriately for transmission to the server and sends it as a data packet. Specific examples of information entered include name, age, and areas of interest.

[0174] Step 2:

[0175] The server uses a generation AI model based on the received user information to generate a customized sightseeing route. In this process, the server analyzes personal information, extracts relevant information from the database, and inputs prompt messages into the generation AI model. These prompt messages then output a sightseeing route optimized for the user.

[0176] Step 3:

[0177] The generated sightseeing route information is sent from the server to the terminal. The terminal displays this information to the user and prepares to launch the map application or guide function to begin sightseeing. The information output at this point is a list of specific sightseeing spots and routes.

[0178] Step 4:

[0179] Users utilize augmented reality (AR) technology by using the camera function on their device at the tourist destinations they visit. The device scans QR codes (registered trademarks) and AR markers displayed at the destination to provide detailed information and stories. The input data consists of images and marker information, which is then analyzed to display relevant content.

[0180] Step 5:

[0181] The device uses an emotion engine to analyze the user's facial expressions and voice tone in real time. The analyzed emotion data is sent to a server, which dynamically suggests appropriate events and additional information according to the user's emotional state. The input data consists of camera video and audio data, while the output information consists of recommended content and missions.

[0182] Step 6:

[0183] After completing their tour, users enter feedback on their experience into a terminal. The terminal sends the collected feedback data to a server. The server analyzes this data and uses it to improve future tour route generation. The input data consists of text comments and ratings, while the output information represents an improved route generation process.

[0184] (Application Example 2)

[0185] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".

[0186] In recent years, the tourism sector has seen a growing demand for personalized experiences tailored to individual users. However, conventional systems have struggled to provide services that reflect users' emotional changes and interests in real time. Furthermore, user visits tend to be fleeting, and there have been insufficient mechanisms to encourage repeat visits. Therefore, there is a need to develop effective tourism experiences that take user emotions into consideration, as well as methods to increase the desire for repeat visits.

[0187] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0188] In this invention, the server includes a generation means for generating customized sightseeing routes based on user attribute information, an acquisition means for acquiring information presented in the region using augmented reality technology, and an emotion response provision means for analyzing the user's facial expressions, voice, and input data using emotion analysis means and presenting information according to the emotion evaluation results. This makes it possible to provide a personalized experience based on the user's emotional changes and to present special information that arouses interest in real time. This can improve user satisfaction and increase the desire to revisit.

[0189] A "user" is an individual who uses this system to enjoy a tourism experience.

[0190] "Attribute information" refers to basic information about a user, as well as data indicating their preferences and interests.

[0191] A "tourist travel route" is a recommended route for sightseeing that is customized based on the user's attribute information and interests.

[0192] "Generating means" refers to a device or program that has the function of collecting and analyzing information to create routes or data for a specific purpose.

[0193] An "information processing device" is a device that processes digital data and presents information to the user.

[0194] Augmented reality technology is a technology that overlays digital information onto the real world environment.

[0195] "Acquisition means" refers to a device or program that has the function of receiving information from an external source.

[0196] "Past activity history" refers to a record of places a user has visited and activities they have undertaken in the past.

[0197] "Update means" refers to a device or program that has the function of modifying or adding to existing data based on newly acquired information.

[0198] "Emotional analysis means" refers to a device or program that has the function of processing emotional data in order to analyze and evaluate the emotions of a user.

[0199] "Emotional evaluation results" refer to the evaluation results of the user's emotional state derived from emotional analysis methods.

[0200] "Information" refers to knowledge and data provided in digital format.

[0201] "Special Offer Information" refers to data or offers of exceptional value that differ from the information that is normally provided.

[0202] This invention is a system for providing a user-optimized sightseeing experience based on user attribute information. The system operates when a user is sightseeing via a smart device, and a specific embodiment of this system is configured as follows.

[0203] The server retrieves the user's basic attribute information and interests from user input or previous data. This information is used to generate the most suitable sightseeing route for the user. The generated sightseeing route is then communicated to the user through an information processing device.

[0204] During the visit, the device detects tourist attractions in the area and displays detailed information about them using augmented reality technology. This involves using an information processing device equipped with a camera, overlaying digitized information onto real-world images. Furthermore, emotion analysis is used to analyze the user's real-time facial expressions and voice to derive emotion evaluation results.

[0205] Based on these sentiment evaluation results, the server selects special offers that are appealing to the user and presents them to the user through the information processing device. For example, if the user shows a strong interest in a particular tourist spot, information about related special events will be provided in real time.

[0206] As a concrete example, if a user is viewing a particular painting in a museum, their facial expressions of surprise or emotion could be analyzed, and information about a special exhibition related to that painting could be presented. Using a generative AI model, prompt messages such as, "We will determine what emotions the user is feeling towards the displayed product and suggest promotions for related products based on those emotions," could be utilized.

[0207] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0208] Step 1:

[0209] The server obtains basic attribute information and areas of interest from the user's terminal. This input includes form entries and past behavioral data from the user. The server analyzes this data and generates the optimal sightseeing route for the user. The generated route data is output and sent to the user's terminal.

[0210] Step 2:

[0211] The terminal displays the tourist travel route received from the server. This process displays information about tourist destinations and a map showing the travel route on the user's screen. This output allows the user to visually confirm which place to visit next.

[0212] Step 3:

[0213] Upon arriving at a tourist destination, users obtain additional information presented through augmented reality technology using their device. The device's camera captures the scenery, and AR technology overlays digital information onto it. This process outputs detailed information integrated with the real-world image.

[0214] Step 4:

[0215] The device captures the user's facial expressions and voice using its camera and microphone. This data is sent to an emotion analysis system to analyze the user's emotional state. The resulting emotion evaluation is output and sent to a server.

[0216] Step 5:

[0217] The server selects personalized special information based on the sentiment evaluation results. Here, a generative AI model is used to delve deeper into the user's level of interest and select relevant special events and promotions. The selected information is output and sent to the terminal.

[0218] Step 6:

[0219] The device displays special offer information received from the server to the user. This information is communicated to the user as on-screen notifications or AR displays. This output further stimulates the user's interest during their sightseeing and allows them to enjoy a richer experience.

[0220] Step 7:

[0221] After completing their tour, users enter feedback via their device. This feedback is sent to a server and used to generate future tour routes. This process accumulates data that helps improve the user experience.

[0222] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0223] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0224] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0225] [Second Embodiment]

[0226] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0227] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0228] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0229] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0230] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0231] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0232] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0233] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0234] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0235] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0236] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0237] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0238] This invention is a tourist information system that personalizes the tourist experience based on the individual attribute information of the user. This system is implemented using a terminal owned by the user and a program that runs on the server side.

[0239] First, the server receives user attribute information and generates a user profile. This profile includes information about the user's interests and previously visited tourist destinations. Next, the server uses a generation method to generate a tourist route based on the user profile. The generated route is customized to the user's hobbies and preferences and includes suggestions for tourist destinations and information on special events.

[0240] The generated sightseeing route is then displayed on the device. The user visits the tourist destinations following this route. At the tourist destinations, the device uses augmented reality technology to retrieve character portraits and other display information. This allows the user to experience additional information and missions at the location.

[0241] The collected information is sent to the server and updated in the database as the user's visit history. This ensures that when a user revisits the same tourist destination, they will be provided with new information and experiences.

[0242] The system also receives user feedback and analyzes it on the server side. This feedback information is used to generate future sightseeing routes, providing an even more satisfying user experience.

[0243] As an example, consider a scenario where a user selects a tour themed around "historical buildings." Based on the user's profile, the server selects historical sites and displays special guide information and quizzes about local history on the user's device. After the visit, the user's feedback is used to provide new quizzes and in-depth information during their next visit.

[0244] Thus, the present invention aims to provide users with a fresh and personalized tourism experience and encourage them to revisit tourist destinations.

[0245] The following describes the processing flow.

[0246] Step 1:

[0247] Users log in to the system using their device and select their preferred travel themes and desired destinations. The device then sends this information to the server.

[0248] Step 2:

[0249] The server verifies the user profile based on the user's attribute information and selected theme, and generates a personalized sightseeing route using a generation method. The generated route includes recommended sightseeing spots and related events.

[0250] Step 3:

[0251] The server sends the generated tourist route information to the terminal. The terminal displays the received route to the user, allowing them to view the details.

[0252] Step 4:

[0253] The user begins sightseeing by following the route displayed on their device. At the tourist destinations they visit, the device uses augmented reality technology to scan installed character illustrations and AR content.

[0254] Step 5:

[0255] The device sends the acquired AR information to the server. The server records the user's visit history in a database and generates new experiences and missions based on that information.

[0256] Step 6:

[0257] The server sends newly generated experience information to the terminal, which then displays it to the user. The user then experiences the presented new missions and information.

[0258] Step 7:

[0259] After the tour ends, the user enters feedback about the experience on their device. The device then sends the feedback to the server.

[0260] Step 8:

[0261] The server analyzes the received feedback and stores it in a database. This feedback is then used to generate future sightseeing routes, improving the system to provide a more enriching experience.

[0262] (Example 1)

[0263] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0264] A challenge in tourist destinations is that the user experience does not adequately cater to individual interests and preferences, resulting in a lack of motivation for visitors to revisit destinations they have already visited. Furthermore, conventional systems do not fully utilize user feedback, making it difficult to provide personalized experiences.

[0265] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0266] In this invention, the server includes an information processing device that generates a customized sightseeing route based on the user's attribute information, means for generating a sightseeing route based on the user profile using a generation AI model and processing using prompt statements, and an information gathering device that collects user feedback information and reflects it in the generation of the sightseeing route. As a result, users are provided with experiences that match their interests and preferences, which increases their motivation to revisit.

[0267] "User attribute information" refers to information linked to an individual, such as a user's interests, preferences, and past browsing history.

[0268] A "tourist route" refers to information that suggests the order and path of visiting tourist destinations based on the user's attribute information.

[0269] An "information processing device" is a device that processes data based on user attribute information and has the function of generating customized tourist routes.

[0270] A "display device" is a device that visually presents tourist routes generated by an information processing device to the user.

[0271] A "data acquisition device" is a device that has the function of acquiring local information using virtual reality technology in tourist destinations.

[0272] An "update device" is a device that has the function of updating the user's visit history in a database based on acquired information.

[0273] A "providing device" is a device that has the function of providing users with new experience information based on their latest visit history.

[0274] An "information gathering device" is a device that receives feedback information from users and uses it to improve future service provision.

[0275] A "control device" is a device that dynamically adjusts the content of information provided through virtual reality technology according to the number of times a user visits.

[0276] A "generative AI model" is an artificial intelligence system that includes algorithms for suggesting optimal tourist routes based on user profiles.

[0277] A "prompt message" is a text-based instruction that gives a generative AI model a command to initiate the generation of specific information.

[0278] This invention is a tourist information system designed to customize the tourist experience based on the user's individual interests and preferences, thereby encouraging repeat visits. The system is implemented using a server and a terminal held by the user.

[0279] The server first receives the attribute information sent from the user's terminal. This information includes the user's interests and past visit history. Next, the server utilizes a generative AI model to generate an optimal tourism route based on the received data. At this stage, a prompt sentence such as "If the user is interested in historical buildings, please generate a tourism route based on this interest" is used.

[0280] The generated tourism route is displayed on the user's terminal, and the user visits tourist destinations according to it. When arriving at a tourist destination, the terminal utilizes augmented reality technology to present local information. This is achieved by using the terminal's camera and GPS functions to provide the user with special guide information and interactive quizzes.

[0281] After the user's visit, the terminal sends the information obtained from the visited location to the server, and the user's visit history is updated. This historical data serves as the basis for providing new experience information in future visits.

[0282] Furthermore, the user can input feedback on the terminal after the tourism experience. The server collects and analyzes this feedback and reflects it in the generation of tourism routes for subsequent visits.

[0283] As a specific example, if the user selects a castle tour as the theme and has visited several castles in the past, the server proposes a route including a new castle based on this information and provides detailed historical backgrounds regarding specific castles. Through this process, the user can deepen their interests and gain further learning opportunities

[0284] In this way, the system has the ability to continuously provide personalized tourism experiences demanded by users.

[0285] The flow of the specific process in Example 1 will be described using FIG. 11.

[0286] Step 1:

[0287] The server receives attribute information transmitted from the user's terminal. This attribute information includes the user's interests, preferences, and past browsing history. The server analyzes this data and generates a user profile. This profile is output as a summarized version of the data indicating the user's specific areas of interest.

[0288] Step 2:

[0289] The server uses a generative AI model to generate sightseeing routes based on the user profile. This process takes prompts such as "If the user is interested in historical buildings, generate a sightseeing route based on their interests" as input. Based on these prompts, the AI ​​model selects the most suitable tourist destinations and outputs a customized route plan.

[0290] Step 3:

[0291] The user's device displays a sightseeing route received from the server. The device's input is the generated sightseeing route, and the output includes a map, a visit order, and detailed information about each sightseeing spot. This output allows the user to plan their trip according to the suggested route.

[0292] Step 4:

[0293] When a user visits a tourist destination, the device uses augmented reality technology to present information. The device receives GPS and camera data as input and displays virtual information about the local culture and history as output. This output includes visual and interactive elements to complement the user's experience.

[0294] Step 5:

[0295] After the user finishes sightseeing, the device sends the acquired information to the server. The input is data collected during the visit, and the server uses this data to update the user's visit history. This process outputs information that will provide a new experience on the next visit.

[0296] Step 6:

[0297] Users input feedback about their sightseeing experience on their device. The device sends this feedback to a server, which analyzes it. The analysis results are then used to generate future sightseeing routes, resulting in more customized routes. The output includes suggestions that better match the user's preferences.

[0298] (Application Example 1)

[0299] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0300] Modern consumers seek personalized shopping experiences that cater to diverse tastes and needs. However, traditional brick-and-mortar stores offer a uniform product display, making it difficult to provide flexible product guidance and purchasing experiences tailored to individual consumer preferences. Furthermore, the lack of mechanisms to immediately provide detailed product information within stores hinders the rapid progress of consumer purchasing decisions.

[0301] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0302] In this invention, the server includes a generating means for generating a customized product route based on user attribute information, a displaying means for displaying on a user terminal based on the product route generated by the generating means, and an acquiring means for acquiring information presented using augmented reality technology in a physical store. Thereby, it becomes possible to provide product guidance according to individual preferences of the user and real-time product information within the store.

[0303] "User attribute information" refers to interests, purchase history, preferences, and related personal data regarding individual users.

[0304] "Product route" refers to an effective product search route within a store individualized based on a specific user profile.

[0305] "Generating means" refers to a system or process for customizing specific routes or information based on user attribute information.

[0306] "Displaying means" refers to a digital or physical display device or interface for presenting information and routes generated on a user terminal.

[0307] "Acquiring means" refers to a technology or device for collecting information presented within a physical store using augmented reality technology and providing it to a user terminal.

[0308] "Updating means" refers to a process or system for keeping a user's shopping history up-to-date based on the information obtained by the acquiring means.

[0309] "Providing means" refers to a method or device for presenting new product information and experiences to a user based on updated user data.

[0310] To implement this invention, it is necessary to build a system that generates product routes based on the user's individual attribute information and presents them to the terminal. This system is designed to allow users to enjoy a customized shopping experience within the store.

[0311] The server receives user attribute information and generates a user profile based on that information. Based on this user profile, the server generates a product route. The generated product route includes products tailored to the user's preferences and special offers. The product information is displayed on the smartphone device using React Native.

[0312] Within the store, users can use augmented reality technology via their devices to obtain detailed product information. This utilizes the device's camera function and implements ARKit (iOS) or ARCore (Android). This allows users to intuitively view product ingredient information and promotional details.

[0313] The acquired information is sent to the server and recorded in the database as the user's shopping history. This data is used to provide the user with more precise product recommendations on their next visit. Furthermore, the recommended products are updated regularly based on user feedback.

[0314] For example, if a user is interested in "organic food," the system will guide them to the relevant product section in the store and present information about how the products are grown and their nutritional content using augmented reality.

[0315] Examples of prompts to input into a generative AI model:

[0316] Create a program that takes user attribute information as input and generates personalized shopping routes and AR information. Include features to highlight eco-friendly products in physical stores and improve recommendations based on user feedback.

[0317] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0318] Step 1:

[0319] The server receives user attribute information, including the user's interests, past purchase history, and preferences. Based on this received data, a user profile is generated. This profile is a detailed record of the user's preferences and is used in the next step.

[0320] Step 2:

[0321] The server generates product routes based on the generated user profile. Using an AI algorithm, it calculates the optimal products and routes for the user from the data in the profile. The output is a specially customized product route, which is sent to the user's smartphone.

[0322] Step 3:

[0323] The device receives the product route sent from the server and displays it as a user interface using React Native. The user then follows the displayed product route to explore the store. This allows the user to obtain location information for products that match their interests.

[0324] Step 4:

[0325] Users scan specific products using their device's camera within a physical store. This operation is performed using augmented reality technology, with product information visually displayed via ARKit (iOS) or ARCore (Android). The input is the scanned product information, and the output is detailed information about that product.

[0326] Step 5:

[0327] The device sends the acquired product information to the server. The server uses this information to update the user's shopping history. This data processing makes it possible to provide a personalized experience for future purchases as well.

[0328] Step 6:

[0329] Users input feedback on product routes and suggestions into a terminal. This feedback is collected by the server and used to improve future product suggestions and route generation. The input is user feedback, and the output is improved product routes and suggestions.

[0330] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0331] This invention is a tourist information system that provides a customized tourist experience based on user attribute information, and also incorporates an emotion engine that recognizes the user's emotions. This system is operated through the cooperation of a user terminal and a server.

[0332] First, the server receives the user's basic attribute information, desired visiting area, and theme. Based on this information, the server designs and generates a specially customized sightseeing route using a generation method. The generated route reflects the user's interests and past visit history, and includes sightseeing spots and special events.

[0333] The generated sightseeing route is sent to the user's device, allowing the user to begin sightseeing according to that route. At the visited tourist spots, the device scans AR content displayed using augmented reality technology to obtain various information.

[0334] This system also incorporates an emotion engine, which analyzes the user's emotions in real time from their facial expressions, voice tone, and input data. The analyzed emotion data is sent to a server, which then provides new information and missions tailored to the user's mood. For example, if the system detects that the user is enjoying themselves, it can suggest additional events or spots that might be of particular interest to them.

[0335] Furthermore, after the tour ends, user feedback is collected via the device and sent to the server. The feedback data and sentiment data are then used through the feedback system to improve individual experiences and are reflected in the design of future routes.

[0336] As a concrete example, consider a case where a user requests a trip themed around "nature." Based on the user's emotional data, the server provides additional information and missions related to the areas where the user felt moved or soothed during their visit. The goal of this process is to provide an optimal travel experience tailored to each individual user and to increase their desire to revisit the tourist destination.

[0337] The following describes the processing flow.

[0338] Step 1:

[0339] Users log in to the system using their device and select their preferred travel themes and regions they wish to visit. The device then sends this information to the server.

[0340] Step 2:

[0341] The server uses a generation mechanism to generate the optimal sightseeing route based on the received user information and attribute information including past visit data. The generated route includes sightseeing spots and event information tailored to the user's interests.

[0342] Step 3:

[0343] The server sends the generated sightseeing route to the device. The device displays this information to the user and prompts them to follow the suggested route.

[0344] Step 4:

[0345] When a user visits a tourist destination, they use a device to scan character panels and local AR content using augmented reality technology. The device then sends the acquired information to a server.

[0346] Step 5:

[0347] The server updates the user's visit history based on the acquired data. Furthermore, the emotion engine analyzes the user's emotions and sends them to the server.

[0348] Step 6:

[0349] The server considers emotional data and visit history to generate new experience information and missions, and delivers content to the device that matches the user's emotional state.

[0350] Step 7:

[0351] Users deepen their experience at tourist destinations based on the new information provided. After completing their sightseeing, they use their device to input feedback about their experience.

[0352] Step 8:

[0353] The device sends feedback to the server, which analyzes the received feedback and stores it in a database. This information is used to generate future sightseeing routes and further improve the user experience.

[0354] (Example 2)

[0355] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0356] Traditional tourist information systems have struggled to provide tourist experiences that fully reflect the individual interests and feelings of users. Furthermore, they lacked mechanisms to utilize user feedback and opinions after an experience for future experiences. As a result, there were limitations in increasing user satisfaction and the desire to return.

[0357] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0358] In this invention, the server includes a generation means for generating customized routes based on the user's personal information, an acquisition means for acquiring information presented using augmented reality technology in a specific area, and a suggestion means for analyzing the user's emotions and dynamically suggesting information based on the analysis results. This enables the provision of a tourism experience tailored to each individual user and real-time suggestions based on emotions.

[0359] "Personal information" refers to information that identifies a user and includes attribute data used to customize tourist routes.

[0360] The "generation method" is a system for creating customized tourist routes based on the user's personal information.

[0361] "Display means" refers to devices or technologies for visually outputting the generated tourist route to the user's communication device.

[0362] "Means of acquisition" refers to the function of collecting information presented using augmented reality technology in a specific region.

[0363] "Update methods" refer to the process of keeping a user's visit history up-to-date based on the acquired information.

[0364] "Means of provision" refers to methods for supplying users with new experience information based on updated visit history.

[0365] "Emotional analysis" is a technology that analyzes users' emotions and dynamically makes suggestions based on the results.

[0366] The "suggestion method" is a function that recommends the most suitable events and information during sightseeing based on the results of user sentiment analysis.

[0367] A "feedback method" is a technique for accumulating user evaluation information and using it to generate future tourist routes.

[0368] The "control mechanism" is a system that adjusts the information presented using augmented reality technology according to the number of times a user has visited the site.

[0369] The tourism guidance system of the present invention is designed to provide a customized tourism experience that reflects the individual tastes and feelings of the user. This system operates primarily through communication between a server and a terminal, both of which play important roles.

[0370] First, the user inputs basic personal information, desired visiting areas, and themes through their device. The device then sends this data to the server. The server receives this data and uses a generative AI model to generate a personalized sightseeing route for each user. In this process, the server retrieves past visit history and related information from a large database and inputs prompts into the generative AI model. One example of such a prompt is, "Generate a customized sightseeing route based on the user's attribute information. The theme should be nature, and information related to the desired visiting area should be considered."

[0371] The generated route information is sent from the server to the terminal and displayed. The user then begins sightseeing according to this information, and at each destination, they can use the camera and microphone on the terminal to obtain diverse information in real time using content provided by augmented reality technology.

[0372] The device also features an emotion engine that analyzes the user's facial expressions and voice, and sends the resulting emotion data to a server. The server uses this data to dynamically suggest information and missions in order to provide the optimal sightseeing experience tailored to the user's emotions.

[0373] After completing their tour, users send feedback from their device to the server. This feedback is used to improve future experiences. Overall, the system aims to engage with users' emotions and provide an engaging experience in real time.

[0374] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0375] Step 1:

[0376] The user uses a device to enter personal information, desired visit area, and theme. The device then formats this information appropriately for transmission to the server and sends it as a data packet. Specific examples of information entered include name, age, and areas of interest.

[0377] Step 2:

[0378] The server uses a generation AI model based on the received user information to generate a customized sightseeing route. In this process, the server analyzes personal information, extracts relevant information from the database, and inputs prompt messages into the generation AI model. These prompt messages then output a sightseeing route optimized for the user.

[0379] Step 3:

[0380] The generated sightseeing route information is sent from the server to the terminal. The terminal displays this information to the user and prepares to launch the map application or guide function to begin sightseeing. The information output at this point is a list of specific sightseeing spots and routes.

[0381] Step 4:

[0382] Users utilize augmented reality (AR) technology by using the camera function on their device at the tourist destinations they visit. The device scans QR codes and AR markers displayed at the destination to provide detailed information and stories. The input data consists of images and marker information, which is then analyzed to display relevant content.

[0383] Step 5:

[0384] The device uses an emotion engine to analyze the user's facial expressions and voice tone in real time. The analyzed emotion data is sent to a server, which dynamically suggests appropriate events and additional information based on the user's emotional state. The input data consists of camera video and audio data, while the output information consists of recommended content and missions.

[0385] Step 6:

[0386] After completing their tour, users enter feedback on their experience into a terminal. The terminal sends the collected feedback data to a server. The server analyzes this data and uses it to improve future tour route generation. The input data consists of text comments and ratings, while the output information represents an improved route generation process.

[0387] (Application Example 2)

[0388] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0389] In recent years, the tourism sector has seen a growing demand for personalized experiences tailored to individual users. However, conventional systems have struggled to provide services that reflect users' emotional changes and interests in real time. Furthermore, user visits tend to be fleeting, and there have been insufficient mechanisms to encourage repeat visits. Therefore, there is a need to develop effective tourism experiences that take user emotions into consideration, as well as methods to increase the desire for repeat visits.

[0390] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0391] In this invention, the server includes a generation means for generating customized sightseeing routes based on user attribute information, an acquisition means for acquiring information presented in the region using augmented reality technology, and an emotion response provision means for analyzing the user's facial expressions, voice, and input data using emotion analysis means and presenting information according to the emotion evaluation results. This makes it possible to provide a personalized experience based on the user's emotional changes and to present special information that arouses interest in real time. This can improve user satisfaction and increase the desire to revisit.

[0392] A "user" is an individual who uses this system to enjoy a tourism experience.

[0393] "Attribute information" refers to basic information about a user, as well as data indicating their preferences and interests.

[0394] A "tourist travel route" is a recommended route for sightseeing that is customized based on the user's attribute information and interests.

[0395] "Generating means" refers to a device or program that has the function of collecting and analyzing information to create routes or data for a specific purpose.

[0396] An "information processing device" is a device that processes digital data and presents information to the user.

[0397] Augmented reality technology is a technology that overlays digital information onto the real world environment.

[0398] "Acquisition means" refers to a device or program that has the function of receiving information from an external source.

[0399] "Past activity history" refers to a record of places a user has visited and activities they have undertaken in the past.

[0400] "Update means" refers to a device or program that has the function of modifying or adding to existing data based on newly acquired information.

[0401] "Emotional analysis means" refers to a device or program that has the function of processing emotional data in order to analyze and evaluate the emotions of a user.

[0402] "Emotional evaluation results" refer to the evaluation results of the user's emotional state derived from emotional analysis methods.

[0403] "Information" refers to knowledge and data provided in digital format.

[0404] "Special Offer Information" refers to data or offers of exceptional value that differ from the information that is normally provided.

[0405] This invention is a system for providing a user-optimized sightseeing experience based on user attribute information. The system operates when a user is sightseeing via a smart device, and a specific embodiment of this system is configured as follows.

[0406] The server retrieves the user's basic attribute information and interests from user input or previous data. This information is used to generate the most suitable sightseeing route for the user. The generated sightseeing route is then communicated to the user through an information processing device.

[0407] During the visit, the device detects tourist attractions in the area and displays detailed information about them using augmented reality technology. This involves using an information processing device equipped with a camera, overlaying digitized information onto real-world images. Furthermore, emotion analysis is used to analyze the user's real-time facial expressions and voice to derive emotion evaluation results.

[0408] Based on these sentiment evaluation results, the server selects special offers that are appealing to the user and presents them to the user through the information processing device. For example, if the user shows a strong interest in a particular tourist spot, information about related special events will be provided in real time.

[0409] As a concrete example, if a user is viewing a particular painting in a museum, their facial expressions of surprise or emotion could be analyzed, and information about a special exhibition related to that painting could be presented. Using a generative AI model, prompt messages such as, "We will determine what emotions the user is feeling towards the displayed product and suggest promotions for related products based on those emotions," could be utilized.

[0410] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0411] Step 1:

[0412] The server obtains basic attribute information and areas of interest from the user's terminal. This input includes form entries and past behavioral data from the user. The server analyzes this data and generates the optimal sightseeing route for the user. The generated route data is output and sent to the user's terminal.

[0413] Step 2:

[0414] The terminal displays the tourist travel route received from the server. This process displays information about tourist destinations and a map showing the travel route on the user's screen. This output allows the user to visually confirm which place to visit next.

[0415] Step 3:

[0416] Upon arriving at a tourist destination, users obtain additional information presented through augmented reality technology using their devices. The device's camera captures the scenery, and AR technology overlays digital information onto it. This process outputs detailed information integrated with the real-world image.

[0417] Step 4:

[0418] The device captures the user's facial expressions and voice using its camera and microphone. This data is sent to an emotion analysis system to analyze the user's emotional state. The resulting emotion evaluation is output and sent to a server.

[0419] Step 5:

[0420] The server selects personalized special information based on the sentiment evaluation results. Here, a generative AI model is used to delve deeper into the user's level of interest and select relevant special events and promotions. The selected information is output and sent to the terminal.

[0421] Step 6:

[0422] The device displays special offer information received from the server to the user. This information is communicated to the user as on-screen notifications or AR displays. This output further stimulates the user's interest during their sightseeing and allows them to enjoy a richer experience.

[0423] Step 7:

[0424] After completing their tour, users enter feedback via their device. This feedback is sent to a server and used to generate future tour routes. This process accumulates data that helps improve the user experience.

[0425] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0426] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0427] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[0428] [Third Embodiment]

[0429] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[0430] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0431] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0432] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[0433] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0434] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0435] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0436] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0437] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0438] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0439] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0440] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[0441] This invention is a tourist information system that personalizes the tourist experience based on the individual attribute information of the user. This system is implemented using a terminal owned by the user and a program that runs on the server side.

[0442] First, the server receives user attribute information and generates a user profile. This profile includes information about the user's interests and previously visited tourist destinations. Next, the server uses a generation method to generate a tourist route based on the user profile. The generated route is customized to the user's hobbies and preferences and includes suggestions for tourist destinations and information on special events.

[0443] The generated sightseeing route is then displayed on the device. The user visits the tourist destinations following this route. At the tourist destinations, the device uses augmented reality technology to retrieve character portraits and other display information. This allows the user to experience additional information and missions at the location.

[0444] The collected information is sent to the server and updated in the database as the user's visit history. This ensures that when a user revisits the same tourist destination, they will be provided with new information and experiences.

[0445] The system also receives user feedback and analyzes it on the server side. This feedback information is used to generate future sightseeing routes, providing an even more satisfying user experience.

[0446] As an example, consider a scenario where a user selects a tour themed around "historical buildings." Based on the user's profile, the server selects historical sites and displays special guide information and quizzes about local history on the user's device. After the visit, the user's feedback is used to provide new quizzes and in-depth information during their next visit.

[0447] Thus, the present invention aims to provide users with a fresh and personalized tourism experience and encourage them to revisit tourist destinations.

[0448] The following describes the processing flow.

[0449] Step 1:

[0450] Users log in to the system using their device and select their preferred travel themes and desired destinations. The device then sends this information to the server.

[0451] Step 2:

[0452] The server verifies the user profile based on the user's attribute information and selected theme, and generates a personalized sightseeing route using a generation method. The generated route includes recommended sightseeing spots and related events.

[0453] Step 3:

[0454] The server sends the generated tourist route information to the terminal. The terminal displays the received route to the user, allowing them to view the details.

[0455] Step 4:

[0456] The user begins sightseeing by following the route displayed on their device. At the tourist destinations they visit, the device uses augmented reality technology to scan installed character illustrations and AR content.

[0457] Step 5:

[0458] The device sends the acquired AR information to the server. The server records the user's visit history in a database and generates new experiences and missions based on that information.

[0459] Step 6:

[0460] The server sends newly generated experience information to the terminal, which then displays it to the user. The user then experiences the presented new missions and information.

[0461] Step 7:

[0462] After the tour ends, the user enters feedback about the experience on their device. The device then sends the feedback to the server.

[0463] Step 8:

[0464] The server analyzes the received feedback and stores it in a database. This feedback is then used to generate future sightseeing routes, improving the system to provide a more enriching experience.

[0465] (Example 1)

[0466] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0467] A challenge in tourist destinations is that user experiences do not adequately cater to individual interests and preferences, resulting in a lack of motivation for visitors to revisit destinations they have already visited. Furthermore, conventional systems do not fully utilize user feedback, making it difficult to provide personalized experiences.

[0468] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0469] In this invention, the server includes an information processing device that generates a customized sightseeing route based on the user's attribute information, means for generating a sightseeing route based on the user profile using a generation AI model and processing using prompt statements, and an information gathering device that collects user feedback information and reflects it in the generation of the sightseeing route. As a result, users are provided with experiences that match their interests and preferences, which increases their motivation to revisit.

[0470] "User attribute information" refers to information linked to an individual, such as a user's interests, preferences, and past browsing history.

[0471] A "tourist route" refers to information that suggests the order and path of visiting tourist destinations based on the user's attribute information.

[0472] An "information processing device" is a device that processes data based on user attribute information and has the function of generating customized tourist routes.

[0473] A "display device" is a device that visually presents tourist routes generated by an information processing device to the user.

[0474] A "data acquisition device" is a device that has the function of acquiring local information using virtual reality technology in tourist destinations.

[0475] An "update device" is a device that has the function of updating the user's visit history in a database based on acquired information.

[0476] A "providing device" is a device that has the function of providing users with new experience information based on their latest visit history.

[0477] An "information gathering device" is a device that receives feedback information from users and uses it to improve future service provision.

[0478] A "control device" is a device that dynamically adjusts the content of information provided through virtual reality technology according to the number of times a user visits.

[0479] A "generative AI model" is an artificial intelligence system that includes algorithms for suggesting optimal tourist routes based on user profiles.

[0480] A "prompt message" is a text-based instruction that gives a generative AI model a command to initiate the generation of specific information.

[0481] This invention is a tourist information system designed to customize the tourist experience based on the user's individual interests and preferences, thereby encouraging repeat visits. The system is implemented using a server and a terminal held by the user.

[0482] The server first receives attribute information sent from the user's device. This information includes the user's interests and past visit history. Next, the server uses a generative AI model to generate the optimal sightseeing route based on the received data. At this stage, prompts such as "If the user is interested in historical buildings, please generate a sightseeing route based on their interests" are used.

[0483] The generated sightseeing route is displayed on the user's device, and the user visits the tourist destinations according to it. Upon arrival at a tourist destination, the device uses augmented reality technology to present local information. This is achieved by using the device's camera and GPS functions to provide the user with special guide information and interactive quizzes.

[0484] After a user visits a location, the terminal sends information acquired from that location to the server, updating the user's visit history. This history data forms the basis for providing new experience information during future visits.

[0485] Furthermore, users can input feedback on their devices after their sightseeing experience. The server collects and analyzes this feedback and uses it to generate future sightseeing routes.

[0486] For example, if a user chooses castle touring as their theme and has previously visited several castles, the server will use that information to suggest a route that includes new castles and provide detailed historical background information about those specific castles. Through this process, users can deepen their interest and gain opportunities for further learning.

[0487] Thus, the system has the capability to continuously provide personalized tourism experiences that users desire.

[0488] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0489] Step 1:

[0490] The server receives attribute information transmitted from the user's terminal. This attribute information includes the user's interests, preferences, and past browsing history. The server analyzes this data and generates a user profile. This profile is output as a summarized version of the data indicating the user's specific areas of interest.

[0491] Step 2:

[0492] The server uses a generative AI model to generate sightseeing routes based on the user profile. This process takes prompts such as "If the user is interested in historical buildings, generate a sightseeing route based on their interests" as input. Based on these prompts, the AI ​​model selects the most suitable tourist destinations and outputs a customized route plan.

[0493] Step 3:

[0494] The user's device displays a sightseeing route received from the server. The device's input is the generated sightseeing route, and the output includes a map, a visit order, and detailed information about each sightseeing spot. This output allows the user to plan their trip according to the suggested route.

[0495] Step 4:

[0496] When a user visits a tourist destination, the device uses augmented reality technology to present information. The device receives GPS and camera data as input and displays virtual information about the local culture and history as output. This output includes visual and interactive elements to complement the user's experience.

[0497] Step 5:

[0498] After the user finishes sightseeing, the device sends the acquired information to the server. The input is data collected during the visit, and the server uses this data to update the user's visit history. This process outputs information that will provide a new experience on the next visit.

[0499] Step 6:

[0500] Users input feedback about their sightseeing experience on their device. The device sends this feedback to a server, which analyzes it. The analysis results are then used to generate future sightseeing routes, resulting in more customized routes. The output includes suggestions that better match the user's preferences.

[0501] (Application Example 1)

[0502] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0503] Modern consumers seek personalized shopping experiences that cater to diverse tastes and needs. However, traditional brick-and-mortar stores offer a uniform product display, making it difficult to provide flexible product guidance and purchasing experiences tailored to individual consumer preferences. Furthermore, the lack of mechanisms to immediately provide detailed product information within stores hinders the rapid progress of consumer purchasing decisions.

[0504] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0505] In this invention, the server includes a generation means for generating a customized product route based on user attribute information, a display means for displaying the product route generated by the generation means on a user terminal, and an acquisition means for acquiring information presented in a physical store using augmented reality technology. This enables product guidance tailored to the user's individual preferences and the provision of real-time product information within the store.

[0506] "User attribute information" refers to individual users' interests, purchase history, preferences, and related personal data.

[0507] A "product route" refers to an effective in-store product search path that is personalized based on a specific user profile.

[0508] "Generation means" refers to a system or process for customizing specific routes or information based on user attribute information.

[0509] "Display means" refers to digital or physical display devices or interfaces used to present information or routes generated on a user terminal.

[0510] "Acquisition means" refers to technologies and devices that use augmented reality technology to collect information presented within a physical store and provide it to the user's terminal.

[0511] "Update means" refers to the process or system used to keep a user's shopping history up-to-date based on information obtained through acquisition means.

[0512] "Means of delivery" refers to methods and devices for presenting new product information and experiences to users based on updated user data.

[0513] To implement this invention, it is necessary to build a system that generates product routes based on the user's individual attribute information and presents them to the terminal. This system is designed to allow users to enjoy a customized shopping experience within the store.

[0514] The server receives user attribute information and generates a user profile based on that information. Based on this user profile, the server generates a product route. The generated product route includes products tailored to the user's preferences and special offers. The product information is displayed on the smartphone device using React Native.

[0515] Within the store, users can use augmented reality technology via their devices to obtain detailed product information. This utilizes the device's camera function and implements ARKit (iOS) or ARCore (Android). This allows users to intuitively view product ingredient information and promotional details.

[0516] The acquired information is sent to the server and recorded in the database as the user's shopping history. This data is used to provide the user with more precise product recommendations on their next visit. Furthermore, the recommended products are updated regularly based on user feedback.

[0517] For example, if a user is interested in "organic food," the system will guide them to the relevant product section in the store and present information about how the products are grown and their nutritional content using augmented reality.

[0518] Examples of prompts to input into a generative AI model:

[0519] Create a program that takes user attribute information as input and generates personalized shopping routes and AR information. Include features to highlight eco-friendly products in physical stores and improve recommendations based on user feedback.

[0520] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0521] Step 1:

[0522] The server receives user attribute information, including the user's interests, past purchase history, and preferences. Based on this received data, a user profile is generated. This profile is a detailed record of the user's preferences and is used in the next step.

[0523] Step 2:

[0524] The server generates product routes based on the generated user profile. Using an AI algorithm, it calculates the optimal products and routes for the user from the data in the profile. The output is a specially customized product route, which is sent to the user's smartphone.

[0525] Step 3:

[0526] The device receives the product route sent from the server and displays it as a user interface using React Native. The user then follows the displayed product route to explore the store. This allows the user to obtain location information for products that match their interests.

[0527] Step 4:

[0528] Users scan specific products using their device's camera within a physical store. This operation is performed using augmented reality technology, with product information visually displayed via ARKit (iOS) or ARCore (Android). The input is the scanned product information, and the output is detailed information about that product.

[0529] Step 5:

[0530] The device sends the acquired product information to the server. The server uses this information to update the user's shopping history. This data processing makes it possible to provide a personalized experience for future purchases.

[0531] Step 6:

[0532] Users input feedback on product routes and suggestions into a terminal. This feedback is collected by the server and used to improve future product suggestions and route generation. The input is user feedback, and the output is improved product routes and suggestions.

[0533] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0534] This invention is a tourist information system that provides a customized tourist experience based on user attribute information, and also incorporates an emotion engine that recognizes the user's emotions. This system is operated through the cooperation of a user terminal and a server.

[0535] First, the server receives the user's basic attribute information, desired visiting area, and theme. Based on this information, the server designs and generates a specially customized sightseeing route using a generation method. The generated route reflects the user's interests and past visit history, and includes sightseeing spots and special events.

[0536] The generated sightseeing route is sent to the user's device, allowing the user to begin sightseeing according to that route. At the tourist destinations visited, the device scans AR content displayed using augmented reality technology to obtain various information.

[0537] This system also incorporates an emotion engine, which analyzes the user's emotions in real time from their facial expressions, voice tone, and input data. The analyzed emotion data is sent to a server, which then provides new information and missions tailored to the user's mood. For example, if the system detects that the user is enjoying themselves, it can suggest additional events or spots that might be of particular interest to them.

[0538] Furthermore, after the tour ends, user feedback is collected via the device and sent to the server. The feedback data and sentiment data are then used through the feedback system to improve individual experiences and are reflected in the design of future routes.

[0539] As a concrete example, consider a case where a user requests a trip themed around "nature." Based on the user's emotional data, the server provides additional information and missions related to the areas where the user felt moved or soothed during their visit. The goal of this process is to provide an optimal travel experience tailored to each individual user and to increase their desire to revisit the tourist destination.

[0540] The following describes the processing flow.

[0541] Step 1:

[0542] Users log in to the system using their device and select their preferred travel themes and regions they wish to visit. The device then sends this information to the server.

[0543] Step 2:

[0544] The server uses a generation mechanism to generate the optimal sightseeing route based on the received user information and attribute information including past visit data. The generated route includes sightseeing spots and event information tailored to the user's interests.

[0545] Step 3:

[0546] The server sends the generated sightseeing route to the device. The device displays this information to the user and prompts them to follow the suggested route.

[0547] Step 4:

[0548] When a user visits a tourist destination, they use a device to scan character panels and local AR content using augmented reality technology. The device then sends the acquired information to a server.

[0549] Step 5:

[0550] The server updates the user's visit history based on the acquired data. Furthermore, the emotion engine analyzes the user's emotions and sends them to the server.

[0551] Step 6:

[0552] The server considers emotional data and visit history to generate new experience information and missions, and delivers content to the device that matches the user's emotional state.

[0553] Step 7:

[0554] Users deepen their experience at tourist destinations based on the new information provided. After completing their sightseeing, they use their device to input feedback about their experience.

[0555] Step 8:

[0556] The device sends feedback to the server, which analyzes the received feedback and stores it in a database. This information is used to generate future sightseeing routes and further improve the user experience.

[0557] (Example 2)

[0558] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0559] Traditional tourist information systems have struggled to provide tourist experiences that fully reflect the individual interests and feelings of users. Furthermore, they lacked mechanisms to utilize user feedback and opinions after an experience for future experiences. As a result, there were limitations in increasing user satisfaction and the desire to return.

[0560] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0561] In this invention, the server includes a generation means for generating customized routes based on the user's personal information, an acquisition means for acquiring information presented using augmented reality technology in a specific area, and a suggestion means for analyzing the user's emotions and dynamically suggesting information based on the analysis results. This enables the provision of a tourism experience tailored to each individual user and real-time suggestions based on emotions.

[0562] "Personal information" refers to information that identifies a user and includes attribute data used to customize tourist routes.

[0563] The "generation method" is a system for creating customized tourist routes based on the user's personal information.

[0564] "Display means" refers to devices or technologies for visually outputting the generated tourist route to the user's communication device.

[0565] "Means of acquisition" refers to the function of collecting information presented using augmented reality technology in a specific area.

[0566] "Update methods" refer to the process of keeping a user's visit history up-to-date based on the acquired information.

[0567] "Means of provision" refers to methods for supplying users with new experience information based on updated visit history.

[0568] "Emotional analysis" is a technology that analyzes users' emotions and dynamically makes suggestions based on the results.

[0569] The "suggestion method" is a function that recommends the most suitable events and information during sightseeing based on the results of the user's sentiment analysis.

[0570] A "feedback method" is a technique for accumulating user evaluation information and using it to generate future tourist routes.

[0571] The "control mechanism" is a system that adjusts the information presented using augmented reality technology according to the number of times a user has visited the site.

[0572] The present invention's tourist information system is designed to provide a customized tourist experience that reflects the user's individual interests and feelings. This system operates primarily through communication between a server and a terminal, both of which play important roles.

[0573] First, the user inputs basic personal information, desired visiting areas, and themes through their device. The device then sends this data to the server. The server receives this data and uses a generative AI model to generate a personalized sightseeing route for each user. In this process, the server retrieves past visit history and related information from a large database and inputs prompts into the generative AI model. One example of such a prompt is, "Generate a customized sightseeing route based on the user's attribute information. The theme should be nature, and information related to the desired visiting area should be considered."

[0574] The generated route information is sent from the server to the terminal and displayed. The user then begins sightseeing according to this information, and at each destination, they can use the camera and microphone on the terminal to obtain diverse information in real time using content provided by augmented reality technology.

[0575] The device also features an emotion engine that analyzes the user's facial expressions and voice, and sends the resulting emotion data to a server. The server uses this data to dynamically suggest information and missions in order to provide the optimal sightseeing experience tailored to the user's emotions.

[0576] After completing their tour, users send feedback from their device to the server. This feedback is used to improve future experiences. Overall, the system aims to engage with users' emotions and provide an engaging experience in real time.

[0577] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0578] Step 1:

[0579] The user uses a device to enter personal information, desired visit area, and theme. The device then formats this information appropriately for transmission to the server and sends it as a data packet. Specific examples of information entered include name, age, and areas of interest.

[0580] Step 2:

[0581] The server uses a generation AI model based on the received user information to generate a customized sightseeing route. In this process, the server analyzes personal information, extracts relevant information from the database, and inputs prompt messages into the generation AI model. These prompt messages then output a sightseeing route optimized for the user.

[0582] Step 3:

[0583] The generated sightseeing route information is sent from the server to the terminal. The terminal displays this information to the user and prepares to launch the map application or guide function to begin sightseeing. The information output at this point is a list of specific sightseeing spots and routes.

[0584] Step 4:

[0585] Users utilize augmented reality (AR) technology by using the camera function on their device at the tourist destinations they visit. The device scans QR codes and AR markers displayed at the destination to provide detailed information and stories. The input data consists of images and marker information, which is then analyzed to display relevant content.

[0586] Step 5:

[0587] The device uses an emotion engine to analyze the user's facial expressions and voice tone in real time. The analyzed emotion data is sent to a server, which dynamically suggests appropriate events and additional information according to the user's emotional state. The input data consists of camera video and audio data, while the output information consists of recommended content and missions.

[0588] Step 6:

[0589] After completing their tour, users enter feedback on their experience into a terminal. The terminal sends the collected feedback data to a server. The server analyzes this data and uses it to improve future tour route generation. The input data consists of text comments and ratings, while the output information represents an improved route generation process.

[0590] (Application Example 2)

[0591] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0592] In recent years, the tourism sector has seen a growing demand for personalized experiences tailored to individual users. However, conventional systems have struggled to provide services that reflect users' emotional changes and interests in real time. Furthermore, user visits tend to be fleeting, and there have been insufficient mechanisms to encourage repeat visits. Therefore, there is a need to develop effective tourism experiences that take user emotions into consideration, as well as methods to increase the desire for repeat visits.

[0593] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0594] In this invention, the server includes a generation means for generating customized sightseeing routes based on user attribute information, an acquisition means for acquiring information presented in the region using augmented reality technology, and an emotion response provision means for analyzing the user's facial expressions, voice, and input data using emotion analysis means and presenting information according to the emotion evaluation results. This makes it possible to provide a personalized experience based on the user's emotional changes and to present special information that arouses interest in real time. This can improve user satisfaction and increase the desire to revisit.

[0595] A "user" is an individual who uses this system to enjoy a tourism experience.

[0596] "Attribute information" refers to basic information about a user, as well as data indicating their preferences and interests.

[0597] A "tourist travel route" is a recommended route for sightseeing that is customized based on the user's attribute information and interests.

[0598] "Generating means" refers to a device or program that has the function of collecting and analyzing information to create routes or data for a specific purpose.

[0599] An "information processing device" is a device that processes digital data and presents information to the user.

[0600] Augmented reality technology is a technology that overlays digital information onto the real world environment.

[0601] "Acquisition means" refers to a device or program that has the function of receiving information from an external source.

[0602] "Past activity history" refers to a record of places a user has visited and activities they have undertaken in the past.

[0603] "Update means" refers to a device or program that has the function of modifying or adding to existing data based on newly acquired information.

[0604] "Emotional analysis means" refers to a device or program that has the function of processing emotional data in order to analyze and evaluate the emotions of a user.

[0605] "Emotional evaluation results" refer to the evaluation results of the user's emotional state derived from emotional analysis methods.

[0606] "Information" refers to knowledge and data provided in digital format.

[0607] "Special Offer Information" refers to data or offers of exceptional value that differ from the information that is normally provided.

[0608] This invention is a system for providing a user-optimized sightseeing experience based on user attribute information. The system operates when a user is sightseeing via a smart device, and a specific embodiment of this system is configured as follows.

[0609] The server retrieves the user's basic attribute information and interests from user input or previous data. This information is used to generate the most suitable sightseeing route for the user. The generated sightseeing route is then communicated to the user through an information processing device.

[0610] During the visit, the device detects tourist attractions in the area and displays detailed information about them using augmented reality technology. This involves using an information processing device equipped with a camera, overlaying digitized information onto real-world images. Furthermore, emotion analysis is used to analyze the user's real-time facial expressions and voice to derive emotion evaluation results.

[0611] Based on these sentiment evaluation results, the server selects special offers that are appealing to the user and presents them to the user through the information processing device. For example, if the user shows a strong interest in a particular tourist spot, information about related special events will be provided in real time.

[0612] As a concrete example, if a user is viewing a particular painting in a museum, their facial expressions of surprise or emotion could be analyzed, and information about a special exhibition related to that painting could be presented. Using a generative AI model, prompt messages such as, "We will determine what emotions the user is feeling towards the displayed product and suggest promotions for related products based on those emotions," could be utilized.

[0613] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0614] Step 1:

[0615] The server obtains basic attribute information and areas of interest from the user's terminal. This input includes form entries and past behavioral data from the user. The server analyzes this data and generates the optimal sightseeing route for the user. The generated route data is output and sent to the user's terminal.

[0616] Step 2:

[0617] The terminal displays the tourist travel route received from the server. This process displays information about tourist destinations and a map showing the travel route on the user's screen. This output allows the user to visually confirm which place to visit next.

[0618] Step 3:

[0619] Upon arriving at a tourist destination, users obtain additional information presented through augmented reality technology using their devices. The device's camera captures the scenery, and AR technology overlays digital information onto it. This process outputs detailed information integrated with the real-world image.

[0620] Step 4:

[0621] The device captures the user's facial expressions and voice using its camera and microphone. This data is sent to an emotion analysis system to analyze the user's emotional state. The resulting emotion evaluation is output and sent to a server.

[0622] Step 5:

[0623] The server selects personalized special information based on the sentiment evaluation results. Here, a generative AI model is used to delve deeper into the user's level of interest and select relevant special events and promotions. The selected information is output and sent to the terminal.

[0624] Step 6:

[0625] The device displays special offer information received from the server to the user. This information is communicated to the user as on-screen notifications or AR displays. This output further stimulates the user's interest during their sightseeing and allows them to enjoy a richer experience.

[0626] Step 7:

[0627] After completing their tour, users enter feedback via their device. This feedback is sent to a server and used to generate future tour routes. This process accumulates data that helps improve the user experience.

[0628] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0629] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0630] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[0631] [Fourth Embodiment]

[0632] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[0633] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[0634] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0635] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[0636] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0637] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0638] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0639] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[0640] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0641] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0642] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0643] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0644] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0645] This invention is a tourist information system that personalizes the tourist experience based on the individual attribute information of the user. This system is implemented using a terminal owned by the user and a program that runs on the server side.

[0646] First, the server receives user attribute information and generates a user profile. This profile includes information about the user's interests and previously visited tourist destinations. Next, the server uses a generation method to generate a tourist route based on the user profile. The generated route is customized to the user's hobbies and preferences and includes suggestions for tourist destinations and information on special events.

[0647] The generated sightseeing route is then displayed on the device. The user visits the tourist destinations following this route. At the tourist destinations, the device uses augmented reality technology to retrieve character portraits and other display information. This allows the user to experience additional information and missions at the location.

[0648] The collected information is sent to the server and updated in the database as the user's visit history. This ensures that when a user revisits the same tourist destination, they will be provided with new information and experiences.

[0649] The system also receives user feedback and analyzes it on the server side. This feedback information is used to generate future sightseeing routes, providing an even more satisfying user experience.

[0650] As an example, consider a scenario where a user selects a tour themed around "historical buildings." Based on the user's profile, the server selects historical sites and displays special guide information and quizzes about local history on the user's device. After the visit, the user's feedback is used to provide new quizzes and in-depth information during their next visit.

[0651] Thus, the present invention aims to provide users with a fresh and personalized tourism experience and encourage them to revisit tourist destinations.

[0652] The following describes the processing flow.

[0653] Step 1:

[0654] Users log in to the system using their device and select their preferred travel themes and desired destinations. The device then sends this information to the server.

[0655] Step 2:

[0656] The server verifies the user profile based on the user's attribute information and selected theme, and generates a personalized sightseeing route using a generation method. The generated route includes recommended sightseeing spots and related events.

[0657] Step 3:

[0658] The server sends the generated tourist route information to the terminal. The terminal displays the received route to the user, allowing them to view the details.

[0659] Step 4:

[0660] The user begins sightseeing by following the route displayed on their device. At the tourist destinations they visit, the device uses augmented reality technology to scan installed character illustrations and AR content.

[0661] Step 5:

[0662] The device sends the acquired AR information to the server. The server records the user's visit history in a database and generates new experiences and missions based on that information.

[0663] Step 6:

[0664] The server sends newly generated experience information to the terminal, which then displays it to the user. The user then experiences the presented new missions and information.

[0665] Step 7:

[0666] After the tour ends, the user enters feedback about the experience on their device. The device then sends the feedback to the server.

[0667] Step 8:

[0668] The server analyzes the received feedback and stores it in a database. This feedback is then used to generate future sightseeing routes, improving the system to provide a more enriching experience.

[0669] (Example 1)

[0670] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0671] A challenge in tourist destinations is that user experiences do not adequately cater to individual interests and preferences, resulting in a lack of motivation for visitors to revisit destinations they have already visited. Furthermore, conventional systems do not fully utilize user feedback, making it difficult to provide personalized experiences.

[0672] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0673] In this invention, the server includes an information processing device that generates a customized sightseeing route based on the user's attribute information, means for generating a sightseeing route based on the user profile using a generation AI model and processing using prompt statements, and an information gathering device that collects user feedback information and reflects it in the generation of the sightseeing route. As a result, users are provided with experiences that match their interests and preferences, which increases their motivation to revisit.

[0674] "User attribute information" refers to information linked to an individual, such as a user's interests, preferences, and past browsing history.

[0675] A "tourist route" refers to information that suggests the order and path of visiting tourist destinations based on the user's attribute information.

[0676] An "information processing device" is a device that processes data based on user attribute information and has the function of generating customized tourist routes.

[0677] A "display device" is a device that visually presents tourist routes generated by an information processing device to the user.

[0678] A "data acquisition device" is a device that has the function of acquiring local information using virtual reality technology in tourist destinations.

[0679] An "update device" is a device that has the function of updating the user's visit history in a database based on acquired information.

[0680] A "providing device" is a device that has the function of providing users with new experience information based on their latest visit history.

[0681] An "information gathering device" is a device that receives feedback information from users and uses it to improve future service provision.

[0682] A "control device" is a device that dynamically adjusts the content of information provided through virtual reality technology according to the number of times a user visits.

[0683] A "generative AI model" is an artificial intelligence system that includes algorithms for suggesting optimal tourist routes based on user profiles.

[0684] A "prompt message" is a text-based instruction that gives a generative AI model a command to initiate the generation of specific information.

[0685] This invention is a tourist information system designed to customize the tourist experience based on the user's individual interests and preferences, thereby encouraging repeat visits. The system is implemented using a server and a terminal held by the user.

[0686] The server first receives attribute information sent from the user's device. This information includes the user's interests and past visit history. Next, the server uses a generative AI model to generate the optimal sightseeing route based on the received data. At this stage, prompts such as "If the user is interested in historical buildings, please generate a sightseeing route based on their interests" are used.

[0687] The generated sightseeing route is displayed on the user's device, and the user visits the tourist destinations according to it. Upon arrival at a tourist destination, the device uses augmented reality technology to present local information. This is achieved by using the device's camera and GPS functions to provide the user with special guide information and interactive quizzes.

[0688] After a user visits a location, the terminal sends information acquired from that location to the server, updating the user's visit history. This history data forms the basis for providing new experience information during future visits.

[0689] Furthermore, users can input feedback on their devices after their sightseeing experience. The server collects and analyzes this feedback and uses it to generate future sightseeing routes.

[0690] For example, if a user chooses castle touring as their theme and has previously visited several castles, the server will use that information to suggest a route that includes new castles and provide detailed historical background information about those specific castles. Through this process, users can deepen their interest and gain opportunities for further learning.

[0691] Thus, the system has the capability to continuously provide personalized tourism experiences that users desire.

[0692] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0693] Step 1:

[0694] The server receives attribute information transmitted from the user's terminal. This attribute information includes the user's interests, preferences, and past browsing history. The server analyzes this data and generates a user profile. This profile is output as a summarized version of the data indicating the user's specific areas of interest.

[0695] Step 2:

[0696] The server uses a generative AI model to generate sightseeing routes based on the user profile. This process takes prompts such as "If the user is interested in historical buildings, generate a sightseeing route based on their interests" as input. Based on these prompts, the AI ​​model selects the most suitable tourist destinations and outputs a customized route plan.

[0697] Step 3:

[0698] The user's device displays a sightseeing route received from the server. The device's input is the generated sightseeing route, and the output includes a map, a visit order, and detailed information about each sightseeing spot. This output allows the user to plan their trip according to the suggested route.

[0699] Step 4:

[0700] When a user visits a tourist destination, the device uses augmented reality technology to present information. The device receives GPS and camera data as input and displays virtual information about the local culture and history as output. This output includes visual and interactive elements to complement the user's experience.

[0701] Step 5:

[0702] After the user finishes sightseeing, the device sends the acquired information to the server. The input is data collected during the visit, and the server uses this data to update the user's visit history. This process outputs information that will provide a new experience on the next visit.

[0703] Step 6:

[0704] Users input feedback about their sightseeing experience on their device. The device sends this feedback to a server, which analyzes it. The analysis results are then used to generate future sightseeing routes, resulting in more customized routes. The output includes suggestions that better match the user's preferences.

[0705] (Application Example 1)

[0706] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0707] Modern consumers seek personalized shopping experiences that cater to diverse tastes and needs. However, traditional brick-and-mortar stores offer a uniform product display, making it difficult to provide flexible product guidance and purchasing experiences tailored to individual consumer preferences. Furthermore, the lack of mechanisms to immediately provide detailed product information within stores hinders the rapid progress of consumer purchasing decisions.

[0708] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0709] In this invention, the server includes a generation means for generating a customized product route based on user attribute information, a display means for displaying the product route generated by the generation means on a user terminal, and an acquisition means for acquiring information presented in a physical store using augmented reality technology. This enables product guidance tailored to the user's individual preferences and the provision of real-time product information within the store.

[0710] "User attribute information" refers to individual users' interests, purchase history, preferences, and related personal data.

[0711] A "product route" refers to an effective in-store product search path that is personalized based on a specific user profile.

[0712] "Generation means" refers to a system or process for customizing specific routes or information based on user attribute information.

[0713] "Display means" refers to digital or physical display devices or interfaces used to present information or routes generated on a user terminal.

[0714] "Acquisition means" refers to technologies and devices that use augmented reality technology to collect information presented within a physical store and provide it to the user's terminal.

[0715] "Update means" refers to the process or system used to keep a user's shopping history up-to-date based on information obtained through acquisition means.

[0716] "Means of delivery" refers to methods and devices for presenting new product information and experiences to users based on updated user data.

[0717] To implement this invention, it is necessary to build a system that generates product routes based on the user's individual attribute information and presents them to the terminal. This system is designed to allow users to enjoy a customized shopping experience within the store.

[0718] The server receives user attribute information and generates a user profile based on that information. Based on this user profile, the server generates a product route. The generated product route includes products tailored to the user's preferences and special offers. The product information is displayed on the smartphone device using React Native.

[0719] Within the store, users can use augmented reality technology via their devices to obtain detailed product information. This utilizes the device's camera function and implements ARKit (iOS) or ARCore (Android). This allows users to intuitively view product ingredient information and promotional details.

[0720] The acquired information is sent to the server and recorded in the database as the user's shopping history. This data is used to provide the user with more precise product recommendations on their next visit. Furthermore, the recommended products are updated regularly based on user feedback.

[0721] For example, if a user is interested in "organic food," the system will guide them to the relevant product section in the store and present information about how the products are grown and their nutritional content using augmented reality.

[0722] Examples of prompts to input into a generative AI model:

[0723] Create a program that takes user attribute information as input and generates personalized shopping routes and AR information. Include features to highlight eco-friendly products in physical stores and improve recommendations based on user feedback.

[0724] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0725] Step 1:

[0726] The server receives user attribute information, including the user's interests, past purchase history, and preferences. Based on this received data, a user profile is generated. This profile is a detailed record of the user's preferences and is used in the next step.

[0727] Step 2:

[0728] The server generates product routes based on the generated user profile. Using an AI algorithm, it calculates the optimal products and routes for the user from the data in the profile. The output is a specially customized product route, which is sent to the user's smartphone.

[0729] Step 3:

[0730] The device receives the product route sent from the server and displays it as a user interface using React Native. The user then follows the displayed product route to explore the store. This allows the user to obtain location information for products that match their interests.

[0731] Step 4:

[0732] Users scan specific products using their device's camera within a physical store. This operation is performed using augmented reality technology, with product information visually displayed via ARKit (iOS) or ARCore (Android). The input is the scanned product information, and the output is detailed information about that product.

[0733] Step 5:

[0734] The device sends the acquired product information to the server. The server uses this information to update the user's shopping history. This data processing makes it possible to provide a personalized experience for future purchases.

[0735] Step 6:

[0736] Users input feedback on product routes and suggestions into a terminal. This feedback is collected by the server and used to improve future product suggestions and route generation. The input is user feedback, and the output is improved product routes and suggestions.

[0737] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0738] This invention is a tourist information system that provides a customized tourist experience based on user attribute information, and also incorporates an emotion engine that recognizes the user's emotions. This system is operated through the cooperation of a user terminal and a server.

[0739] First, the server receives the user's basic attribute information, desired visiting area, and theme. Based on this information, the server designs and generates a specially customized sightseeing route using a generation method. The generated route reflects the user's interests and past visit history, and includes sightseeing spots and special events.

[0740] The generated sightseeing route is sent to the user's device, allowing the user to begin sightseeing according to that route. At the tourist destinations visited, the device scans AR content displayed using augmented reality technology to obtain various information.

[0741] This system also incorporates an emotion engine, which analyzes the user's emotions in real time from their facial expressions, voice tone, and input data. The analyzed emotion data is sent to a server, which then provides new information and missions tailored to the user's mood. For example, if the system detects that the user is enjoying themselves, it can suggest additional events or spots that might be of particular interest to them.

[0742] Furthermore, after the tour ends, user feedback is collected via the device and sent to the server. The feedback data and sentiment data are then used through the feedback system to improve individual experiences and are reflected in the design of future routes.

[0743] As a concrete example, consider a case where a user requests a trip themed around "nature." Based on the user's emotional data, the server provides additional information and missions related to the areas where the user felt moved or soothed during their visit. The goal of this process is to provide an optimal travel experience tailored to each individual user and to increase their desire to revisit the tourist destination.

[0744] The following describes the processing flow.

[0745] Step 1:

[0746] Users log in to the system using their device and select their preferred travel themes and regions they wish to visit. The device then sends this information to the server.

[0747] Step 2:

[0748] The server uses a generation mechanism to generate the optimal sightseeing route based on the received user information and attribute information including past visit data. The generated route includes sightseeing spots and event information tailored to the user's interests.

[0749] Step 3:

[0750] The server sends the generated sightseeing route to the device. The device displays this information to the user and prompts them to follow the suggested route.

[0751] Step 4:

[0752] When a user visits a tourist destination, they use a device to scan character panels and local AR content using augmented reality technology. The device then sends the acquired information to a server.

[0753] Step 5:

[0754] The server updates the user's visit history based on the acquired data. Furthermore, the emotion engine analyzes the user's emotions and sends them to the server.

[0755] Step 6:

[0756] The server considers emotional data and visit history to generate new experience information and missions, and delivers content to the device that matches the user's emotional state.

[0757] Step 7:

[0758] Users deepen their experience at tourist destinations based on the new information provided. After completing their sightseeing, they use their device to input feedback about their experience.

[0759] Step 8:

[0760] The device sends feedback to the server, which analyzes the received feedback and stores it in a database. This information is used to generate future sightseeing routes and further improve the user experience.

[0761] (Example 2)

[0762] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0763] Traditional tourist information systems have struggled to provide tourist experiences that fully reflect the individual interests and feelings of users. Furthermore, they lacked mechanisms to utilize user feedback and opinions after an experience for future experiences. As a result, there were limitations in increasing user satisfaction and the desire to return.

[0764] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0765] In this invention, the server includes a generation means for generating customized routes based on the user's personal information, an acquisition means for acquiring information presented using augmented reality technology in a specific area, and a suggestion means for analyzing the user's emotions and dynamically suggesting information based on the analysis results. This enables the provision of a tourism experience tailored to each individual user and real-time suggestions based on emotions.

[0766] "Personal information" refers to information that identifies a user and includes attribute data used to customize tourist routes.

[0767] The "generation method" is a system for creating customized tourist routes based on the user's personal information.

[0768] "Display means" refers to devices or technologies for visually outputting the generated tourist route to the user's communication device.

[0769] "Means of acquisition" refers to the function of collecting information presented using augmented reality technology in a specific area.

[0770] "Update methods" refer to the process of keeping a user's visit history up-to-date based on the acquired information.

[0771] "Means of provision" refers to methods for supplying users with new experience information based on updated visit history.

[0772] "Emotional analysis" is a technology that analyzes users' emotions and dynamically makes suggestions based on the results.

[0773] The "suggestion method" is a function that recommends the most suitable events and information during sightseeing based on the results of the user's sentiment analysis.

[0774] A "feedback method" is a technique for accumulating user evaluation information and using it to generate future tourist routes.

[0775] The "control mechanism" is a system that adjusts the information presented using augmented reality technology according to the number of times a user has visited the site.

[0776] The present invention's tourist information system is designed to provide a customized tourist experience that reflects the user's individual interests and feelings. This system operates primarily through communication between a server and a terminal, both of which play important roles.

[0777] First, the user inputs basic personal information, desired visiting areas, and themes through their device. The device then sends this data to the server. The server receives this data and uses a generative AI model to generate a personalized sightseeing route for each user. In this process, the server retrieves past visit history and related information from a large database and inputs prompts into the generative AI model. One example of such a prompt is, "Generate a customized sightseeing route based on the user's attribute information. The theme should be nature, and information related to the desired visiting area should be considered."

[0778] The generated route information is sent from the server to the terminal and displayed. The user then begins sightseeing according to this information, and at each destination, they can use the camera and microphone on the terminal to obtain diverse information in real time using content provided by augmented reality technology.

[0779] The device also features an emotion engine that analyzes the user's facial expressions and voice, and sends the resulting emotion data to a server. The server uses this data to dynamically suggest information and missions in order to provide the optimal sightseeing experience tailored to the user's emotions.

[0780] After completing their tour, users send feedback from their device to the server. This feedback is used to improve future experiences. Overall, the system aims to engage with users' emotions and provide an engaging experience in real time.

[0781] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0782] Step 1:

[0783] The user uses a device to enter personal information, desired visit area, and theme. The device then formats this information appropriately for transmission to the server and sends it as a data packet. Specific examples of information entered include name, age, and areas of interest.

[0784] Step 2:

[0785] The server uses a generation AI model based on the received user information to generate a customized sightseeing route. In this process, the server analyzes personal information, extracts relevant information from the database, and inputs prompt messages into the generation AI model. These prompt messages then output a sightseeing route optimized for the user.

[0786] Step 3:

[0787] The generated sightseeing route information is sent from the server to the terminal. The terminal displays this information to the user and prepares to launch the map application or guide function to begin sightseeing. The information output at this point is a list of specific sightseeing spots and routes.

[0788] Step 4:

[0789] Users utilize augmented reality (AR) technology by using the camera function on their device at the tourist destinations they visit. The device scans QR codes and AR markers displayed at the destination to provide detailed information and stories. The input data consists of images and marker information, which is then analyzed to display relevant content.

[0790] Step 5:

[0791] The device uses an emotion engine to analyze the user's facial expressions and voice tone in real time. The analyzed emotion data is sent to a server, which dynamically suggests appropriate events and additional information according to the user's emotional state. The input data consists of camera video and audio data, while the output information consists of recommended content and missions.

[0792] Step 6:

[0793] After completing their tour, users enter feedback on their experience into a terminal. The terminal sends the collected feedback data to a server. The server analyzes this data and uses it to improve future tour route generation. The input data consists of text comments and ratings, while the output information represents an improved route generation process.

[0794] (Application Example 2)

[0795] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0796] In recent years, the tourism sector has seen a growing demand for personalized experiences tailored to individual users. However, conventional systems have struggled to provide services that reflect users' emotional changes and interests in real time. Furthermore, user visits tend to be fleeting, and there have been insufficient mechanisms to encourage repeat visits. Therefore, there is a need to develop effective tourism experiences that take user emotions into consideration, as well as methods to increase the desire for repeat visits.

[0797] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0798] In this invention, the server includes a generation means for generating customized sightseeing routes based on user attribute information, an acquisition means for acquiring information presented in the region using augmented reality technology, and an emotion response provision means for analyzing the user's facial expressions, voice, and input data using emotion analysis means and presenting information according to the emotion evaluation results. This makes it possible to provide a personalized experience based on the user's emotional changes and to present special information that arouses interest in real time. This can improve user satisfaction and increase the desire to revisit.

[0799] A "user" is an individual who uses this system to enjoy a tourism experience.

[0800] "Attribute information" refers to basic information about a user, as well as data indicating their preferences and interests.

[0801] A "tourist travel route" is a recommended route for sightseeing that is customized based on the user's attribute information and interests.

[0802] "Generating means" refers to a device or program that has the function of collecting and analyzing information to create routes or data for a specific purpose.

[0803] An "information processing device" is a device that processes digital data and presents information to the user.

[0804] Augmented reality technology is a technology that overlays digital information onto the real world environment.

[0805] "Acquisition means" refers to a device or program that has the function of receiving information from an external source.

[0806] "Past activity history" refers to a record of places a user has visited and activities they have undertaken in the past.

[0807] "Update means" refers to a device or program that has the function of modifying or adding to existing data based on newly acquired information.

[0808] "Emotional analysis means" refers to a device or program that has the function of processing emotional data in order to analyze and evaluate the emotions of a user.

[0809] "Emotional evaluation results" refer to the evaluation results of the user's emotional state derived from emotional analysis methods.

[0810] "Information" refers to knowledge and data provided in digital format.

[0811] "Special Offer Information" refers to data or offers of exceptional value that differ from the information that is normally provided.

[0812] This invention is a system for providing a user-optimized sightseeing experience based on user attribute information. The system operates when a user is sightseeing via a smart device, and a specific embodiment of this system is configured as follows.

[0813] The server retrieves the user's basic attribute information and interests from user input or previous data. This information is used to generate the most suitable sightseeing route for the user. The generated sightseeing route is then communicated to the user through an information processing device.

[0814] During the visit, the device detects tourist attractions in the area and displays detailed information about them using augmented reality technology. This involves using an information processing device equipped with a camera, overlaying digitized information onto real-world images. Furthermore, emotion analysis is used to analyze the user's real-time facial expressions and voice to derive emotion evaluation results.

[0815] Based on these sentiment evaluation results, the server selects special offers that are appealing to the user and presents them to the user through the information processing device. For example, if the user shows a strong interest in a particular tourist spot, information about related special events will be provided in real time.

[0816] As a concrete example, if a user is viewing a particular painting in a museum, their facial expressions of surprise or emotion could be analyzed, and information about a special exhibition related to that painting could be presented. Using a generative AI model, prompt messages such as, "We will determine what emotions the user is feeling towards the displayed product and suggest promotions for related products based on those emotions," could be utilized.

[0817] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0818] Step 1:

[0819] The server obtains basic attribute information and areas of interest from the user's terminal. This input includes form entries and past behavioral data from the user. The server analyzes this data and generates the optimal sightseeing route for the user. The generated route data is output and sent to the user's terminal.

[0820] Step 2:

[0821] The terminal displays the tourist travel route received from the server. This process displays information about tourist destinations and a map showing the travel route on the user's screen. This output allows the user to visually confirm which place to visit next.

[0822] Step 3:

[0823] Upon arriving at a tourist destination, users obtain additional information presented through augmented reality technology using their device. The device's camera captures the scenery, and AR technology overlays digital information onto it. This process outputs detailed information integrated with the real-world image.

[0824] Step 4:

[0825] The device captures the user's facial expressions and voice using its camera and microphone. This data is sent to an emotion analysis system to analyze the user's emotional state. The resulting emotion evaluation is output and sent to a server.

[0826] Step 5:

[0827] The server selects personalized special information based on the sentiment evaluation results. Here, a generative AI model is used to delve deeper into the user's level of interest and select relevant special events and promotions. The selected information is output and sent to the terminal.

[0828] Step 6:

[0829] The device displays special offer information received from the server to the user. This information is communicated to the user as on-screen notifications or AR displays. This output further stimulates the user's interest during their sightseeing and allows them to enjoy a richer experience.

[0830] Step 7:

[0831] After completing their tour, users enter feedback via their device. This feedback is sent to a server and used to generate future tour routes. This process accumulates data that helps improve the user experience.

[0832] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0833] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0834] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.

[0835] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[0836] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.

[0837] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.

[0838] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.

[0839] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.

[0840] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."

[0841] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.

[0842] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.

[0843] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.

[0844] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[0845] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[0846] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[0847] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[0848] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[0849] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[0850] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[0851] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[0852] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted as being incorporated by reference.

[0853] The following is further disclosed regarding the embodiments described above.

[0854] (Claim 1)

[0855] A generation method for generating customized tourist routes based on user attribute information,

[0856] A display means that displays a tourist route generated by the generation means on a user terminal,

[0857] A means of acquiring information displayed using augmented reality technology in a tourist destination,

[0858] An update means for updating the user's visit history based on the information obtained by the acquisition means,

[0859] A system including a means for providing new experience information based on the aforementioned update means.

[0860] (Claim 2)

[0861] The system according to claim 1, further comprising a feedback means for collecting user feedback information and reflecting it in the generation of future tourist routes.

[0862] (Claim 3)

[0863] The system according to claim 1, further comprising control means for controlling the information presented using the augmented reality technology to change based on the number of times the user has visited.

[0864] "Example 1"

[0865] (Claim 1)

[0866] An information processing device that generates customized tourist routes based on user attribute information,

[0867] A display device that displays information on a user information terminal based on the tourist route generated by the aforementioned information processing device,

[0868] An acquisition device that uses virtual reality technology to acquire information in tourist destinations,

[0869] An update device that updates the user's visit history based on the information obtained by the acquisition device,

[0870] A providing device that provides new experience information based on the aforementioned update device,

[0871] An information gathering device that collects user feedback information and reflects it in the generation of future tourist routes,

[0872] A control device that controls the information presented using the acquisition device to change based on the number of visits by the user,

[0873] A system that includes this.

[0874] (Claim 2)

[0875] The system according to claim 1, which generates tourist routes based on user profiles using a generative AI model, and includes a process of using prompt statements in the process.

[0876] (Claim 3)

[0877] The system according to claim 1, which includes processing to present local information and missions using virtual reality technology based on the user's location information, thereby enriching the user's experience.

[0878] "Application Example 1"

[0879] (Claim 1)

[0880] A generation method for generating customized product routes based on user attribute information,

[0881] A display means that displays on the user terminal based on the product route generated by the generation means,

[0882] A means of acquiring information presented using augmented reality technology in a physical store,

[0883] An update means for updating the user's shopping history based on the information obtained by the acquisition means,

[0884] A system including a means for providing new product information based on the aforementioned update means.

[0885] (Claim 2)

[0886] The system according to claim 1, further comprising a feedback means for collecting user feedback information and reflecting it in the generation of future product routes.

[0887] (Claim 3)

[0888] The system according to claim 1, further comprising control means for controlling the information presented using the augmented reality technology to change based on the number of times the user has visited.

[0889] "Example 2 of combining an emotion engine"

[0890] (Claim 1)

[0891] A generation means for generating customized routes based on the user's personal information,

[0892] A display means for displaying a path generated by the generation means on a communication device,

[0893] A means of acquiring information presented using augmented reality technology in a specific region,

[0894] An update means for updating the user's behavior history based on the information obtained by the acquisition means,

[0895] A means for providing new experience information based on the update means,

[0896] A system that analyzes user emotions and includes a suggestion mechanism that dynamically proposes information based on the analysis results.

[0897] (Claim 2)

[0898] The system according to claim 1, further comprising a feedback means for collecting evaluation information from users and reflecting it in route generation for subsequent routes.

[0899] (Claim 3)

[0900] The system according to claim 1, further comprising control means for controlling the information presented using the augmented reality technology to change based on the number of visits by the user.

[0901] "Application example 2 when combining with an emotional engine"

[0902] (Claim 1)

[0903] A generation means for generating customized sightseeing routes based on user attribute information,

[0904] A display means for displaying information on an information processing device based on the tourist travel route generated by the generation means,

[0905] A means of acquiring information presented using augmented reality technology in a region,

[0906] An update means for updating the user's past behavior history based on the information obtained by the acquisition means,

[0907] A means for providing new experience information based on the update means,

[0908] An emotion response providing means that analyzes the user's facial expressions, voice, and input data using emotion analysis means and presents information according to the emotion evaluation results,

[0909] The aforementioned emotional response providing means presents special information related to the emotional evaluation results,

[0910] A system that includes this.

[0911] (Claim 2)

[0912] The system according to claim 1, further comprising a feedback means for collecting user feedback information and reflecting it in the generation of future tourist travel routes.

[0913] (Claim 3)

[0914] The system according to claim 1, further comprising control means for controlling the information presented using the augmented reality technology to change based on the number of times the user has visited. [Explanation of symbols]

[0915] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>

Claims

1. A generation method for generating customized tourist routes based on user attribute information, A display means that displays a tourist route generated by the generation means on a user terminal, A means of acquiring information displayed using augmented reality technology in a tourist destination, An update means for updating the user's visit history based on the information obtained by the acquisition means, A system including a means for providing new experience information based on the aforementioned update means.

2. The system according to claim 1, further comprising a feedback means for collecting user feedback information and reflecting it in the generation of future tourist routes.

3. The system according to claim 1, further comprising control means for controlling the information presented using the augmented reality technology to change based on the number of times the user has visited.

Images